-- Logs begin at Fri 2022-09-09 20:14:57 UTC, end at Fri 2022-09-09 21:12:15 UTC. -- Sep 09 20:41:31.040152 dv-cinder-831247-28-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 09 20:41:31.049209 dv-cinder-831247-28-smb devstack@keystone.service[81385]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 09 20:41:31.051216 dv-cinder-831247-28-smb devstack@keystone.service[81385]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 9 20:41:31 2022] *** Sep 09 20:41:31.051216 dv-cinder-831247-28-smb devstack@keystone.service[81385]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 09 20:41:31.051216 dv-cinder-831247-28-smb devstack@keystone.service[81385]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 09 20:41:31.051216 dv-cinder-831247-28-smb devstack@keystone.service[81385]: nodename: dv-cinder-831247-28-smb Sep 09 20:41:31.051216 dv-cinder-831247-28-smb devstack@keystone.service[81385]: machine: x86_64 Sep 09 20:41:31.051216 dv-cinder-831247-28-smb devstack@keystone.service[81385]: clock source: unix Sep 09 20:41:31.051216 dv-cinder-831247-28-smb devstack@keystone.service[81385]: pcre jit disabled Sep 09 20:41:31.051216 dv-cinder-831247-28-smb devstack@keystone.service[81385]: detected number of CPU cores: 4 Sep 09 20:41:31.051216 dv-cinder-831247-28-smb devstack@keystone.service[81385]: current working directory: / Sep 09 20:41:31.051216 dv-cinder-831247-28-smb devstack@keystone.service[81385]: detected binary path: /usr/bin/uwsgi-core Sep 09 20:41:31.051216 dv-cinder-831247-28-smb devstack@keystone.service[81385]: your processes number limit is 47680 Sep 09 20:41:31.051795 dv-cinder-831247-28-smb devstack@keystone.service[81385]: your memory page size is 4096 bytes Sep 09 20:41:31.051795 dv-cinder-831247-28-smb devstack@keystone.service[81385]: detected max file descriptor number: 2048 Sep 09 20:41:31.051795 dv-cinder-831247-28-smb devstack@keystone.service[81385]: lock engine: pthread robust mutexes Sep 09 20:41:31.051795 dv-cinder-831247-28-smb devstack@keystone.service[81385]: thunder lock: enabled Sep 09 20:41:31.051795 dv-cinder-831247-28-smb devstack@keystone.service[81385]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 09 20:41:31.051795 dv-cinder-831247-28-smb devstack@keystone.service[81385]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 09 20:41:31.092913 dv-cinder-831247-28-smb devstack@keystone.service[81385]: Python main interpreter initialized at 0x5566c37ab9c0 Sep 09 20:41:31.092913 dv-cinder-831247-28-smb devstack@keystone.service[81385]: python threads support enabled Sep 09 20:41:31.092913 dv-cinder-831247-28-smb devstack@keystone.service[81385]: your server socket listen backlog is limited to 100 connections Sep 09 20:41:31.092913 dv-cinder-831247-28-smb devstack@keystone.service[81385]: your mercy for graceful operations on workers is 90 seconds Sep 09 20:41:31.093255 dv-cinder-831247-28-smb devstack@keystone.service[81385]: mapped 403077 bytes (393 KB) for 2 cores Sep 09 20:41:31.093345 dv-cinder-831247-28-smb devstack@keystone.service[81385]: *** Operational MODE: preforking *** Sep 09 20:41:31.093593 dv-cinder-831247-28-smb devstack@keystone.service[81385]: *** uWSGI is running in multiple interpreter mode *** Sep 09 20:41:31.093593 dv-cinder-831247-28-smb devstack@keystone.service[81385]: spawned uWSGI master process (pid: 81385) Sep 09 20:41:31.093787 dv-cinder-831247-28-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 09 20:41:31.098087 dv-cinder-831247-28-smb devstack@keystone.service[81385]: spawned uWSGI worker 1 (pid: 81397, cores: 1) Sep 09 20:41:31.098087 dv-cinder-831247-28-smb devstack@keystone.service[81385]: spawned uWSGI worker 2 (pid: 81398, cores: 1) Sep 09 20:41:31.098087 dv-cinder-831247-28-smb devstack@keystone.service[81385]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 09 20:41:35.407679 dv-cinder-831247-28-smb devstack@keystone.service[81398]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 20:41:35.407679 dv-cinder-831247-28-smb devstack@keystone.service[81398]: from cryptography.utils import int_from_bytes Sep 09 20:41:35.408537 dv-cinder-831247-28-smb devstack@keystone.service[81398]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 20:41:35.408537 dv-cinder-831247-28-smb devstack@keystone.service[81398]: from cryptography.utils import int_from_bytes Sep 09 20:41:35.412384 dv-cinder-831247-28-smb devstack@keystone.service[81397]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 20:41:35.412384 dv-cinder-831247-28-smb devstack@keystone.service[81397]: from cryptography.utils import int_from_bytes Sep 09 20:41:35.412838 dv-cinder-831247-28-smb devstack@keystone.service[81397]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 09 20:41:35.412838 dv-cinder-831247-28-smb devstack@keystone.service[81397]: from cryptography.utils import int_from_bytes Sep 09 20:41:35.459048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 20:41:35.459241 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 20:41:35.459436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] command line args: [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 20:41:35.459711 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 20:41:35.459892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ================================================================================ {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 20:41:35.460172 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] admin_token = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.460424 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] config_dir = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.460615 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.460800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] config_source = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.460985 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] debug = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.461134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 09 20:41:35.461213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.461437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 09 20:41:35.461507 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] command line args: [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 09 20:41:35.461563 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.461722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.461838 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 09 20:41:35.461941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ================================================================================ {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 09 20:41:35.462041 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.462206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] admin_token = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.462310 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.462438 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.462545 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] config_dir = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.462662 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_config_append = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.462762 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.462862 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.462961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] config_source = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.463059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_dir = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.463158 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] debug = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.463262 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_file = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.463363 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.463515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.463634 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.463634 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.463859 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.463978 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.464122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.464242 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.464360 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.464482 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.464605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.464726 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_config_append = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.464838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.464950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.465062 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.465182 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_dir = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.465182 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_file = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.465387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.465504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.465621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.465621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.465839 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.465956 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.466075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.466185 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.466302 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.466302 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.466533 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.466644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.466762 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.466873 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.466984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.467097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.467097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.467333 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.467447 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.467564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] publish_errors = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.467684 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.467796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.467912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.468049 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.468165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.468287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.468408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.468526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.468526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.468724 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.468836 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] standard_threads = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.468836 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.469062 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.469062 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] publish_errors = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.469292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.469292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.469512 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.469628 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] use_journal = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.469741 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.469858 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] use_json = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.469980 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.470099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] use_stderr = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.470212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.470935 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] use_syslog = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.471051 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.471163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.471344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] standard_threads = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.471467 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.471467 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.471678 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.471790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.471902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.471902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.472149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.472269 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] use_journal = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.472389 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.472502 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] use_json = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.472614 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.472734 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] use_stderr = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.472734 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] use_syslog = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.472944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.473062 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 09 20:41:35.473180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.473293 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.473414 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.473528 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.473640 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.473757 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.473869 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.473981 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.474100 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.474214 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.474325 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.474438 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.474549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.474665 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.474789 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.474908 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.475026 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.475139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.475250 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.475368 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.475493 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.475607 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.475718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.475835 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.475955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.476104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.476228 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.476342 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.476454 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.476567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.476678 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.476789 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.476981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.477103 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.477217 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.477335 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.477454 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.477576 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.477690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.477801 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.477913 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.478024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.478135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.478254 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.478367 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.478479 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.478591 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.478709 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.478822 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.478942 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.479055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.479167 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.479284 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.479402 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.479515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.479635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.479749 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.479861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.479973 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.480101 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.480224 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.480346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.480466 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.480578 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.480691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.480803 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.480915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.481034 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.481147 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.481264 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.481377 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.481489 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.481600 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.481720 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.481846 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.481960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.482071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.482183 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.482300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.482487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.482870 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.482983 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.483095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.483208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.483319 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.483430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.483548 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.483662 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.483781 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.483900 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.484066 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.484195 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.484315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.484429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.484541 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.484657 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.484770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.484893 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.485007 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.485119 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.485231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.485342 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.485444 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.485546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.485640 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.485733 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.485861 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.485996 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.486182 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.486361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.486497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.486611 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.486724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.486837 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.486939 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.487059 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.487173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.487276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.487392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.487392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.487614 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.487729 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.487853 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.487958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.488090 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.488090 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.488315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.488315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.488537 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.488651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.488770 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.488884 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.488996 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.489109 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.489230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.489352 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.489465 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.489578 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.489687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.489799 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.489923 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.490026 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.490145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.490259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.490361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.490471 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.490592 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.490705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.490817 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.490929 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.491041 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.491153 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.491278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.491398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.491518 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.491631 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.491743 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.491854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.491976 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.492118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.492232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.492346 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.492458 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.492571 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.492726 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.492856 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.492971 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.493084 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.493196 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.493309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.493431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.493544 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.493656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.493775 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.493888 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.494000 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.494189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.494305 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.494418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.494530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.494646 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.494769 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.494892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.495014 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.495134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.495247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.495360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.495474 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.495586 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.495709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.495824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.495936 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.496066 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.496180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.496303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.496426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.496547 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.496661 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.496774 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.496902 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.external = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.497063 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.497214 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.497343 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.497343 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.497566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.497682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.497825 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.497949 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.498064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.password = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.498064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] auth.token = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.498301 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.498422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.498537 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.498650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.498769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.498891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.499007 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.external = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.499120 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.499234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.499348 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.499468 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.499592 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.499707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.499821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.499934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.password = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.500106 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.500222 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] auth.token = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.500348 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.500464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.500578 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.500699 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.500815 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.500929 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.500929 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.501153 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.501267 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.501387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.501387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.501601 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.501601 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.501826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.501940 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.502066 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.502231 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.502349 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.502473 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.502588 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.502701 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.502816 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.502816 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.503029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.503151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.503266 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.503388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.503509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.503624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.503738 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.503900 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.504034 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.504151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.504265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.504379 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.504493 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.504623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.504739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.504854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.504968 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.505082 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.505204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.505319 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.505432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.505545 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.505659 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.505773 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.505896 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.506011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.506126 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.506239 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.506352 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.506466 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.506589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.506705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.506818 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.506932 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.507046 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.507160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.507283 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.507398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.507512 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.507626 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.507748 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.507863 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.508078 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.508199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.508320 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.508442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.508557 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.508662 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.508783 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.508898 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.509014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.509128 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.509242 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.509356 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.509477 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.509592 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.509706 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.509820 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.509934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.510049 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.510172 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.510287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.510410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.510525 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.510646 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.510768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.510892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.511007 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.511122 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.511242 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.511357 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.511471 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.511593 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.511709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.511812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.511924 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.512087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.512205 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.512335 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.512452 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.512566 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.512680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.512794 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.512908 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.513030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.513146 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.513262 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.513375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.513488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.513602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.513724 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.513838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.513953 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.514066 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.514180 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.514294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.514417 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.514535 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.514650 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.514765 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.514877 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.514999 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.515114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.515228 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.515343 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.515456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.515570 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.515692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.515808 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.515922 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.516047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.516174 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.516296 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.516420 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.516536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.516536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.516749 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.516863 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.516978 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.517599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.517723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.517866 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.518030 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.518149 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.518263 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.518385 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.518503 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.518617 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.518731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.518854 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.518969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.519092 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.519208 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.519322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.519436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.519551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.519666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.519796 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.519914 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.520042 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.520159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.520273 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.520387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.520514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.520631 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.520746 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.520861 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.520976 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.521091 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.521214 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.521330 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.521445 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.521560 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.521675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.521789 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.521911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.522027 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.522142 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.522257 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.522371 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.522485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.522608 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.522724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.522840 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.522953 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.523067 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.523182 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.523304 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.523420 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.523534 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.523649 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.523764 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.523877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.524030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.524149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.524263 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.524377 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.524744 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.524862 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.524989 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.525106 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.525219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.525332 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.525446 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.525559 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.525681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.525798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.525912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.526025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.526139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.526252 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.526374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.526489 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.526602 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.526716 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.526830 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.526943 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.527065 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.527181 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.527301 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.527416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.527530 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.527644 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.527766 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.527883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.528016 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.528132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.528245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.528358 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.528484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.528600 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.528714 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.528827 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.528942 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.529055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.529177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.529292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.529406 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.529519 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.529632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.529746 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.529868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.529984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.530117 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.530228 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.530341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.530455 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.530576 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.530698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] role.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.530812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.530935 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] role.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.531055 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.531246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.531363 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.531477 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.531591 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.531709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.531825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.531946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.532119 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.532234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.532349 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.532462 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.532576 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] role.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.532701 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.533401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] role.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.533516 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.533631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.533776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.533932 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.534058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.534175 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.534297 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.534413 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.534532 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.534646 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.534769 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.534884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.534999 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.535113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.535113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.535336 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.535458 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.535573 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.535686 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.535799 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.535913 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.536047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.536175 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.536294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.536414 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.536529 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.536643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.536757 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.536757 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.536981 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.537095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.537209 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.537324 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.537446 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.537561 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.537675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.537788 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.537901 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.538014 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.538136 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.538251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.538365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.538479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.538592 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.538706 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.538827 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.538942 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.539056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.539170 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.539282 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.539396 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.539518 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.539633 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.539746 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.539860 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.539973 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.540108 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.540234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.540350 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.540464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.540578 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.540691 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.540803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.540924 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.541039 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.541153 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.541265 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.541379 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.541492 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.541615 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.541730 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.541843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.541956 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.542070 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.542183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.542304 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.542420 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.542533 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.542648 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.542761 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.542875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.542996 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.543111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.543233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.543357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.543472 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.543585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.543700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.543822 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.connection = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.543937 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.544119 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.544235 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.544348 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.544467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.544593 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.544710 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.544823 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.544937 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.545059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.545183 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.545298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.545411 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.545538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.545654 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.connection = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.545769 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.545883 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.545997 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.546110 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.546233 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.546348 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.546462 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.546576 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.546689 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.546804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.546927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.547042 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.547156 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.547270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.547383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.547496 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.547618 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.547740 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.547857 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.547971 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.548105 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.548105 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 20:41:35.548361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.548361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.548361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.548361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.548361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.548361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.549186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.549186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 09 20:41:35.549186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81397) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 09 20:41:35.576546 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.576725 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.576951 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.577035 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.577273 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.577505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.586002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.586262 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.614532 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.614765 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.615237 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.615474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.668468 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.669130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.717657 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.717892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.718522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.718764 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.876900 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.877124 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.877235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.877319 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.877395 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.877528 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.877613 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.877751 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.877834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.877970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.878067 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.878193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.901642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.901874 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.902024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.902109 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.902262 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.902346 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.902491 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.902573 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.902722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.902814 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.902935 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.903015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.903157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.903376 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.914733 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.914887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.928079 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.928315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.928544 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.928753 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.928837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.928978 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.929060 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.929197 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.929278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.929416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81398) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.929499 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.929635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.929855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.930074 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81397) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 09 20:41:35.946399 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.946613 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 20:41:35.946964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.947095 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.947177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 20:41:35.947292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 20:41:35.947432 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.947649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.947729 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.947856 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 09 20:41:35.947936 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.948162 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.948247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.948433 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.948701 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.948964 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.957918 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.958205 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.958484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.958609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.958773 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.958893 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.959167 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.959456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.965820 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:35.966481 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:35.968772 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:35.969062 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.969357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.969436 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:35.969645 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.969727 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.969936 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.970025 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.970794 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.970939 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.971078 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.971220 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.971346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.971427 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.971596 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.971679 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.971874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.971963 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.972183 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.972264 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.972465 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.972742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.995571 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.996143 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.997092 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:35.997385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:35.997627 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:35.997921 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.002205 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.002501 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.002745 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.002826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.003033 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.003320 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.009216 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.009507 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.009777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.010071 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.015179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.015485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.015708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.015791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.016036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.016163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.016332 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.016429 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.016625 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.016708 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.016910 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.016998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.017732 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.017835 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.018012 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.018288 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.034222 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.034501 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.034658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.034943 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.038368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.038844 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.041614 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.041916 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.042125 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.042428 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.046105 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.046676 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.049288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.049873 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.052586 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.052895 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.053125 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.053207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.053430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.053510 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.053719 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.053808 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.054005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.054086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.054301 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.054599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.069912 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.070213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.070454 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.070535 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.070743 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.070823 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.071014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.071283 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.077662 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.078279 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.079214 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.080458 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.081350 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.081635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.082190 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.082473 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.084375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.084668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.084956 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.085197 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.085276 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.085487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.085644 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.085781 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.086074 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.086468 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.097434 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.097727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.098017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.098306 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.098385 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.098668 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.098756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.098951 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.099032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.099236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.099317 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.099623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.099916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.100226 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.115275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.116335 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.118209 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.119260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.121170 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.122204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.122653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.123699 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.124188 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.124478 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.124879 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.125204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.125493 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.125895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.131916 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.133108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.133360 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.134594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.136297 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.136699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.136991 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.137275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.137539 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.137941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.138234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.138520 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.145308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.145618 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.145904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.146436 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.146747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.147042 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.153119 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81398) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.153406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.153689 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.153968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.154236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81397) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 09 20:41:36.154317 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.154511 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.154590 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.154789 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.154870 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.155069 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.155146 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.155342 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.155428 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.155617 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.155705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.155901 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.156016 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.156228 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.156309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.156507 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.156600 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.156800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.156884 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81398) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.157063 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.157339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.157614 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.157920 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81397) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 09 20:41:36.192514 dv-cinder-831247-28-smb devstack@keystone.service[81398]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5566c37ab9c0 pid: 81398 (default app) Sep 09 20:41:36.193421 dv-cinder-831247-28-smb devstack@keystone.service[81397]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5566c37ab9c0 pid: 81397 (default app) Sep 09 20:41:36.195774 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5bac5-f147-43b5-8635-bbd84cb1502a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:36.196095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5bac5-f147-43b5-8635-bbd84cb1502a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:36.196376 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5bac5-f147-43b5-8635-bbd84cb1502a None None] PATH_INFO: `/v3` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:36.200505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Fri Sep 9 20:41:36 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:41:42.984864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6eeea-bd38-422f-9806-244a00647b83 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:42.985399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6eeea-bd38-422f-9806-244a00647b83 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:42.985399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6eeea-bd38-422f-9806-244a00647b83 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:42.989839 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:41:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:41:42.995085 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700f1c6-6ce5-47b3-9baa-64e02d1b6acb None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:42.995663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700f1c6-6ce5-47b3-9baa-64e02d1b6acb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:42.995663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2700f1c6-6ce5-47b3-9baa-64e02d1b6acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:43.065826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: INFO dbcounter [None req-2700f1c6-6ce5-47b3-9baa-64e02d1b6acb None None] Registered counter for database keystone Sep 09 20:41:43.084784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG oslo_db.sqlalchemy.engines [None req-2700f1c6-6ce5-47b3-9baa-64e02d1b6acb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:41:43.090923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writer thread running {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:41:43.270941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG passlib.handlers.bcrypt [None req-2700f1c6-6ce5-47b3-9baa-64e02d1b6acb None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81398) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 20:41:43.271237 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG passlib.handlers.bcrypt [None req-2700f1c6-6ce5-47b3-9baa-64e02d1b6acb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81398) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 20:41:43.330884 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2700f1c6-6ce5-47b3-9baa-64e02d1b6acb None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:41:43.332531 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2700f1c6-6ce5-47b3-9baa-64e02d1b6acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:41:43.459775 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:41:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 09 20:41:43.925663 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6eeea-bd38-422f-9806-244a00647b83 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:43.995191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: INFO dbcounter [None req-86f6eeea-bd38-422f-9806-244a00647b83 None None] Registered counter for database keystone Sep 09 20:41:44.017595 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG oslo_db.sqlalchemy.engines [None req-86f6eeea-bd38-422f-9806-244a00647b83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81397) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 09 20:41:44.023875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writer thread running {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 09 20:41:44.142916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6eeea-bd38-422f-9806-244a00647b83 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:44.147244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f5376-c7e2-4302-9767-7f8bcc9450f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:44.147864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f5376-c7e2-4302-9767-7f8bcc9450f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:44.148175 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f5376-c7e2-4302-9767-7f8bcc9450f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:44.148452 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f5376-c7e2-4302-9767-7f8bcc9450f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:44.156896 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f5376-c7e2-4302-9767-7f8bcc9450f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:44.209606 dv-cinder-831247-28-smb devstack@keystone.service[81397]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2a1f5376-c7e2-4302-9767-7f8bcc9450f5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 20:41:44.209895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f5376-c7e2-4302-9767-7f8bcc9450f5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:44.219251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Fri Sep 9 20:41:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 20:41:44.225788 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700f1c6-6ce5-47b3-9baa-64e02d1b6acb None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:44.243327 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2700f1c6-6ce5-47b3-9baa-64e02d1b6acb None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:44.247764 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101c0d0-e9a2-49fb-b1c8-49fd65cf059c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:44.248917 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101c0d0-e9a2-49fb-b1c8-49fd65cf059c admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:44.249203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101c0d0-e9a2-49fb-b1c8-49fd65cf059c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:44.249478 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101c0d0-e9a2-49fb-b1c8-49fd65cf059c admin admin] PATH_INFO: `/v3/projects/36e4c2d50d8d40f5b9937dbb73fb973f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:44.251084 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101c0d0-e9a2-49fb-b1c8-49fd65cf059c admin admin] RBAC: Authorizing `identity:get_project(project_id=36e4c2d50d8d40f5b9937dbb73fb973f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:44.305327 dv-cinder-831247-28-smb devstack@keystone.service[81398]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1101c0d0-e9a2-49fb-b1c8-49fd65cf059c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 09 20:41:44.305677 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101c0d0-e9a2-49fb-b1c8-49fd65cf059c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:44.310283 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Fri Sep 9 20:41:44 2022] GET /identity/v3/projects/36e4c2d50d8d40f5b9937dbb73fb973f => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:41:46.458751 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee99cc-15a2-4786-a18e-a0607438c132 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:46.459313 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee99cc-15a2-4786-a18e-a0607438c132 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:46.459313 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee99cc-15a2-4786-a18e-a0607438c132 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:46.463374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:41:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:41:46.468719 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa737b7-470d-496a-b564-572266f82c7e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:46.469130 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa737b7-470d-496a-b564-572266f82c7e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:46.469272 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa737b7-470d-496a-b564-572266f82c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:46.490297 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-dfa737b7-470d-496a-b564-572266f82c7e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:41:46.491828 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-dfa737b7-470d-496a-b564-572266f82c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:41:46.499602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:41:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 09 20:41:46.766326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee99cc-15a2-4786-a18e-a0607438c132 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:46.778735 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee99cc-15a2-4786-a18e-a0607438c132 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:46.783097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51f233-f0e0-45a3-bdfd-2cbd19546f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:46.783692 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51f233-f0e0-45a3-bdfd-2cbd19546f39 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:46.783972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51f233-f0e0-45a3-bdfd-2cbd19546f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:46.784272 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51f233-f0e0-45a3-bdfd-2cbd19546f39 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:46.791768 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51f233-f0e0-45a3-bdfd-2cbd19546f39 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:46.793577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51f233-f0e0-45a3-bdfd-2cbd19546f39 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:46.802731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Fri Sep 9 20:41:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 20:41:46.808001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa737b7-470d-496a-b564-572266f82c7e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:46.817683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa737b7-470d-496a-b564-572266f82c7e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:46.822072 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bbbbba-aafa-4c5e-9dfe-f57c45bb56e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:46.822700 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbbbba-aafa-4c5e-9dfe-f57c45bb56e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:46.822983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbbbba-aafa-4c5e-9dfe-f57c45bb56e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:46.823256 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bbbbba-aafa-4c5e-9dfe-f57c45bb56e6 admin admin] PATH_INFO: `/v3/users/8564ddd7649c432ab9e6d44eaa5a7f9f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:46.824629 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbbbba-aafa-4c5e-9dfe-f57c45bb56e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=8564ddd7649c432ab9e6d44eaa5a7f9f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:46.826462 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bbbbba-aafa-4c5e-9dfe-f57c45bb56e6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:46.827967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Fri Sep 9 20:41:46 2022] GET /identity/v3/users/8564ddd7649c432ab9e6d44eaa5a7f9f => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:41:49.028140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfb086-b79a-445e-8904-122d83091e8f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:49.028690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfb086-b79a-445e-8904-122d83091e8f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:49.028690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfb086-b79a-445e-8904-122d83091e8f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:49.029986 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:41:49.035841 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868e329-56c7-4d62-b0af-d923cbb2149c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:49.036292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868e329-56c7-4d62-b0af-d923cbb2149c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:49.036428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868e329-56c7-4d62-b0af-d923cbb2149c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:49.054841 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5868e329-56c7-4d62-b0af-d923cbb2149c None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:41:49.056045 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5868e329-56c7-4d62-b0af-d923cbb2149c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:41:49.080681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3055b-2b48-480e-be49-87b7c9095411 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:49.080966 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3055b-2b48-480e-be49-87b7c9095411 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:49.081245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3055b-2b48-480e-be49-87b7c9095411 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:49.082561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:41:49.087736 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900426aa-ceeb-4c9d-a8dc-0884bc5b818e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:49.088057 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900426aa-ceeb-4c9d-a8dc-0884bc5b818e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:49.088340 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900426aa-ceeb-4c9d-a8dc-0884bc5b818e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:49.131256 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG passlib.handlers.bcrypt [None req-900426aa-ceeb-4c9d-a8dc-0884bc5b818e None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81397) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 09 20:41:49.131656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG passlib.handlers.bcrypt [None req-900426aa-ceeb-4c9d-a8dc-0884bc5b818e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81397) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 09 20:41:49.139165 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:41:49.181280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-900426aa-ceeb-4c9d-a8dc-0884bc5b818e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:41:49.182876 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-900426aa-ceeb-4c9d-a8dc-0884bc5b818e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:41:49.281727 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:41:49.406432 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868e329-56c7-4d62-b0af-d923cbb2149c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:49.431878 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:49.511884 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868e329-56c7-4d62-b0af-d923cbb2149c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:49.544697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a820506-410a-4a8b-a0b8-5e284e21d7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:49.545270 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a820506-410a-4a8b-a0b8-5e284e21d7e0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:49.545547 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a820506-410a-4a8b-a0b8-5e284e21d7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:49.545820 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a820506-410a-4a8b-a0b8-5e284e21d7e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:49.550428 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900426aa-ceeb-4c9d-a8dc-0884bc5b818e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:49.557400 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a820506-410a-4a8b-a0b8-5e284e21d7e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:41:49.566665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-1a820506-410a-4a8b-a0b8-5e284e21d7e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:41:49.566665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:41:49.566665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:41:49.566665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:41:49.566665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:41:49.566665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:41:49.566665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:41:49.566665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:41:49.566665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:41:49.566665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:41:49.566665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:41:49.566665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:41:49.566665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:41:49.566665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:41:49.566665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:41:49.566665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:41:49.567727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:41:49.567727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:41:49.567727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:41:49.567727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:41:49.567727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:41:49.567727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:41:49.567727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:41:49.567727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:41:49.567727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:41:49.567727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:41:49.567727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:41:49.567727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:41:49.567727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:41:49.567727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:41:49.567727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:41:49.567727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:41:49.568665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:41:49.568665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:41:49.568665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:41:49.568665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:41:49.568665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:41:49.568665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:41:49.568665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:41:49.568665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:41:49.568665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:41:49.568665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:41:49.568665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:41:49.568665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:41:49.568665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:41:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:41:49.573950 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a820506-410a-4a8b-a0b8-5e284e21d7e0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:49.649174 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900426aa-ceeb-4c9d-a8dc-0884bc5b818e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:49.651670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:49.656759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:49.676746 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a820506-410a-4a8b-a0b8-5e284e21d7e0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:49.688371 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8cc662-cbdf-43e5-aa60-e34350b9b656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:49.689836 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cc662-cbdf-43e5-aa60-e34350b9b656 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:49.690115 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cc662-cbdf-43e5-aa60-e34350b9b656 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:49.690387 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cc662-cbdf-43e5-aa60-e34350b9b656 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:49.713039 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a13885-946e-4496-b57d-5f19b076b15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:49.713654 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a13885-946e-4496-b57d-5f19b076b15d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:49.713941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a13885-946e-4496-b57d-5f19b076b15d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:49.714210 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a13885-946e-4496-b57d-5f19b076b15d None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:49.714894 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a13885-946e-4496-b57d-5f19b076b15d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:41:49.715193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a13885-946e-4496-b57d-5f19b076b15d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:49.716624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a13885-946e-4496-b57d-5f19b076b15d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:49.728356 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:41:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:41:49.733947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a13885-946e-4496-b57d-5f19b076b15d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:49.757943 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8cc662-cbdf-43e5-aa60-e34350b9b656 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:49.759788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8cc662-cbdf-43e5-aa60-e34350b9b656 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:49.834917 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a13885-946e-4496-b57d-5f19b076b15d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:49.856010 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 8/16] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:41:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 20:41:49.862152 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8cc662-cbdf-43e5-aa60-e34350b9b656 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:49.864931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:49.870464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45c18d-c03a-4697-8b9c-98a9cf3e9392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:49.871102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45c18d-c03a-4697-8b9c-98a9cf3e9392 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:49.871383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45c18d-c03a-4697-8b9c-98a9cf3e9392 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:49.871653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45c18d-c03a-4697-8b9c-98a9cf3e9392 None admin] PATH_INFO: `/v3/users/8564ddd7649c432ab9e6d44eaa5a7f9f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:49.872819 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45c18d-c03a-4697-8b9c-98a9cf3e9392 None admin] RBAC: Authorizing `identity:get_user(user_id=8564ddd7649c432ab9e6d44eaa5a7f9f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:49.874275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e45c18d-c03a-4697-8b9c-98a9cf3e9392 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:49.875832 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:41:49 2022] GET /identity/v3/users/8564ddd7649c432ab9e6d44eaa5a7f9f => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:41:49.881844 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45c18d-c03a-4697-8b9c-98a9cf3e9392 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:49.897666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:49.960210 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8cc662-cbdf-43e5-aa60-e34350b9b656 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:49.982159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45c18d-c03a-4697-8b9c-98a9cf3e9392 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:49.993760 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ecb45-ef96-4c8c-a18c-b60feb94282a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:49.994609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ecb45-ef96-4c8c-a18c-b60feb94282a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:49.994886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ecb45-ef96-4c8c-a18c-b60feb94282a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:49.995159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ecb45-ef96-4c8c-a18c-b60feb94282a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:50.013124 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ecb45-ef96-4c8c-a18c-b60feb94282a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:50.014580 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570ecb45-ef96-4c8c-a18c-b60feb94282a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:50.015490 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d0763-8df3-4d79-924e-f34ac59a0337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:50.016154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d0763-8df3-4d79-924e-f34ac59a0337 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:50.016438 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d0763-8df3-4d79-924e-f34ac59a0337 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:50.016763 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d0763-8df3-4d79-924e-f34ac59a0337 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:50.018170 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d0763-8df3-4d79-924e-f34ac59a0337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:50.019622 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d0763-8df3-4d79-924e-f34ac59a0337 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:50.021218 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 10/18] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:41:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:41:50.027348 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d0763-8df3-4d79-924e-f34ac59a0337 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:50.034430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-570ecb45-ef96-4c8c-a18c-b60feb94282a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:41:50.034430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:41:50.034430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:41:50.034430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:41:50.034430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:41:50.034430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:41:50.034430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:41:50.034430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:41:50.034430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:41:50.034430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:41:50.034430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:41:50.034430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:41:50.034430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:41:50.034430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:41:50.034430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:41:50.034430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:41:50.035787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:41:50.035787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:41:50.035787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:41:50.035787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:41:50.035787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:41:50.035787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:41:50.035787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:41:50.035787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:41:50.035787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:41:50.035787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:41:50.035787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:41:50.035787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:41:50.035787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:41:50.035787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:41:50.035787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:41:50.035787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:41:50.035787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:41:50.036643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:41:50.036643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:41:50.036643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:41:50.036643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 9/19] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:41:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:41:50.041234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ecb45-ef96-4c8c-a18c-b60feb94282a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:50.097584 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:50.113193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:50.132983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d0763-8df3-4d79-924e-f34ac59a0337 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:50.143532 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570ecb45-ef96-4c8c-a18c-b60feb94282a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:50.168641 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6263a-5522-4d90-af2a-1a2747abadf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:50.169259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6263a-5522-4d90-af2a-1a2747abadf5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:50.169544 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6263a-5522-4d90-af2a-1a2747abadf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:50.169824 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6263a-5522-4d90-af2a-1a2747abadf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:50.170544 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6263a-5522-4d90-af2a-1a2747abadf5 None admin] RBAC: Adding query filter params (role.id=be620fc7968740269d233c5ace94a563, scope.domain.id=default, user.id=8564ddd7649c432ab9e6d44eaa5a7f9f) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:41:50.170854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6263a-5522-4d90-af2a-1a2747abadf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:50.172353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6263a-5522-4d90-af2a-1a2747abadf5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:50.176767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75940e-888a-474d-b093-c6643adfa4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:50.177366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75940e-888a-474d-b093-c6643adfa4fd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:50.177645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75940e-888a-474d-b093-c6643adfa4fd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:50.177916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75940e-888a-474d-b093-c6643adfa4fd None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:50.178561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75940e-888a-474d-b093-c6643adfa4fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:41:50.178862 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75940e-888a-474d-b093-c6643adfa4fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:50.179376 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 11/20] 10.222.0.15 () {56 vars in 1322 bytes} [Fri Sep 9 20:41:50 2022] GET /identity/v3/role_assignments?user.id=8564ddd7649c432ab9e6d44eaa5a7f9f&scope.domain.id=default&role.id=be620fc7968740269d233c5ace94a563 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:41:50.180266 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75940e-888a-474d-b093-c6643adfa4fd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:50.200206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 10/21] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:41:52.699005 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c06198-9e1b-41f4-80d8-a4f2f2df340a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:52.699945 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c06198-9e1b-41f4-80d8-a4f2f2df340a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:52.700484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c06198-9e1b-41f4-80d8-a4f2f2df340a None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:52.702257 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 12/22] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:41:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:41:52.710528 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71719881-32fd-4d3c-8903-4c5f95ae36eb None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:52.711473 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71719881-32fd-4d3c-8903-4c5f95ae36eb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:52.712167 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71719881-32fd-4d3c-8903-4c5f95ae36eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:52.743188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-71719881-32fd-4d3c-8903-4c5f95ae36eb None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:41:52.744778 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-71719881-32fd-4d3c-8903-4c5f95ae36eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:41:52.841324 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 11/23] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:41:52.875185 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a33566-0730-44b0-8e71-edad6dca1f62 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:52.875815 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a33566-0730-44b0-8e71-edad6dca1f62 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:52.876850 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a33566-0730-44b0-8e71-edad6dca1f62 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:52.878663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:41:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:41:52.884680 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc752a74-aef1-47b6-a4d7-f8d56fec8cbd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:52.884973 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc752a74-aef1-47b6-a4d7-f8d56fec8cbd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:52.885243 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc752a74-aef1-47b6-a4d7-f8d56fec8cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:52.912546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-cc752a74-aef1-47b6-a4d7-f8d56fec8cbd None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:41:52.913747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cc752a74-aef1-47b6-a4d7-f8d56fec8cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:41:52.974352 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:53.006122 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 12/25] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:41:53.101735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd339f-06b4-4229-809c-e869cd520dc1 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:53.102064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd339f-06b4-4229-809c-e869cd520dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:53.102299 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd339f-06b4-4229-809c-e869cd520dc1 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:53.103643 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 14/26] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:41:53.109017 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa8f7d-def1-472c-9d63-9a5c193c1b36 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:53.109518 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa8f7d-def1-472c-9d63-9a5c193c1b36 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:53.110024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa8f7d-def1-472c-9d63-9a5c193c1b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:53.131881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-53aa8f7d-def1-472c-9d63-9a5c193c1b36 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:41:53.133420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-53aa8f7d-def1-472c-9d63-9a5c193c1b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:41:53.177431 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd339f-06b4-4229-809c-e869cd520dc1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:53.263105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 13/27] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:41:53.344838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd339f-06b4-4229-809c-e869cd520dc1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:53.386865 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa8f7d-def1-472c-9d63-9a5c193c1b36 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:53.395110 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63462809-e26d-4ec6-ab21-451ee4212eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:53.395110 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63462809-e26d-4ec6-ab21-451ee4212eaa None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:53.395110 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63462809-e26d-4ec6-ab21-451ee4212eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:53.395110 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63462809-e26d-4ec6-ab21-451ee4212eaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:53.420703 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63462809-e26d-4ec6-ab21-451ee4212eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:41:53.429635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-63462809-e26d-4ec6-ab21-451ee4212eaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:41:53.429635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:41:53.429635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:41:53.429635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:41:53.429635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:41:53.429635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:41:53.429635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:41:53.429635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:41:53.429635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:41:53.429635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:41:53.429635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:41:53.429635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:41:53.429635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:41:53.429635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:41:53.429635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:41:53.429635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:41:53.430760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:41:53.430760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:41:53.430760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:41:53.430760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:41:53.430760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:41:53.430760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:41:53.430760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:41:53.430760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:41:53.430760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:41:53.430760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:41:53.430760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:41:53.430760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:41:53.430760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:41:53.430760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:41:53.430760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:41:53.430760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:41:53.431695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:41:53.431695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:41:53.431695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:41:53.431695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:41:53.431695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:41:53.431695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:41:53.431695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:41:53.431695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:41:53.431695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:41:53.431695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:41:53.431695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:41:53.431695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:41:53.439627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 15/28] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:41:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:41:53.445943 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63462809-e26d-4ec6-ab21-451ee4212eaa None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:53.460800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:53.578556 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa8f7d-def1-472c-9d63-9a5c193c1b36 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:53.592305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:53.633916 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63462809-e26d-4ec6-ab21-451ee4212eaa None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:53.645713 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15340805-9b7f-4fe6-a7c1-e871454f0267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:53.646365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15340805-9b7f-4fe6-a7c1-e871454f0267 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:53.646643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15340805-9b7f-4fe6-a7c1-e871454f0267 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:53.646916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15340805-9b7f-4fe6-a7c1-e871454f0267 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:53.663186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15340805-9b7f-4fe6-a7c1-e871454f0267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:53.665867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15340805-9b7f-4fe6-a7c1-e871454f0267 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:53.689848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-15340805-9b7f-4fe6-a7c1-e871454f0267 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:41:53.689848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:41:53.689848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:41:53.689848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:41:53.689848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:41:53.689848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:41:53.689848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:41:53.689848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:41:53.689848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:41:53.689848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:41:53.689848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:41:53.689848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:41:53.689848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:41:53.689848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:41:53.689848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:41:53.689848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:41:53.690731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:41:53.690731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:41:53.690731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:41:53.690731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:41:53.690731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:41:53.690731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:41:53.690731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:41:53.690731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:41:53.690731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:41:53.690731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:41:53.690731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:41:53.690731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:41:53.690731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:41:53.690731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:41:53.690731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:41:53.690731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:41:53.690731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:41:53.691511 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:41:53.691511 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:41:53.691511 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:41:53.691511 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 14/29] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:41:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:41:53.698340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b7bee-3248-4ae8-96d0-1d6dc8aac3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:53.698956 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b7bee-3248-4ae8-96d0-1d6dc8aac3af None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:53.699238 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b7bee-3248-4ae8-96d0-1d6dc8aac3af None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:53.699759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b7bee-3248-4ae8-96d0-1d6dc8aac3af None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:53.700186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b7bee-3248-4ae8-96d0-1d6dc8aac3af None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:41:53.700492 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b7bee-3248-4ae8-96d0-1d6dc8aac3af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:53.701887 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b7bee-3248-4ae8-96d0-1d6dc8aac3af None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:53.703641 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced5e3a-99a1-465b-8742-b9bf5faa1f52 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:53.703921 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced5e3a-99a1-465b-8742-b9bf5faa1f52 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:53.704244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced5e3a-99a1-465b-8742-b9bf5faa1f52 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:53.705596 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 15/30] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:41:53 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:41:53.709806 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced5e3a-99a1-465b-8742-b9bf5faa1f52 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:53.716284 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 16/31] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:41:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:41:53.722766 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25c214-a994-4e17-b1f2-e6c23c6f7981 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:53.723059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25c214-a994-4e17-b1f2-e6c23c6f7981 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:53.723340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25c214-a994-4e17-b1f2-e6c23c6f7981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:53.755382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-bb25c214-a994-4e17-b1f2-e6c23c6f7981 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:41:53.756724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bb25c214-a994-4e17-b1f2-e6c23c6f7981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:41:53.830001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced5e3a-99a1-465b-8742-b9bf5faa1f52 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:53.848407 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:53.859686 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 17/32] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:41:53.860794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25c214-a994-4e17-b1f2-e6c23c6f7981 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:53.882197 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e585a-80e2-4bd4-89ec-d571393253f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:53.883243 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e585a-80e2-4bd4-89ec-d571393253f6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:53.883810 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e585a-80e2-4bd4-89ec-d571393253f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:53.884327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e585a-80e2-4bd4-89ec-d571393253f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:53.885331 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e585a-80e2-4bd4-89ec-d571393253f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:41:53.885877 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e585a-80e2-4bd4-89ec-d571393253f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:53.887575 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e585a-80e2-4bd4-89ec-d571393253f6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:53.902360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 16/33] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:41:53.904191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e585a-80e2-4bd4-89ec-d571393253f6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:53.958938 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:54.059577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e585a-80e2-4bd4-89ec-d571393253f6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:54.109746 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54219db-042a-4b19-b072-d652840613c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:54.110289 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54219db-042a-4b19-b072-d652840613c8 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:54.111101 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54219db-042a-4b19-b072-d652840613c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:54.111377 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54219db-042a-4b19-b072-d652840613c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:54.116774 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54219db-042a-4b19-b072-d652840613c8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:54.118193 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54219db-042a-4b19-b072-d652840613c8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:54.147885 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25c214-a994-4e17-b1f2-e6c23c6f7981 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:54.215939 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bbf4a-820b-439a-bfcb-ca7cc33a763d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:54.218549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bbf4a-820b-439a-bfcb-ca7cc33a763d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:54.219169 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bbf4a-820b-439a-bfcb-ca7cc33a763d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:54.219622 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bbf4a-820b-439a-bfcb-ca7cc33a763d None admin] PATH_INFO: `/v3/users/8564ddd7649c432ab9e6d44eaa5a7f9f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:54.223179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bbf4a-820b-439a-bfcb-ca7cc33a763d None admin] RBAC: Authorizing `identity:get_user(user_id=8564ddd7649c432ab9e6d44eaa5a7f9f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:54.224947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bbf4a-820b-439a-bfcb-ca7cc33a763d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:54.226733 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 18/34] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:41:53 2022] GET /identity/v3/users/8564ddd7649c432ab9e6d44eaa5a7f9f => generated 247 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:41:54.228663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bbf4a-820b-439a-bfcb-ca7cc33a763d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:54.287446 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 17/35] 10.222.0.15 () {60 vars in 1131 bytes} [Fri Sep 9 20:41:53 2022] POST /identity/v3/roles => generated 219 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:41:54.287446 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54219db-042a-4b19-b072-d652840613c8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:54.365653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:54.448801 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bbf4a-820b-439a-bfcb-ca7cc33a763d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:54.508470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:54.542923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f094649-ef98-4da2-9a9c-11a1027162b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:54.543566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f094649-ef98-4da2-9a9c-11a1027162b6 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:54.543855 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f094649-ef98-4da2-9a9c-11a1027162b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:54.544158 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f094649-ef98-4da2-9a9c-11a1027162b6 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:54.544831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f094649-ef98-4da2-9a9c-11a1027162b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:54.546303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f094649-ef98-4da2-9a9c-11a1027162b6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:54.569629 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54219db-042a-4b19-b072-d652840613c8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:54.623868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09e58b-5673-4d6f-846e-a09b219bfb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:54.624476 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09e58b-5673-4d6f-846e-a09b219bfb23 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:54.624765 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09e58b-5673-4d6f-846e-a09b219bfb23 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:54.625045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09e58b-5673-4d6f-846e-a09b219bfb23 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:54.625720 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09e58b-5673-4d6f-846e-a09b219bfb23 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:54.627885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09e58b-5673-4d6f-846e-a09b219bfb23 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:54.644839 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 18/36] 10.222.0.15 () {60 vars in 1131 bytes} [Fri Sep 9 20:41:54 2022] POST /identity/v3/roles => generated 225 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:41:54.645670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09e58b-5673-4d6f-846e-a09b219bfb23 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:54.720508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 19/37] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Sep 9 20:41:54 2022] POST /identity/v3/projects => generated 301 bytes in 489 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:41:54.720508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e10ed0-d74b-4938-99ad-4e2df12928b4 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:54.720508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e10ed0-d74b-4938-99ad-4e2df12928b4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:54.720508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e10ed0-d74b-4938-99ad-4e2df12928b4 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:54.720508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 20/38] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:41:54.723801 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebee0ec-31c7-4473-80aa-dafecfec150f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:54.723801 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebee0ec-31c7-4473-80aa-dafecfec150f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:54.723801 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebee0ec-31c7-4473-80aa-dafecfec150f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:54.723801 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 21/39] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:41:54.733337 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91928825-0a13-4555-9dbf-f8eb01a7a5e9 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:54.733653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91928825-0a13-4555-9dbf-f8eb01a7a5e9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:54.734183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91928825-0a13-4555-9dbf-f8eb01a7a5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:54.762551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-91928825-0a13-4555-9dbf-f8eb01a7a5e9 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:41:54.765616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-91928825-0a13-4555-9dbf-f8eb01a7a5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:41:54.797346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09e58b-5673-4d6f-846e-a09b219bfb23 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:54.850551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8968aea2-7b6f-420c-b8a6-af81bf396de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:54.851194 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968aea2-7b6f-420c-b8a6-af81bf396de4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:54.852346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968aea2-7b6f-420c-b8a6-af81bf396de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:54.852346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968aea2-7b6f-420c-b8a6-af81bf396de4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:54.854323 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968aea2-7b6f-420c-b8a6-af81bf396de4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:54.855890 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8968aea2-7b6f-420c-b8a6-af81bf396de4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:54.857823 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 19/40] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:41:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:41:54.859603 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a1d17-587a-4566-b480-d8abe3aba0b5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:54.859892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a1d17-587a-4566-b480-d8abe3aba0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:54.864381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a1d17-587a-4566-b480-d8abe3aba0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:54.868911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 22/41] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:41:54.869846 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91928825-0a13-4555-9dbf-f8eb01a7a5e9 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:54.883253 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:54.893897 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-464a1d17-587a-4566-b480-d8abe3aba0b5 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:41:54.896293 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-464a1d17-587a-4566-b480-d8abe3aba0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:41:54.942813 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:54.991038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 20/42] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:41:55.009391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91928825-0a13-4555-9dbf-f8eb01a7a5e9 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:55.045458 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e450a-d105-47a6-9db8-96e8433603d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:55.046137 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e450a-d105-47a6-9db8-96e8433603d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:55.046422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e450a-d105-47a6-9db8-96e8433603d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:55.046702 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e450a-d105-47a6-9db8-96e8433603d1 None admin] PATH_INFO: `/v3/domains/default/users/8564ddd7649c432ab9e6d44eaa5a7f9f/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:55.049335 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e450a-d105-47a6-9db8-96e8433603d1 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8564ddd7649c432ab9e6d44eaa5a7f9f, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:55.050942 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e450a-d105-47a6-9db8-96e8433603d1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:55.066658 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 23/43] 10.222.0.15 () {58 vars in 1361 bytes} [Fri Sep 9 20:41:54 2022] PUT /identity/v3/domains/default/users/8564ddd7649c432ab9e6d44eaa5a7f9f/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:41:55.171722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a1d17-587a-4566-b480-d8abe3aba0b5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:55.272559 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e450a-d105-47a6-9db8-96e8433603d1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:55.285254 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a1d17-587a-4566-b480-d8abe3aba0b5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:55.345986 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c091977-cb09-4864-9b90-7e01a89f69ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:55.347046 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c091977-cb09-4864-9b90-7e01a89f69ea None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:55.347541 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c091977-cb09-4864-9b90-7e01a89f69ea None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:55.348047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c091977-cb09-4864-9b90-7e01a89f69ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:55.349837 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c091977-cb09-4864-9b90-7e01a89f69ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:55.352503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c091977-cb09-4864-9b90-7e01a89f69ea None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:55.355296 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 21/44] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:41:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:41:55.361100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c091977-cb09-4864-9b90-7e01a89f69ea None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:55.365080 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:55.395046 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e450a-d105-47a6-9db8-96e8433603d1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:55.402735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:55.434819 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fb070-e489-42c2-a6cb-cc28e509fe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:55.435420 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fb070-e489-42c2-a6cb-cc28e509fe82 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:55.435862 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fb070-e489-42c2-a6cb-cc28e509fe82 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:55.436221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fb070-e489-42c2-a6cb-cc28e509fe82 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:55.437701 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fb070-e489-42c2-a6cb-cc28e509fe82 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:55.439653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fb070-e489-42c2-a6cb-cc28e509fe82 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:55.457377 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 24/45] 10.222.0.15 () {60 vars in 1131 bytes} [Fri Sep 9 20:41:55 2022] POST /identity/v3/roles => generated 223 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:41:55.475627 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c091977-cb09-4864-9b90-7e01a89f69ea None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:55.513142 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de3d7b-4a13-4128-a2ef-f390eae67d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:55.513784 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de3d7b-4a13-4128-a2ef-f390eae67d0d None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:55.514066 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de3d7b-4a13-4128-a2ef-f390eae67d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:55.514343 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de3d7b-4a13-4128-a2ef-f390eae67d0d None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:55.515029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de3d7b-4a13-4128-a2ef-f390eae67d0d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:55.517137 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de3d7b-4a13-4128-a2ef-f390eae67d0d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:55.549657 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 22/46] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Sep 9 20:41:55 2022] POST /identity/v3/projects => generated 312 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:41:57.268536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2f282-6075-46f2-86fb-3fc2667b799b None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:57.269049 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2f282-6075-46f2-86fb-3fc2667b799b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:57.269163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2f282-6075-46f2-86fb-3fc2667b799b None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:57.270425 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 25/47] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:41:57.276144 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d83a12-9f90-4c0b-b1cc-4ff9d578db43 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:57.276540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d83a12-9f90-4c0b-b1cc-4ff9d578db43 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:57.276702 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d83a12-9f90-4c0b-b1cc-4ff9d578db43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:57.299378 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-28d83a12-9f90-4c0b-b1cc-4ff9d578db43 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:41:57.300627 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-28d83a12-9f90-4c0b-b1cc-4ff9d578db43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:41:57.351135 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:57.368388 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 23/48] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:41:57.637487 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2f282-6075-46f2-86fb-3fc2667b799b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:57.731075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a018a8-1313-400e-8935-fb5c03c36d49 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:57.731363 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a018a8-1313-400e-8935-fb5c03c36d49 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:57.731647 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a018a8-1313-400e-8935-fb5c03c36d49 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:57.733043 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 24/49] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:41:57.740075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffde51-f5c4-4091-9bd3-0f006b8f5ca4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:57.740490 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffde51-f5c4-4091-9bd3-0f006b8f5ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:57.740780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ffde51-f5c4-4091-9bd3-0f006b8f5ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:57.760207 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-21ffde51-f5c4-4091-9bd3-0f006b8f5ca4 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:41:57.761425 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-21ffde51-f5c4-4091-9bd3-0f006b8f5ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:41:57.826532 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 25/50] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:41:57.850144 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2f282-6075-46f2-86fb-3fc2667b799b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:57.883048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae74afd-213e-4d40-9071-2215816c608b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:57.883679 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae74afd-213e-4d40-9071-2215816c608b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:57.883962 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae74afd-213e-4d40-9071-2215816c608b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:57.884265 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae74afd-213e-4d40-9071-2215816c608b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:57.894683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae74afd-213e-4d40-9071-2215816c608b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:41:57.899428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-2ae74afd-213e-4d40-9071-2215816c608b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:41:57.899428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:41:57.899428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:41:57.899428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:41:57.899428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:41:57.899428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:41:57.899428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:41:57.899428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:41:57.899428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:41:57.899428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:41:57.899428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:41:57.899428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:41:57.899428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:41:57.899428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:41:57.899428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:41:57.899428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:41:57.900551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:41:57.900551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:41:57.900551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:41:57.900551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:41:57.900551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:41:57.900551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:41:57.900551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:41:57.900551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:41:57.900551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:41:57.900551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:41:57.900551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:41:57.900551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:41:57.900551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:41:57.900551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:41:57.900551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:41:57.900551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:41:57.901456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:41:57.901456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:41:57.901456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:41:57.901456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:41:57.901456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:41:57.901456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:41:57.901456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:41:57.901456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:41:57.901456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:41:57.901456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:41:57.901456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:41:57.901456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:41:57.901456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 26/51] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:41:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:41:57.906550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffde51-f5c4-4091-9bd3-0f006b8f5ca4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:58.001784 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ffde51-f5c4-4091-9bd3-0f006b8f5ca4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:58.017990 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:58.035620 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa4ab5-26e6-4554-9b45-d92b04ed5908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:58.036355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa4ab5-26e6-4554-9b45-d92b04ed5908 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:58.036638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa4ab5-26e6-4554-9b45-d92b04ed5908 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:58.036909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aa4ab5-26e6-4554-9b45-d92b04ed5908 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:58.037579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa4ab5-26e6-4554-9b45-d92b04ed5908 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:41:58.037884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa4ab5-26e6-4554-9b45-d92b04ed5908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:58.039262 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aa4ab5-26e6-4554-9b45-d92b04ed5908 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:58.056581 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 26/52] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:41:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:41:58.058414 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae74afd-213e-4d40-9071-2215816c608b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:58.085910 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:58.098741 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa4ab5-26e6-4554-9b45-d92b04ed5908 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:58.163977 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae74afd-213e-4d40-9071-2215816c608b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:58.201306 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3012af-74b3-4dd8-8acf-fee385690376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:58.201965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3012af-74b3-4dd8-8acf-fee385690376 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:58.202251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3012af-74b3-4dd8-8acf-fee385690376 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:58.202529 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3012af-74b3-4dd8-8acf-fee385690376 None admin] PATH_INFO: `/v3/users/8564ddd7649c432ab9e6d44eaa5a7f9f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:58.203725 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3012af-74b3-4dd8-8acf-fee385690376 None admin] RBAC: Authorizing `identity:get_user(user_id=8564ddd7649c432ab9e6d44eaa5a7f9f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:58.205532 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3012af-74b3-4dd8-8acf-fee385690376 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:58.207235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 27/53] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:41:58 2022] GET /identity/v3/users/8564ddd7649c432ab9e6d44eaa5a7f9f => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:41:58.212875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3012af-74b3-4dd8-8acf-fee385690376 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:58.305115 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aa4ab5-26e6-4554-9b45-d92b04ed5908 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:58.311327 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:58.319275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3012af-74b3-4dd8-8acf-fee385690376 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:58.341199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c210f8-d056-401d-bcee-3ca7d9755acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:58.341847 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c210f8-d056-401d-bcee-3ca7d9755acd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:58.342126 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c210f8-d056-401d-bcee-3ca7d9755acd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:58.342410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c210f8-d056-401d-bcee-3ca7d9755acd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:58.343546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c210f8-d056-401d-bcee-3ca7d9755acd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:58.345619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c210f8-d056-401d-bcee-3ca7d9755acd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:58.347203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 27/54] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:41:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:41:58.352674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c210f8-d056-401d-bcee-3ca7d9755acd None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:58.353966 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b6bba-603e-47cd-b646-d27a8d292f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:58.354604 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b6bba-603e-47cd-b646-d27a8d292f65 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:58.354885 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b6bba-603e-47cd-b646-d27a8d292f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:58.355330 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b6bba-603e-47cd-b646-d27a8d292f65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:58.357210 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b6bba-603e-47cd-b646-d27a8d292f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:58.358659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b6bba-603e-47cd-b646-d27a8d292f65 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:58.360822 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 28/55] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:41:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:41:58.366296 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b6bba-603e-47cd-b646-d27a8d292f65 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:41:58.397804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:41:58.454145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c210f8-d056-401d-bcee-3ca7d9755acd None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:58.466704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b6bba-603e-47cd-b646-d27a8d292f65 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:41:58.487303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabae400-694f-4db0-93a9-e8d8534b5ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:58.487905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabae400-694f-4db0-93a9-e8d8534b5ed3 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:58.488210 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabae400-694f-4db0-93a9-e8d8534b5ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:58.488484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabae400-694f-4db0-93a9-e8d8534b5ed3 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:58.489130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabae400-694f-4db0-93a9-e8d8534b5ed3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:58.490555 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabae400-694f-4db0-93a9-e8d8534b5ed3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:58.500517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f3273-c370-4c45-ab87-011352289f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:41:58.501400 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f3273-c370-4c45-ab87-011352289f54 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:41:58.501510 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f3273-c370-4c45-ab87-011352289f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:41:58.501705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f3273-c370-4c45-ab87-011352289f54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:41:58.502430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f3273-c370-4c45-ab87-011352289f54 None admin] RBAC: Adding query filter params (role.id=be620fc7968740269d233c5ace94a563, scope.domain.id=default, user.id=8564ddd7649c432ab9e6d44eaa5a7f9f) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:41:58.502737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f3273-c370-4c45-ab87-011352289f54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:41:58.504206 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f3273-c370-4c45-ab87-011352289f54 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:41:58.510452 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 29/56] 10.222.0.15 () {56 vars in 1322 bytes} [Fri Sep 9 20:41:58 2022] GET /identity/v3/role_assignments?user.id=8564ddd7649c432ab9e6d44eaa5a7f9f&scope.domain.id=default&role.id=be620fc7968740269d233c5ace94a563 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:41:58.517451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 28/57] 10.222.0.15 () {60 vars in 1140 bytes} [Fri Sep 9 20:41:58 2022] POST /identity/v3/projects => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:42:00.687236 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890d9df-b114-4fd1-8628-53550bd12982 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:00.687732 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890d9df-b114-4fd1-8628-53550bd12982 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:00.687812 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890d9df-b114-4fd1-8628-53550bd12982 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:00.689669 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 30/58] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:00.694785 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b426256-5f36-4938-af35-5fcbcfa33817 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:00.695168 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b426256-5f36-4938-af35-5fcbcfa33817 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:00.695349 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b426256-5f36-4938-af35-5fcbcfa33817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:00.713647 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3b426256-5f36-4938-af35-5fcbcfa33817 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:00.714859 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3b426256-5f36-4938-af35-5fcbcfa33817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:00.779843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 29/59] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:01.050307 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890d9df-b114-4fd1-8628-53550bd12982 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:01.078076 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:01.153010 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890d9df-b114-4fd1-8628-53550bd12982 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:01.185014 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29014b38-fc56-4ec9-ba66-d975e9c66d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:01.185640 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29014b38-fc56-4ec9-ba66-d975e9c66d8f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:01.185924 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29014b38-fc56-4ec9-ba66-d975e9c66d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:01.186201 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29014b38-fc56-4ec9-ba66-d975e9c66d8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:01.187303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29014b38-fc56-4ec9-ba66-d975e9c66d8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:01.189435 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29014b38-fc56-4ec9-ba66-d975e9c66d8f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:01.190977 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 31/60] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:42:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:01.196459 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b426256-5f36-4938-af35-5fcbcfa33817 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:01.223138 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:01.292456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b426256-5f36-4938-af35-5fcbcfa33817 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:01.326456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d2ae7-7d85-4cbf-8b90-71d4abebaed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:01.327062 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d2ae7-7d85-4cbf-8b90-71d4abebaed5 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:01.327342 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d2ae7-7d85-4cbf-8b90-71d4abebaed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:01.327613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d2ae7-7d85-4cbf-8b90-71d4abebaed5 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:01.328301 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d2ae7-7d85-4cbf-8b90-71d4abebaed5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:01.330519 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d2ae7-7d85-4cbf-8b90-71d4abebaed5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:01.355997 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 30/61] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Sep 9 20:42:01 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:42:04.584309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba97499-ebfc-408b-ab15-17e1aab98fbb None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:04.585309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba97499-ebfc-408b-ab15-17e1aab98fbb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:04.585798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba97499-ebfc-408b-ab15-17e1aab98fbb None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:04.587462 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 32/62] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:04.593229 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01096cc9-6c69-41c8-a5b5-f1374e712e15 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:04.594142 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01096cc9-6c69-41c8-a5b5-f1374e712e15 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:04.594655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01096cc9-6c69-41c8-a5b5-f1374e712e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:04.614525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-01096cc9-6c69-41c8-a5b5-f1374e712e15 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:04.616111 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-01096cc9-6c69-41c8-a5b5-f1374e712e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:04.705306 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 31/63] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:04.714282 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd4fbe-e11c-4dec-8a64-df918c98ff34 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:04.714866 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd4fbe-e11c-4dec-8a64-df918c98ff34 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:04.715341 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd4fbe-e11c-4dec-8a64-df918c98ff34 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:04.716923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 33/64] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:04.729355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fa8a6-b34d-4061-ba54-7e7151d376f5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:04.729647 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fa8a6-b34d-4061-ba54-7e7151d376f5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:04.729924 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fa8a6-b34d-4061-ba54-7e7151d376f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:04.757176 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ab8fa8a6-b34d-4061-ba54-7e7151d376f5 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:04.758399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ab8fa8a6-b34d-4061-ba54-7e7151d376f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:04.769153 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:04.846192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 32/65] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:05.036525 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd4fbe-e11c-4dec-8a64-df918c98ff34 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:05.144234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a2f61-24a0-45a0-8457-34ba5e1004fe None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:05.144442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a2f61-24a0-45a0-8457-34ba5e1004fe None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:05.144903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a2f61-24a0-45a0-8457-34ba5e1004fe None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:05.146238 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 33/66] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:05.152556 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a5fd1-27df-445b-855e-b35eefd17165 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:05.152842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a5fd1-27df-445b-855e-b35eefd17165 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:05.153268 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a5fd1-27df-445b-855e-b35eefd17165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:05.176365 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:05.180762 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-648a5fd1-27df-445b-855e-b35eefd17165 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:05.183170 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-648a5fd1-27df-445b-855e-b35eefd17165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:05.194232 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd4fbe-e11c-4dec-8a64-df918c98ff34 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:05.251178 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368b1b0-4a73-45f5-a90a-cc311fca1543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:05.251837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368b1b0-4a73-45f5-a90a-cc311fca1543 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:05.252184 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368b1b0-4a73-45f5-a90a-cc311fca1543 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:05.252543 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368b1b0-4a73-45f5-a90a-cc311fca1543 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:05.263799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 34/67] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:05.268209 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f368b1b0-4a73-45f5-a90a-cc311fca1543 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:05.269374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a5fd1-27df-445b-855e-b35eefd17165 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:05.270508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-f368b1b0-4a73-45f5-a90a-cc311fca1543 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:42:05.270508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:05.270508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:05.270508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:05.270508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:05.270508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:05.270508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:05.270508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:05.270508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:05.270508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:05.270508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:05.270508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:05.270508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:05.270508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:05.270508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:05.270508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:05.271323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:05.271323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:05.271323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:05.271323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:05.271323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:05.271323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:05.271323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:05.271323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:05.271323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:05.271323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:05.271323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:05.271323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:05.271323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:05.271323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:05.271323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:05.271323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:05.276308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:05.276308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:05.276308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:05.276308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:05.276308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:05.276308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:05.276308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:05.276308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:05.276308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:05.276308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:05.276308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:42:05.276308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:05.276308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 34/68] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:42:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:05.277946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368b1b0-4a73-45f5-a90a-cc311fca1543 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:05.371152 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:05.403324 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a5fd1-27df-445b-855e-b35eefd17165 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:05.408032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368b1b0-4a73-45f5-a90a-cc311fca1543 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:05.441771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e59f11-3004-4f7a-b4d5-eb3512312b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:05.442691 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e59f11-3004-4f7a-b4d5-eb3512312b7c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:05.443149 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e59f11-3004-4f7a-b4d5-eb3512312b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:05.443636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e59f11-3004-4f7a-b4d5-eb3512312b7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:05.444090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb07029-4cb3-4000-9561-fdf31cc3e05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:05.444707 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb07029-4cb3-4000-9561-fdf31cc3e05d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:05.445081 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb07029-4cb3-4000-9561-fdf31cc3e05d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:05.445363 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb07029-4cb3-4000-9561-fdf31cc3e05d None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:05.446053 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb07029-4cb3-4000-9561-fdf31cc3e05d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:05.446362 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb07029-4cb3-4000-9561-fdf31cc3e05d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:05.447744 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb07029-4cb3-4000-9561-fdf31cc3e05d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:05.456269 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e59f11-3004-4f7a-b4d5-eb3512312b7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:05.456817 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 35/69] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:05.458148 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e5295-c50b-43c6-b410-10fe1a7028fc None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:05.458581 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e5295-c50b-43c6-b410-10fe1a7028fc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:05.458990 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e5295-c50b-43c6-b410-10fe1a7028fc None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:05.460384 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 36/70] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:05.461567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755db50c-ab8e-4bfc-ad70-d0112a0917d3 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:05.461978 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755db50c-ab8e-4bfc-ad70-d0112a0917d3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:05.462410 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755db50c-ab8e-4bfc-ad70-d0112a0917d3 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:05.463729 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 37/71] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:05.464486 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755db50c-ab8e-4bfc-ad70-d0112a0917d3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:05.465157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-15e59f11-3004-4f7a-b4d5-eb3512312b7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:05.465157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:05.465157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:05.465157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:05.465157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:05.465157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:05.465157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:05.465157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:05.465157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:05.465157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:05.465157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:05.465157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:05.465157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:05.465157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:05.465157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:05.465157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:05.466186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:05.466186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:05.466186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:05.466186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:05.466186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:05.466186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:05.466186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:05.466186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:05.466186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:05.466186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:05.466186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:05.466186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:05.466186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:05.466186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:05.466186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:05.466186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:05.466914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:05.466914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:05.466914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:05.466914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:05.466914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:05.466914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:05.466914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:05.466914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:05.466914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:05.466914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:05.466914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:05.466914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:05.467561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 35/72] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:05.468995 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778e28f-499e-47f6-9be3-7e7610f5473c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:05.472216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778e28f-499e-47f6-9be3-7e7610f5473c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:05.472720 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778e28f-499e-47f6-9be3-7e7610f5473c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:05.487847 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:05.491392 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b778e28f-499e-47f6-9be3-7e7610f5473c None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:05.492624 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b778e28f-499e-47f6-9be3-7e7610f5473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:05.564192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 36/73] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:05.576176 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8567f6-02ef-4dbd-9a93-2ddb58ded16d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:05.576176 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8567f6-02ef-4dbd-9a93-2ddb58ded16d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:05.576176 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8567f6-02ef-4dbd-9a93-2ddb58ded16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:05.583937 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8c8567f6-02ef-4dbd-9a93-2ddb58ded16d None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:05.584473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755db50c-ab8e-4bfc-ad70-d0112a0917d3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:05.585174 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8c8567f6-02ef-4dbd-9a93-2ddb58ded16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:05.619937 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4d177-1eb6-4695-9e6e-b8747fec844f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:05.620830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4d177-1eb6-4695-9e6e-b8747fec844f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:05.621290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4d177-1eb6-4695-9e6e-b8747fec844f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:05.621721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4d177-1eb6-4695-9e6e-b8747fec844f None admin] PATH_INFO: `/v3/users/8564ddd7649c432ab9e6d44eaa5a7f9f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:05.622947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4d177-1eb6-4695-9e6e-b8747fec844f None admin] RBAC: Authorizing `identity:get_user(user_id=8564ddd7649c432ab9e6d44eaa5a7f9f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:05.624454 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4d177-1eb6-4695-9e6e-b8747fec844f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:05.630801 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 38/74] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:05 2022] GET /identity/v3/users/8564ddd7649c432ab9e6d44eaa5a7f9f => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:05.631446 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4d177-1eb6-4695-9e6e-b8747fec844f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:05.648045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:05.658450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 37/75] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:05.659282 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8567f6-02ef-4dbd-9a93-2ddb58ded16d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:05.742344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:05.764758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8567f6-02ef-4dbd-9a93-2ddb58ded16d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:05.765994 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4d177-1eb6-4695-9e6e-b8747fec844f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:05.806347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642aac7-7bdd-45bf-9ff4-a67979d04760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:05.807211 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642aac7-7bdd-45bf-9ff4-a67979d04760 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:05.807639 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642aac7-7bdd-45bf-9ff4-a67979d04760 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:05.808126 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642aac7-7bdd-45bf-9ff4-a67979d04760 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:05.816911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acf168-c628-4836-b85f-bc9b1b7c504d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:05.817609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acf168-c628-4836-b85f-bc9b1b7c504d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:05.817966 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acf168-c628-4836-b85f-bc9b1b7c504d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:05.818317 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acf168-c628-4836-b85f-bc9b1b7c504d None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:05.819233 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acf168-c628-4836-b85f-bc9b1b7c504d None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:05.819709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acf168-c628-4836-b85f-bc9b1b7c504d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:05.820105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642aac7-7bdd-45bf-9ff4-a67979d04760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:05.821374 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acf168-c628-4836-b85f-bc9b1b7c504d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:05.825435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a642aac7-7bdd-45bf-9ff4-a67979d04760 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:05.825435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:05.825435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:05.825435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:05.825435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:05.825435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:05.825435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:05.825435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:05.825435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:05.825435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:05.825435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:05.825435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:05.825435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:05.825435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:05.825435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:05.825435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:05.826250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:05.826250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:05.826250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:05.826250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:05.826250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:05.826250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:05.826250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:05.826250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:05.826250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:05.826250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:05.826250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:05.826250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:05.826250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:05.826250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:05.826250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:05.826250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:05.827005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:05.827005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:05.827005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:05.827005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:05.827005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:05.827005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:05.827005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:05.827005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:05.827005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:05.827005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:05.827005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:05.827005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:05.829661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 38/76] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:42:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:05.830742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642aac7-7bdd-45bf-9ff4-a67979d04760 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:05.833468 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 39/77] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:05.835449 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acf168-c628-4836-b85f-bc9b1b7c504d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:05.894960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:05.949123 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642aac7-7bdd-45bf-9ff4-a67979d04760 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:05.951185 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acf168-c628-4836-b85f-bc9b1b7c504d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:05.990296 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07580e4c-a7bd-4cba-90c8-3c6d78b50bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:05.990705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cd353-a7b2-413c-9e23-6af235f0b7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:05.990915 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07580e4c-a7bd-4cba-90c8-3c6d78b50bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:05.991198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07580e4c-a7bd-4cba-90c8-3c6d78b50bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:05.991317 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cd353-a7b2-413c-9e23-6af235f0b7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:05.991475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07580e4c-a7bd-4cba-90c8-3c6d78b50bb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:05.991602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cd353-a7b2-413c-9e23-6af235f0b7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:05.991879 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cd353-a7b2-413c-9e23-6af235f0b7c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:05.992573 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cd353-a7b2-413c-9e23-6af235f0b7c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:05.992879 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cd353-a7b2-413c-9e23-6af235f0b7c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:05.994271 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cd353-a7b2-413c-9e23-6af235f0b7c8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:06.003244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 40/78] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:42:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:06.004163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cd353-a7b2-413c-9e23-6af235f0b7c8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:06.015838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:06.064768 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07580e4c-a7bd-4cba-90c8-3c6d78b50bb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:06.066772 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07580e4c-a7bd-4cba-90c8-3c6d78b50bb2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:06.105034 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cd353-a7b2-413c-9e23-6af235f0b7c8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:06.121207 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:06.139461 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76694c3-ec03-4be9-a31d-977b89553dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:06.140126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76694c3-ec03-4be9-a31d-977b89553dba None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:06.140412 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76694c3-ec03-4be9-a31d-977b89553dba None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:06.140688 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76694c3-ec03-4be9-a31d-977b89553dba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:06.141919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76694c3-ec03-4be9-a31d-977b89553dba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:06.143390 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76694c3-ec03-4be9-a31d-977b89553dba None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:06.144978 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 41/79] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:42:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:06.145746 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76694c3-ec03-4be9-a31d-977b89553dba None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:06.170107 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 39/80] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:06.170952 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07580e4c-a7bd-4cba-90c8-3c6d78b50bb2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:06.225288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:06.249412 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76694c3-ec03-4be9-a31d-977b89553dba None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:06.267762 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07580e4c-a7bd-4cba-90c8-3c6d78b50bb2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:06.283059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239a37d-157c-4cfa-832a-6ac5f1956aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:06.283702 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239a37d-157c-4cfa-832a-6ac5f1956aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:06.284011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239a37d-157c-4cfa-832a-6ac5f1956aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:06.284297 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239a37d-157c-4cfa-832a-6ac5f1956aa0 None admin] PATH_INFO: `/v3/users/2230c53133ec4c828215f6a48adbb673` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:06.300501 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239a37d-157c-4cfa-832a-6ac5f1956aa0 None admin] RBAC: Authorizing `identity:get_user(user_id=2230c53133ec4c828215f6a48adbb673)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:06.301274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81577aec-fd74-4b03-a644-a4b31fb983ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:06.301932 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81577aec-fd74-4b03-a644-a4b31fb983ab None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:06.302034 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239a37d-157c-4cfa-832a-6ac5f1956aa0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:06.302208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81577aec-fd74-4b03-a644-a4b31fb983ab None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:06.302477 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81577aec-fd74-4b03-a644-a4b31fb983ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:06.308061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 42/81] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:06 2022] GET /identity/v3/users/2230c53133ec4c828215f6a48adbb673 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:06.308061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239a37d-157c-4cfa-832a-6ac5f1956aa0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:06.316514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81577aec-fd74-4b03-a644-a4b31fb983ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:06.321299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-81577aec-fd74-4b03-a644-a4b31fb983ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:06.321299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:06.321299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:06.321299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:06.321299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:06.321299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:06.321299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:06.321299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:06.321299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:06.321299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:06.321299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:06.321299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:06.321299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:06.321299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:06.321299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:06.321299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:06.322230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:06.322230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:06.322230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:06.322230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:06.322230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:06.322230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:06.322230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:06.322230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:06.322230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:06.322230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:06.322230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:06.322230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:06.322230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:06.322230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:06.322230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:06.322230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:06.323145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:06.323145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:06.323145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:06.323145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:06.323145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:06.323145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:06.323145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:06.323145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:06.323145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:06.323145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:06.323145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:06.323145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:06.323145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 40/82] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:06.323145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81577aec-fd74-4b03-a644-a4b31fb983ab None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:06.338776 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:06.407657 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239a37d-157c-4cfa-832a-6ac5f1956aa0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:06.420505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81577aec-fd74-4b03-a644-a4b31fb983ab None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:06.442161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b3906-503f-4273-a459-75e51daf1b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:06.442796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b3906-503f-4273-a459-75e51daf1b27 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:06.443083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b3906-503f-4273-a459-75e51daf1b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:06.443357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b3906-503f-4273-a459-75e51daf1b27 None admin] PATH_INFO: `/v3/users/2230c53133ec4c828215f6a48adbb673` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:06.444526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b3906-503f-4273-a459-75e51daf1b27 None admin] RBAC: Authorizing `identity:get_user(user_id=2230c53133ec4c828215f6a48adbb673)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:06.445970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b3906-503f-4273-a459-75e51daf1b27 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:06.447534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 43/83] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:06 2022] GET /identity/v3/users/2230c53133ec4c828215f6a48adbb673 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:06.448348 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b3906-503f-4273-a459-75e51daf1b27 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:06.450850 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:06.456689 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b7259-6ee7-4050-bfe4-2142ee589df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:06.457306 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b7259-6ee7-4050-bfe4-2142ee589df8 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:06.457588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b7259-6ee7-4050-bfe4-2142ee589df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:06.457866 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b7259-6ee7-4050-bfe4-2142ee589df8 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:06.458523 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b7259-6ee7-4050-bfe4-2142ee589df8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:06.459972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b7259-6ee7-4050-bfe4-2142ee589df8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:06.488222 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 41/84] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Sep 9 20:42:06 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:42:06.488222 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b7259-6ee7-4050-bfe4-2142ee589df8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:06.563251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b3906-503f-4273-a459-75e51daf1b27 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:06.569576 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:06.603480 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cd677-576c-4457-8465-27b2660190ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:06.604242 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cd677-576c-4457-8465-27b2660190ec None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:06.604486 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cd677-576c-4457-8465-27b2660190ec None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:06.604728 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cd677-576c-4457-8465-27b2660190ec None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:06.605286 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b7259-6ee7-4050-bfe4-2142ee589df8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:06.605944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878cd677-576c-4457-8465-27b2660190ec None admin] RBAC: Authorizing `identity:get_project(project_id=3518388fd55847e99d38040fb3c91ac5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:06.607470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878cd677-576c-4457-8465-27b2660190ec None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:06.615168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 44/85] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:06 2022] GET /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:06.615168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cd677-576c-4457-8465-27b2660190ec None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:06.645166 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9370fd-dcaa-4d3a-9ad2-8a10229addea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:06.645797 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9370fd-dcaa-4d3a-9ad2-8a10229addea None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:06.646081 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9370fd-dcaa-4d3a-9ad2-8a10229addea None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:06.646358 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9370fd-dcaa-4d3a-9ad2-8a10229addea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:06.702016 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:06.719860 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9370fd-dcaa-4d3a-9ad2-8a10229addea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:06.721568 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9370fd-dcaa-4d3a-9ad2-8a10229addea None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:06.744383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cd677-576c-4457-8465-27b2660190ec None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:06.788092 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42700d2e-4d64-4ece-8c0a-a08aa9f79f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:06.789102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42700d2e-4d64-4ece-8c0a-a08aa9f79f25 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:06.789595 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42700d2e-4d64-4ece-8c0a-a08aa9f79f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:06.789879 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42700d2e-4d64-4ece-8c0a-a08aa9f79f25 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:06.790553 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42700d2e-4d64-4ece-8c0a-a08aa9f79f25 None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:06.790865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42700d2e-4d64-4ece-8c0a-a08aa9f79f25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:06.792385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42700d2e-4d64-4ece-8c0a-a08aa9f79f25 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:06.805184 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 45/86] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:06.806106 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42700d2e-4d64-4ece-8c0a-a08aa9f79f25 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:06.807698 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:06.847712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 42/87] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:06.848277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9370fd-dcaa-4d3a-9ad2-8a10229addea None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:06.920623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42700d2e-4d64-4ece-8c0a-a08aa9f79f25 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:06.953230 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:06.964075 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed4425-c987-42c9-81a8-6972d16364a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:06.965369 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed4425-c987-42c9-81a8-6972d16364a3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:06.966115 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed4425-c987-42c9-81a8-6972d16364a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:06.966603 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed4425-c987-42c9-81a8-6972d16364a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:06.988009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9370fd-dcaa-4d3a-9ad2-8a10229addea None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:07.028546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de706209-85b9-4011-9079-73cfdd4b064e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:07.028861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de706209-85b9-4011-9079-73cfdd4b064e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:07.029084 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de706209-85b9-4011-9079-73cfdd4b064e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:07.029361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de706209-85b9-4011-9079-73cfdd4b064e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:07.030095 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de706209-85b9-4011-9079-73cfdd4b064e None admin] RBAC: Adding query filter params (role.id=be620fc7968740269d233c5ace94a563, scope.project.id=3518388fd55847e99d38040fb3c91ac5, user.id=8564ddd7649c432ab9e6d44eaa5a7f9f) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:07.030407 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de706209-85b9-4011-9079-73cfdd4b064e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:07.032479 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de706209-85b9-4011-9079-73cfdd4b064e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:07.041408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 43/88] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:42:06 2022] GET /identity/v3/role_assignments?user.id=8564ddd7649c432ab9e6d44eaa5a7f9f&scope.project.id=3518388fd55847e99d38040fb3c91ac5&role.id=be620fc7968740269d233c5ace94a563 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:07.042393 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de706209-85b9-4011-9079-73cfdd4b064e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:07.070477 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed4425-c987-42c9-81a8-6972d16364a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:07.073586 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed4425-c987-42c9-81a8-6972d16364a3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:07.085176 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:07.160343 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de706209-85b9-4011-9079-73cfdd4b064e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:07.199227 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ab601-d753-4217-8f59-24b79f74170f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:07.200296 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ab601-d753-4217-8f59-24b79f74170f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:07.200649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ab601-d753-4217-8f59-24b79f74170f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:07.201040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ab601-d753-4217-8f59-24b79f74170f None admin] PATH_INFO: `/v3/users/2230c53133ec4c828215f6a48adbb673` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:07.202549 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ab601-d753-4217-8f59-24b79f74170f None admin] RBAC: Authorizing `identity:get_user(user_id=2230c53133ec4c828215f6a48adbb673)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:07.204859 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ab601-d753-4217-8f59-24b79f74170f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:07.206727 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 44/89] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:07 2022] GET /identity/v3/users/2230c53133ec4c828215f6a48adbb673 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:07.207579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ab601-d753-4217-8f59-24b79f74170f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:07.241263 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 46/90] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:07.243320 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed4425-c987-42c9-81a8-6972d16364a3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:07.307092 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:07.382487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ab601-d753-4217-8f59-24b79f74170f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:07.384095 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:07.411827 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed4425-c987-42c9-81a8-6972d16364a3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:07.426279 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b27d8-bcc9-4560-9918-dd609f726dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:07.426920 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b27d8-bcc9-4560-9918-dd609f726dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:07.427199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b27d8-bcc9-4560-9918-dd609f726dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:07.427473 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b27d8-bcc9-4560-9918-dd609f726dd0 None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:07.428634 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b27d8-bcc9-4560-9918-dd609f726dd0 None admin] RBAC: Authorizing `identity:get_project(project_id=3518388fd55847e99d38040fb3c91ac5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:07.430152 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b27d8-bcc9-4560-9918-dd609f726dd0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:07.431782 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 45/91] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:07 2022] GET /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:07.432639 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b27d8-bcc9-4560-9918-dd609f726dd0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:07.482448 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdf361-b826-4987-9aea-ee60b3212c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:07.483176 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdf361-b826-4987-9aea-ee60b3212c12 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:07.483461 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdf361-b826-4987-9aea-ee60b3212c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:07.483736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdf361-b826-4987-9aea-ee60b3212c12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:07.602901 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fdf361-b826-4987-9aea-ee60b3212c12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:07.604496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fdf361-b826-4987-9aea-ee60b3212c12 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:07.614177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b27d8-bcc9-4560-9918-dd609f726dd0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:07.676430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:07.720312 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 47/92] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:07.721565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdf361-b826-4987-9aea-ee60b3212c12 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:07.733257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5784834-9d30-44e7-b7b3-29edbb1ae84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:07.734559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5784834-9d30-44e7-b7b3-29edbb1ae84f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:07.735553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5784834-9d30-44e7-b7b3-29edbb1ae84f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:07.735982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5784834-9d30-44e7-b7b3-29edbb1ae84f None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:07.740691 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5784834-9d30-44e7-b7b3-29edbb1ae84f None admin] RBAC: Authorizing `identity:get_project(project_id=3518388fd55847e99d38040fb3c91ac5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:07.742409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5784834-9d30-44e7-b7b3-29edbb1ae84f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:07.744277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 46/93] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:07 2022] GET /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:07.745238 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5784834-9d30-44e7-b7b3-29edbb1ae84f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:07.826087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:07.898701 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdf361-b826-4987-9aea-ee60b3212c12 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:07.946097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5784834-9d30-44e7-b7b3-29edbb1ae84f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:07.964644 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:07.966415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea4fd4-25fc-4550-9f2d-f060b53bc836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:07.967174 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea4fd4-25fc-4550-9f2d-f060b53bc836 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:07.967466 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea4fd4-25fc-4550-9f2d-f060b53bc836 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:07.967741 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea4fd4-25fc-4550-9f2d-f060b53bc836 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:07.968647 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea4fd4-25fc-4550-9f2d-f060b53bc836 None admin] RBAC: Adding query filter params (role.id=c726a7153e6e47a3aa35a96221eb3d78, scope.project.id=3518388fd55847e99d38040fb3c91ac5, user.id=2230c53133ec4c828215f6a48adbb673) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:07.968974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea4fd4-25fc-4550-9f2d-f060b53bc836 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:07.970712 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea4fd4-25fc-4550-9f2d-f060b53bc836 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:07.979587 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 48/94] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:42:07 2022] GET /identity/v3/role_assignments?user.id=2230c53133ec4c828215f6a48adbb673&scope.project.id=3518388fd55847e99d38040fb3c91ac5&role.id=c726a7153e6e47a3aa35a96221eb3d78 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:07.982689 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea4fd4-25fc-4550-9f2d-f060b53bc836 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:08.019275 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd116c-6df7-400c-81ae-46c57f7a2000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:08.019940 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd116c-6df7-400c-81ae-46c57f7a2000 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:08.020313 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd116c-6df7-400c-81ae-46c57f7a2000 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:08.020589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd116c-6df7-400c-81ae-46c57f7a2000 None admin] PATH_INFO: `/v3/projects/f5c6f11d39084c4bb8ce6758e9459db9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:08.021857 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd116c-6df7-400c-81ae-46c57f7a2000 None admin] RBAC: Authorizing `identity:get_project(project_id=f5c6f11d39084c4bb8ce6758e9459db9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:08.023341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fd116c-6df7-400c-81ae-46c57f7a2000 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:08.026608 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 47/95] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:07 2022] GET /identity/v3/projects/f5c6f11d39084c4bb8ce6758e9459db9 => generated 312 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:08.034112 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd116c-6df7-400c-81ae-46c57f7a2000 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:08.231944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea4fd4-25fc-4550-9f2d-f060b53bc836 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:08.261130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd116c-6df7-400c-81ae-46c57f7a2000 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:08.274629 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:08.323978 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73824eb7-f5e2-4462-bd4d-06b396997cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:08.324943 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73824eb7-f5e2-4462-bd4d-06b396997cfe None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:08.325373 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73824eb7-f5e2-4462-bd4d-06b396997cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:08.325824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73824eb7-f5e2-4462-bd4d-06b396997cfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:08.326715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73824eb7-f5e2-4462-bd4d-06b396997cfe None admin] RBAC: Adding query filter params (role.id=c726a7153e6e47a3aa35a96221eb3d78, scope.project.id=f5c6f11d39084c4bb8ce6758e9459db9, user.id=2230c53133ec4c828215f6a48adbb673) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:08.327175 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73824eb7-f5e2-4462-bd4d-06b396997cfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:08.329539 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73824eb7-f5e2-4462-bd4d-06b396997cfe None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:08.333268 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f2b47-7e39-48cf-9773-eba73cf070bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:08.333978 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f2b47-7e39-48cf-9773-eba73cf070bc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:08.334175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f2b47-7e39-48cf-9773-eba73cf070bc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:08.334487 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f2b47-7e39-48cf-9773-eba73cf070bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:08.335179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f2b47-7e39-48cf-9773-eba73cf070bc None admin] RBAC: Adding query filter params (role.id=d9c09fde9a114c2fa299455f8298db09, scope.project.id=3518388fd55847e99d38040fb3c91ac5, user.id=2230c53133ec4c828215f6a48adbb673) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:08.335490 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f2b47-7e39-48cf-9773-eba73cf070bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:08.336523 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 48/96] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:42:08 2022] GET /identity/v3/role_assignments?user.id=2230c53133ec4c828215f6a48adbb673&scope.project.id=f5c6f11d39084c4bb8ce6758e9459db9&role.id=c726a7153e6e47a3aa35a96221eb3d78 => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:08.342301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f2b47-7e39-48cf-9773-eba73cf070bc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:08.343239 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 49/97] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:42:07 2022] GET /identity/v3/role_assignments?user.id=2230c53133ec4c828215f6a48adbb673&scope.project.id=3518388fd55847e99d38040fb3c91ac5&role.id=d9c09fde9a114c2fa299455f8298db09 => generated 259 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:09.143209 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d84f1-7a85-4a3f-9250-f47a67a8dc15 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:09.144278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d84f1-7a85-4a3f-9250-f47a67a8dc15 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:09.144800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d84f1-7a85-4a3f-9250-f47a67a8dc15 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:09.146460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 49/98] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:09.152505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a63e10-6c61-42bd-adc0-8df05c34412b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:09.152975 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a63e10-6c61-42bd-adc0-8df05c34412b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:09.153231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a63e10-6c61-42bd-adc0-8df05c34412b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:09.177005 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-01a63e10-6c61-42bd-adc0-8df05c34412b None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:09.178217 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-01a63e10-6c61-42bd-adc0-8df05c34412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:09.246658 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:09.259739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 50/99] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:09.436501 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2896d21-ad06-4efb-a6aa-b7967f3d33ef None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:09.437174 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2896d21-ad06-4efb-a6aa-b7967f3d33ef None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:09.437643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2896d21-ad06-4efb-a6aa-b7967f3d33ef None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:09.439260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 50/100] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:09.444864 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dc2ff-77af-4569-96db-2857b9cf0284 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:09.445384 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dc2ff-77af-4569-96db-2857b9cf0284 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:09.445872 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361dc2ff-77af-4569-96db-2857b9cf0284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:09.464649 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-361dc2ff-77af-4569-96db-2857b9cf0284 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:09.466148 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-361dc2ff-77af-4569-96db-2857b9cf0284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:09.550905 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 51/101] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:09.609168 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2896d21-ad06-4efb-a6aa-b7967f3d33ef None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:09.727724 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2896d21-ad06-4efb-a6aa-b7967f3d33ef None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:09.768630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce0a69-fae7-4de4-8f79-1c3bb85a6f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:09.769665 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce0a69-fae7-4de4-8f79-1c3bb85a6f6f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:09.770190 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce0a69-fae7-4de4-8f79-1c3bb85a6f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:09.770655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce0a69-fae7-4de4-8f79-1c3bb85a6f6f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:09.784451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce0a69-fae7-4de4-8f79-1c3bb85a6f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:09.790250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-58ce0a69-fae7-4de4-8f79-1c3bb85a6f6f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 20:42:09.790250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:09.790250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:09.790250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:09.790250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:09.790250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:09.790250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:09.790250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:09.790250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:09.790250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:09.790250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:09.790250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:09.790250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:09.790250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:09.790250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:09.790250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:09.791077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:09.791077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:09.791077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:09.791077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:09.791077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:09.791077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:09.791077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:09.791077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:09.791077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:09.791077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:09.791077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:09.791077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:09.791077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:09.791077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:09.791077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:09.791077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:09.791813 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:09.791813 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:09.791813 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:09.791813 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:09.791813 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:09.791813 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:09.791813 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:09.791813 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:09.791813 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:09.791813 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:09.791813 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 20:42:09.791813 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:09.793597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 51/102] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:09.800052 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dc2ff-77af-4569-96db-2857b9cf0284 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:09.911877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361dc2ff-77af-4569-96db-2857b9cf0284 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:09.933633 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:09.949784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cc00c-ef55-42c3-9b6d-9ddfe1726a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:09.950596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cc00c-ef55-42c3-9b6d-9ddfe1726a74 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:09.951018 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cc00c-ef55-42c3-9b6d-9ddfe1726a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:09.951456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cc00c-ef55-42c3-9b6d-9ddfe1726a74 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:09.952291 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cc00c-ef55-42c3-9b6d-9ddfe1726a74 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:09.952735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cc00c-ef55-42c3-9b6d-9ddfe1726a74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:09.954410 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cc00c-ef55-42c3-9b6d-9ddfe1726a74 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:09.967131 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 52/103] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:09.973488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce0a69-fae7-4de4-8f79-1c3bb85a6f6f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:10.013641 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:10.099878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce0a69-fae7-4de4-8f79-1c3bb85a6f6f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:10.136752 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cc00c-ef55-42c3-9b6d-9ddfe1726a74 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:10.138788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddda1d-a98a-4337-af8b-786377feacfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:10.139727 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddda1d-a98a-4337-af8b-786377feacfc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:10.140190 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddda1d-a98a-4337-af8b-786377feacfc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:10.140673 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bddda1d-a98a-4337-af8b-786377feacfc None admin] PATH_INFO: `/v3/users/f3ff8e8429da4d5eb50e6e2d42a43919` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:10.157493 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bddda1d-a98a-4337-af8b-786377feacfc None admin] RBAC: Authorizing `identity:get_user(user_id=f3ff8e8429da4d5eb50e6e2d42a43919)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:10.159714 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bddda1d-a98a-4337-af8b-786377feacfc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:10.161658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 52/104] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:09 2022] GET /identity/v3/users/f3ff8e8429da4d5eb50e6e2d42a43919 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:10.168537 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddda1d-a98a-4337-af8b-786377feacfc None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:10.270223 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:10.286711 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bddda1d-a98a-4337-af8b-786377feacfc None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:10.308047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cc00c-ef55-42c3-9b6d-9ddfe1726a74 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:10.328344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c6f9a-6a94-4e9d-a13f-d2aa54ac65e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:10.329524 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c6f9a-6a94-4e9d-a13f-d2aa54ac65e5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:10.329958 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c6f9a-6a94-4e9d-a13f-d2aa54ac65e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:10.330386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c6f9a-6a94-4e9d-a13f-d2aa54ac65e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:10.383387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853447d-e941-4e53-9455-e820eb325220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:10.384067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853447d-e941-4e53-9455-e820eb325220 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:10.384384 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853447d-e941-4e53-9455-e820eb325220 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:10.384630 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853447d-e941-4e53-9455-e820eb325220 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:10.386998 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853447d-e941-4e53-9455-e820eb325220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:10.388430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853447d-e941-4e53-9455-e820eb325220 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:10.390352 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 53/105] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:42:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:10.395629 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853447d-e941-4e53-9455-e820eb325220 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:10.409405 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c6f9a-6a94-4e9d-a13f-d2aa54ac65e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:10.411148 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c6f9a-6a94-4e9d-a13f-d2aa54ac65e5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:10.484398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:10.511252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:10.527814 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 53/106] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 20:42:10.537164 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c6f9a-6a94-4e9d-a13f-d2aa54ac65e5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:10.573809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853447d-e941-4e53-9455-e820eb325220 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:10.637687 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684683c-c616-4e0b-aafb-0662f6417d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:10.637687 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684683c-c616-4e0b-aafb-0662f6417d8b None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:10.637687 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684683c-c616-4e0b-aafb-0662f6417d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:10.637687 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684683c-c616-4e0b-aafb-0662f6417d8b None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:10.638081 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684683c-c616-4e0b-aafb-0662f6417d8b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:10.638081 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684683c-c616-4e0b-aafb-0662f6417d8b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:10.707431 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 54/107] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Sep 9 20:42:10 2022] POST /identity/v3/projects => generated 302 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:42:10.726879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c6f9a-6a94-4e9d-a13f-d2aa54ac65e5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:10.783265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533a810-b2a4-4323-84e1-55432ec6e79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:10.784290 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533a810-b2a4-4323-84e1-55432ec6e79c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:10.784778 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533a810-b2a4-4323-84e1-55432ec6e79c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:10.785293 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533a810-b2a4-4323-84e1-55432ec6e79c None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:10.786688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533a810-b2a4-4323-84e1-55432ec6e79c None admin] RBAC: Authorizing `identity:get_project(project_id=3518388fd55847e99d38040fb3c91ac5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:10.788388 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533a810-b2a4-4323-84e1-55432ec6e79c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:10.790250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 54/108] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:10 2022] GET /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:10.798818 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684683c-c616-4e0b-aafb-0662f6417d8b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:10.810838 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4c05b-e80b-4a74-961d-803bd4d43686 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:10.811547 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4c05b-e80b-4a74-961d-803bd4d43686 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:10.812059 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4c05b-e80b-4a74-961d-803bd4d43686 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:10.814172 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 55/109] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:42:10.820731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6b2b6-64b0-437f-87f2-c30c81d9f279 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:10.821045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6b2b6-64b0-437f-87f2-c30c81d9f279 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:10.821295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6b2b6-64b0-437f-87f2-c30c81d9f279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:10.847857 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2db6b2b6-64b0-437f-87f2-c30c81d9f279 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:10.849111 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2db6b2b6-64b0-437f-87f2-c30c81d9f279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:10.965908 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:11.004717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684683c-c616-4e0b-aafb-0662f6417d8b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:11.005898 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 56/110] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:42:11.009010 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:11.051330 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465eee9-8220-49cd-aca1-1bf08e799554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:11.051897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465eee9-8220-49cd-aca1-1bf08e799554 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:11.052246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465eee9-8220-49cd-aca1-1bf08e799554 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:11.052526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465eee9-8220-49cd-aca1-1bf08e799554 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:11.053280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465eee9-8220-49cd-aca1-1bf08e799554 None admin] RBAC: Adding query filter params (role.id=b02b3a3726d145cf941be8e260928951, scope.project.id=3518388fd55847e99d38040fb3c91ac5, user.id=f3ff8e8429da4d5eb50e6e2d42a43919) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:11.053594 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465eee9-8220-49cd-aca1-1bf08e799554 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:11.055100 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465eee9-8220-49cd-aca1-1bf08e799554 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:11.061670 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 55/111] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:42:10 2022] GET /identity/v3/role_assignments?user.id=f3ff8e8429da4d5eb50e6e2d42a43919&scope.project.id=3518388fd55847e99d38040fb3c91ac5&role.id=b02b3a3726d145cf941be8e260928951 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:11.160560 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd87970-6e1a-4046-b84e-ac200c1dc786 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:11.161095 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd87970-6e1a-4046-b84e-ac200c1dc786 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:11.161379 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd87970-6e1a-4046-b84e-ac200c1dc786 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:11.162797 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 57/112] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:11.168563 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e3a98-5c12-47c1-88ab-25319f98d1e5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:11.168862 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e3a98-5c12-47c1-88ab-25319f98d1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:11.169220 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e3a98-5c12-47c1-88ab-25319f98d1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:11.192496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-166e3a98-5c12-47c1-88ab-25319f98d1e5 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:11.193718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-166e3a98-5c12-47c1-88ab-25319f98d1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:11.283723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 56/113] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:42:11.496953 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd87970-6e1a-4046-b84e-ac200c1dc786 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:11.534118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9db3e4-55c5-4c90-96f8-652985326770 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:11.534612 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9db3e4-55c5-4c90-96f8-652985326770 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:11.534702 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9db3e4-55c5-4c90-96f8-652985326770 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:11.536189 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 57/114] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:11.542295 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cac976-a65b-454a-9c13-bd585fe4a4f3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:11.542592 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cac976-a65b-454a-9c13-bd585fe4a4f3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:11.542877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cac976-a65b-454a-9c13-bd585fe4a4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:11.576484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b4cac976-a65b-454a-9c13-bd585fe4a4f3 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:11.577633 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b4cac976-a65b-454a-9c13-bd585fe4a4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:11.677256 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd87970-6e1a-4046-b84e-ac200c1dc786 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:11.732586 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f78307-701c-4a37-9da1-e9a31d9f9f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:11.733252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f78307-701c-4a37-9da1-e9a31d9f9f8b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:11.733533 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f78307-701c-4a37-9da1-e9a31d9f9f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:11.733803 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f78307-701c-4a37-9da1-e9a31d9f9f8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:11.738271 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 58/115] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:42:11.754651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f78307-701c-4a37-9da1-e9a31d9f9f8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:11.759536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f4f78307-701c-4a37-9da1-e9a31d9f9f8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:42:11.759536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:11.759536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:11.759536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:11.759536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:11.759536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:11.759536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:11.759536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:11.759536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:11.759536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:11.759536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:11.759536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:11.759536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:11.759536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:11.759536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:11.759536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:11.760395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:11.760395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:11.760395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:11.760395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:11.760395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:11.760395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:11.760395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:11.760395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:11.760395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:11.760395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:11.760395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:11.760395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:11.760395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:11.760395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:11.760395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:11.760395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:11.761134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:11.761134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:11.761134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:11.761134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:11.761134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:11.761134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:11.761134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:11.761134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:11.761134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:11.761134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:11.761134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:42:11.761134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:11.761714 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cac976-a65b-454a-9c13-bd585fe4a4f3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:11.777545 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 58/116] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:42:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:11.783270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f78307-701c-4a37-9da1-e9a31d9f9f8b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:11.825034 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:11.884895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:11.969522 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cac976-a65b-454a-9c13-bd585fe4a4f3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:11.976075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f78307-701c-4a37-9da1-e9a31d9f9f8b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:12.015665 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a50ae-c36b-4c5e-ada8-d407f0d12b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:12.016844 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a50ae-c36b-4c5e-ada8-d407f0d12b99 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:12.017122 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a50ae-c36b-4c5e-ada8-d407f0d12b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:12.017394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a50ae-c36b-4c5e-ada8-d407f0d12b99 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:12.018079 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a50ae-c36b-4c5e-ada8-d407f0d12b99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:12.018384 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a50ae-c36b-4c5e-ada8-d407f0d12b99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:12.019774 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a50ae-c36b-4c5e-ada8-d407f0d12b99 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:12.035272 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 59/117] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:12.038521 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885afdc6-d08b-4c83-93b2-0077b1c19fc7 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:12.038815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885afdc6-d08b-4c83-93b2-0077b1c19fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:12.039095 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885afdc6-d08b-4c83-93b2-0077b1c19fc7 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:12.042284 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 60/118] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:12.042872 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885afdc6-d08b-4c83-93b2-0077b1c19fc7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:12.043874 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa5fa1-cdb3-4745-bd61-10a6c1d40c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:12.044546 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa5fa1-cdb3-4745-bd61-10a6c1d40c2c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:12.044827 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa5fa1-cdb3-4745-bd61-10a6c1d40c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:12.045101 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa5fa1-cdb3-4745-bd61-10a6c1d40c2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:12.069072 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa5fa1-cdb3-4745-bd61-10a6c1d40c2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:12.079837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-28fa5fa1-cdb3-4745-bd61-10a6c1d40c2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:12.079837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:12.079837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:12.079837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:12.079837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:12.079837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:12.079837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:12.079837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:12.079837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:12.079837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:12.079837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:12.079837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:12.079837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:12.079837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:12.079837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:12.079837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:12.080739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:12.080739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:12.080739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:12.080739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:12.080739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:12.080739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:12.080739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:12.080739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:12.080739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:12.080739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:12.080739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:12.080739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:12.080739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:12.080739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:12.080739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:12.080739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:12.081498 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:12.081498 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:12.081498 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:12.081498 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:12.081498 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:12.081498 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:12.081498 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:12.081498 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:12.081498 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:12.081498 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:12.081498 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:12.081498 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:12.083747 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 59/119] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:12.086176 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af4284-7e13-4483-83ac-a96ff6c2eb7b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:12.086692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af4284-7e13-4483-83ac-a96ff6c2eb7b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:12.087169 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af4284-7e13-4483-83ac-a96ff6c2eb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:12.117235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c8af4284-7e13-4483-83ac-a96ff6c2eb7b None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:12.119627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c8af4284-7e13-4483-83ac-a96ff6c2eb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:12.182159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885afdc6-d08b-4c83-93b2-0077b1c19fc7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:12.193296 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:12.215654 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 60/120] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:12.216662 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af4284-7e13-4483-83ac-a96ff6c2eb7b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:12.223329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b3a57-b3a0-4d73-b813-4cfbe29deaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:12.223969 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b3a57-b3a0-4d73-b813-4cfbe29deaaf None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:12.224349 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b3a57-b3a0-4d73-b813-4cfbe29deaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:12.224625 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b3a57-b3a0-4d73-b813-4cfbe29deaaf None admin] PATH_INFO: `/v3/users/8564ddd7649c432ab9e6d44eaa5a7f9f` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:12.225808 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b3a57-b3a0-4d73-b813-4cfbe29deaaf None admin] RBAC: Authorizing `identity:get_user(user_id=8564ddd7649c432ab9e6d44eaa5a7f9f)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:12.227306 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b3a57-b3a0-4d73-b813-4cfbe29deaaf None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:12.231847 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 61/121] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:12 2022] GET /identity/v3/users/8564ddd7649c432ab9e6d44eaa5a7f9f => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:12.237842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b3a57-b3a0-4d73-b813-4cfbe29deaaf None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:12.238614 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:12.344860 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af4284-7e13-4483-83ac-a96ff6c2eb7b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:12.391713 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f6572-d78a-4f0b-a409-2236cc56128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:12.392771 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f6572-d78a-4f0b-a409-2236cc56128a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:12.393231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f6572-d78a-4f0b-a409-2236cc56128a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:12.393681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f6572-d78a-4f0b-a409-2236cc56128a None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:12.394526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f6572-d78a-4f0b-a409-2236cc56128a None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:12.395004 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f6572-d78a-4f0b-a409-2236cc56128a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:12.396641 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f6572-d78a-4f0b-a409-2236cc56128a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:12.418678 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 61/122] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:12.419608 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f6572-d78a-4f0b-a409-2236cc56128a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:12.431808 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b3a57-b3a0-4d73-b813-4cfbe29deaaf None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:12.470989 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750491e-342c-46f9-a7fd-c4e645017ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:12.471962 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750491e-342c-46f9-a7fd-c4e645017ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:12.472490 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750491e-342c-46f9-a7fd-c4e645017ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:12.473405 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750491e-342c-46f9-a7fd-c4e645017ee4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:12.485649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750491e-342c-46f9-a7fd-c4e645017ee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:12.492219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c750491e-342c-46f9-a7fd-c4e645017ee4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:12.492219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:12.492219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:12.492219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:12.492219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:12.492219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:12.492219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:12.492219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:12.492219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:12.492219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:12.492219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:12.492219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:12.492219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:12.492219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:12.492219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:12.492219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:12.493047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:12.493047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:12.493047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:12.493047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:12.493047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:12.493047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:12.493047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:12.493047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:12.493047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:12.493047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:12.493047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:12.493047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:12.493047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:12.493047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:12.493047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:12.493047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:12.493880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:12.493880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:12.493880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:12.493880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:12.493880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:12.493880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:12.493880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:12.493880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:12.493880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:12.493880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:12.493880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:12.493880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:12.496068 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 62/123] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:12.497048 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750491e-342c-46f9-a7fd-c4e645017ee4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:12.544702 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:12.571208 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:12.602170 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f6572-d78a-4f0b-a409-2236cc56128a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:12.622190 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750491e-342c-46f9-a7fd-c4e645017ee4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:12.640377 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363883a2-5f0f-45fe-991f-a718e8119660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:12.641362 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363883a2-5f0f-45fe-991f-a718e8119660 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:12.641844 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363883a2-5f0f-45fe-991f-a718e8119660 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:12.642316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363883a2-5f0f-45fe-991f-a718e8119660 None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:12.643741 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363883a2-5f0f-45fe-991f-a718e8119660 None admin] RBAC: Authorizing `identity:get_project(project_id=3518388fd55847e99d38040fb3c91ac5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:12.645433 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363883a2-5f0f-45fe-991f-a718e8119660 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:12.647459 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 62/124] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:12 2022] GET /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:12.648441 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363883a2-5f0f-45fe-991f-a718e8119660 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:12.658910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce2f84-b66e-495c-a961-48b78e43c107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:12.659550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce2f84-b66e-495c-a961-48b78e43c107 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:12.659836 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce2f84-b66e-495c-a961-48b78e43c107 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:12.660151 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce2f84-b66e-495c-a961-48b78e43c107 None admin] PATH_INFO: `/v3/users/2230c53133ec4c828215f6a48adbb673` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:12.661415 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce2f84-b66e-495c-a961-48b78e43c107 None admin] RBAC: Authorizing `identity:get_user(user_id=2230c53133ec4c828215f6a48adbb673)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:12.662988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ce2f84-b66e-495c-a961-48b78e43c107 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:12.664895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 63/125] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:12 2022] GET /identity/v3/users/2230c53133ec4c828215f6a48adbb673 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:12.665849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce2f84-b66e-495c-a961-48b78e43c107 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:12.764482 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363883a2-5f0f-45fe-991f-a718e8119660 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:12.795681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce2f84-b66e-495c-a961-48b78e43c107 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:12.799045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:12.800516 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa470dc-360d-4617-a35d-00cb803d9f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:12.801177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa470dc-360d-4617-a35d-00cb803d9f44 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:12.801468 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa470dc-360d-4617-a35d-00cb803d9f44 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:12.801749 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa470dc-360d-4617-a35d-00cb803d9f44 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:12.802424 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa470dc-360d-4617-a35d-00cb803d9f44 None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:12.802736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa470dc-360d-4617-a35d-00cb803d9f44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:12.804371 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa470dc-360d-4617-a35d-00cb803d9f44 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:12.814517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 63/126] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:12.819174 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa470dc-360d-4617-a35d-00cb803d9f44 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:12.829079 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:12.854429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b805026-2a61-4185-bb79-26b147f891df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:12.855655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b805026-2a61-4185-bb79-26b147f891df None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:12.856205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b805026-2a61-4185-bb79-26b147f891df None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:12.856680 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b805026-2a61-4185-bb79-26b147f891df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:12.871654 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b805026-2a61-4185-bb79-26b147f891df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:12.879708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8b805026-2a61-4185-bb79-26b147f891df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:12.879708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:12.879708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:12.879708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:12.879708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:12.879708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:12.879708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:12.879708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:12.879708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:12.879708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:12.879708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:12.879708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:12.879708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:12.879708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:12.879708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:12.879708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:12.880594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:12.880594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:12.880594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:12.880594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:12.880594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:12.880594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:12.880594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:12.880594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:12.880594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:12.880594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:12.880594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:12.880594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:12.880594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:12.880594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:12.880594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:12.880594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:12.881333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:12.881333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:12.881333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:12.881333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:12.881333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:12.881333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:12.881333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:12.881333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:12.881333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:12.881333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:12.881333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:12.881333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:12.883897 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 64/127] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:42:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:12.884876 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b805026-2a61-4185-bb79-26b147f891df None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:12.936669 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa470dc-360d-4617-a35d-00cb803d9f44 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:12.986044 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101f7d3-6b53-433d-8798-f00812c35c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:12.986965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101f7d3-6b53-433d-8798-f00812c35c94 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:12.987421 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101f7d3-6b53-433d-8798-f00812c35c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:12.988103 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101f7d3-6b53-433d-8798-f00812c35c94 None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5/users/8564ddd7649c432ab9e6d44eaa5a7f9f/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:12.991000 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101f7d3-6b53-433d-8798-f00812c35c94 None admin] RBAC: Authorizing `identity:create_grant(project_id=3518388fd55847e99d38040fb3c91ac5, user_id=8564ddd7649c432ab9e6d44eaa5a7f9f, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:12.993609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101f7d3-6b53-433d-8798-f00812c35c94 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:13.009930 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b805026-2a61-4185-bb79-26b147f891df None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:13.011142 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 64/128] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:42:12 2022] PUT /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5/users/8564ddd7649c432ab9e6d44eaa5a7f9f/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:42:13.013358 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101f7d3-6b53-433d-8798-f00812c35c94 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:13.051099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e8da7-f1a3-4b0a-bb1a-d2ad80b6275c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:13.051942 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e8da7-f1a3-4b0a-bb1a-d2ad80b6275c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:13.052307 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e8da7-f1a3-4b0a-bb1a-d2ad80b6275c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:13.052714 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e8da7-f1a3-4b0a-bb1a-d2ad80b6275c None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:13.054082 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e8da7-f1a3-4b0a-bb1a-d2ad80b6275c None admin] RBAC: Authorizing `identity:get_project(project_id=3518388fd55847e99d38040fb3c91ac5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:13.055709 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858e8da7-f1a3-4b0a-bb1a-d2ad80b6275c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:13.057992 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 65/129] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:12 2022] GET /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:13.059038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e8da7-f1a3-4b0a-bb1a-d2ad80b6275c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:13.103191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:13.120385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:13.142609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101f7d3-6b53-433d-8798-f00812c35c94 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:13.184301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af71816-e80f-4071-9115-018a9e02955f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:13.185214 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af71816-e80f-4071-9115-018a9e02955f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:13.185724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af71816-e80f-4071-9115-018a9e02955f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:13.186261 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af71816-e80f-4071-9115-018a9e02955f None admin] PATH_INFO: `/v3/users/2230c53133ec4c828215f6a48adbb673` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:13.187117 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858e8da7-f1a3-4b0a-bb1a-d2ad80b6275c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:13.189244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af71816-e80f-4071-9115-018a9e02955f None admin] RBAC: Authorizing `identity:get_user(user_id=2230c53133ec4c828215f6a48adbb673)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:13.191060 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af71816-e80f-4071-9115-018a9e02955f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:13.193425 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 65/130] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:13 2022] GET /identity/v3/users/2230c53133ec4c828215f6a48adbb673 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:13.194467 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af71816-e80f-4071-9115-018a9e02955f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:13.231961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09393b64-1bc0-45c8-ae6c-1abf40a1d42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:13.232622 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09393b64-1bc0-45c8-ae6c-1abf40a1d42a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:13.232906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09393b64-1bc0-45c8-ae6c-1abf40a1d42a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:13.233183 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09393b64-1bc0-45c8-ae6c-1abf40a1d42a None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:13.233858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09393b64-1bc0-45c8-ae6c-1abf40a1d42a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:13.234168 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09393b64-1bc0-45c8-ae6c-1abf40a1d42a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:13.236259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09393b64-1bc0-45c8-ae6c-1abf40a1d42a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:13.245720 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 66/131] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:42:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:13.246315 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09393b64-1bc0-45c8-ae6c-1abf40a1d42a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:13.352837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af71816-e80f-4071-9115-018a9e02955f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:13.385091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:13.393418 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47344abf-1c6b-462c-88b6-c3522d1e401f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:13.394102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47344abf-1c6b-462c-88b6-c3522d1e401f None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:13.394389 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47344abf-1c6b-462c-88b6-c3522d1e401f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:13.394670 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47344abf-1c6b-462c-88b6-c3522d1e401f None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5/users/2230c53133ec4c828215f6a48adbb673/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:13.395500 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09393b64-1bc0-45c8-ae6c-1abf40a1d42a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:13.396821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47344abf-1c6b-462c-88b6-c3522d1e401f None admin] RBAC: Authorizing `identity:create_grant(project_id=3518388fd55847e99d38040fb3c91ac5, user_id=2230c53133ec4c828215f6a48adbb673, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:13.398946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47344abf-1c6b-462c-88b6-c3522d1e401f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:13.402410 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:13.420854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 66/132] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:42:13 2022] PUT /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5/users/2230c53133ec4c828215f6a48adbb673/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:42:13.421387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47344abf-1c6b-462c-88b6-c3522d1e401f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:13.461602 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99cce7-2738-4893-be0b-10be0eb05c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:13.462679 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99cce7-2738-4893-be0b-10be0eb05c70 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:13.463196 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99cce7-2738-4893-be0b-10be0eb05c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:13.463720 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99cce7-2738-4893-be0b-10be0eb05c70 None admin] PATH_INFO: `/v3/projects/f5c6f11d39084c4bb8ce6758e9459db9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:13.468637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99cce7-2738-4893-be0b-10be0eb05c70 None admin] RBAC: Authorizing `identity:get_project(project_id=f5c6f11d39084c4bb8ce6758e9459db9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:13.471696 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99cce7-2738-4893-be0b-10be0eb05c70 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:13.473735 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 67/133] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:13 2022] GET /identity/v3/projects/f5c6f11d39084c4bb8ce6758e9459db9 => generated 312 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:13.495724 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99cce7-2738-4893-be0b-10be0eb05c70 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:13.588395 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47344abf-1c6b-462c-88b6-c3522d1e401f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:13.635095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e10a7-0920-415b-bf55-a7b0435d5955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:13.635771 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e10a7-0920-415b-bf55-a7b0435d5955 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:13.636085 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e10a7-0920-415b-bf55-a7b0435d5955 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:13.636370 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e10a7-0920-415b-bf55-a7b0435d5955 None admin] PATH_INFO: `/v3/users/2230c53133ec4c828215f6a48adbb673` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:13.640932 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e10a7-0920-415b-bf55-a7b0435d5955 None admin] RBAC: Authorizing `identity:get_user(user_id=2230c53133ec4c828215f6a48adbb673)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:13.647233 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e10a7-0920-415b-bf55-a7b0435d5955 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:13.649029 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 67/134] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:13 2022] GET /identity/v3/users/2230c53133ec4c828215f6a48adbb673 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:13.650524 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d47fa6-d3b3-4c99-8796-b60b56bd235e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:13.650809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d47fa6-d3b3-4c99-8796-b60b56bd235e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:13.651087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d47fa6-d3b3-4c99-8796-b60b56bd235e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:13.658601 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 68/135] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:13.660875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d47fa6-d3b3-4c99-8796-b60b56bd235e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:13.718643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99cce7-2738-4893-be0b-10be0eb05c70 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:13.768075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d5c07e-80a5-4f64-a01b-0710b4b19349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:13.769099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5c07e-80a5-4f64-a01b-0710b4b19349 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:13.769583 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5c07e-80a5-4f64-a01b-0710b4b19349 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:13.770058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d5c07e-80a5-4f64-a01b-0710b4b19349 None admin] PATH_INFO: `/v3/projects/f5c6f11d39084c4bb8ce6758e9459db9/users/2230c53133ec4c828215f6a48adbb673/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:13.772345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5c07e-80a5-4f64-a01b-0710b4b19349 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5c6f11d39084c4bb8ce6758e9459db9, user_id=2230c53133ec4c828215f6a48adbb673, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:13.774230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d5c07e-80a5-4f64-a01b-0710b4b19349 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:13.788580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:13.792363 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 68/136] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:42:13 2022] PUT /identity/v3/projects/f5c6f11d39084c4bb8ce6758e9459db9/users/2230c53133ec4c828215f6a48adbb673/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:42:13.794024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33f054-c8ef-4d0c-b56a-eed0d100410f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:13.794521 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33f054-c8ef-4d0c-b56a-eed0d100410f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:13.795027 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33f054-c8ef-4d0c-b56a-eed0d100410f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:13.817360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1b33f054-c8ef-4d0c-b56a-eed0d100410f None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:13.819660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1b33f054-c8ef-4d0c-b56a-eed0d100410f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:13.848738 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:13.858863 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d47fa6-d3b3-4c99-8796-b60b56bd235e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:13.946378 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 69/137] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:13.950720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8dba0-13ab-4125-9f22-e7b1a0faaabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:13.951450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8dba0-13ab-4125-9f22-e7b1a0faaabb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:13.951805 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8dba0-13ab-4125-9f22-e7b1a0faaabb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:13.952175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8dba0-13ab-4125-9f22-e7b1a0faaabb None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:13.953333 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8dba0-13ab-4125-9f22-e7b1a0faaabb None admin] RBAC: Authorizing `identity:get_project(project_id=3518388fd55847e99d38040fb3c91ac5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:13.954957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8dba0-13ab-4125-9f22-e7b1a0faaabb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:13.956734 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 69/138] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:13 2022] GET /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:13.963584 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33f054-c8ef-4d0c-b56a-eed0d100410f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:14.090208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33f054-c8ef-4d0c-b56a-eed0d100410f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:14.128934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ebfb56-41df-491f-b7d4-2c94f2c3499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:14.129961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebfb56-41df-491f-b7d4-2c94f2c3499f None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:14.130444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebfb56-41df-491f-b7d4-2c94f2c3499f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:14.130921 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ebfb56-41df-491f-b7d4-2c94f2c3499f None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5/users/2230c53133ec4c828215f6a48adbb673/roles/d9c09fde9a114c2fa299455f8298db09` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:14.133557 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebfb56-41df-491f-b7d4-2c94f2c3499f None admin] RBAC: Authorizing `identity:create_grant(project_id=3518388fd55847e99d38040fb3c91ac5, user_id=2230c53133ec4c828215f6a48adbb673, role_id=d9c09fde9a114c2fa299455f8298db09)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:14.135304 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ebfb56-41df-491f-b7d4-2c94f2c3499f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:14.152074 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 70/139] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:42:13 2022] PUT /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5/users/2230c53133ec4c828215f6a48adbb673/roles/d9c09fde9a114c2fa299455f8298db09 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:42:14.329630 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54b64b-df76-4ec6-9a58-d53d2d9705be None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:14.329992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54b64b-df76-4ec6-9a58-d53d2d9705be None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:14.330207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54b64b-df76-4ec6-9a58-d53d2d9705be None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:14.331800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 70/140] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:14.337342 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b9085-6956-4e16-ac09-8e8b6accd170 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:14.338180 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b9085-6956-4e16-ac09-8e8b6accd170 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:14.338659 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b9085-6956-4e16-ac09-8e8b6accd170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:14.368241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2b2b9085-6956-4e16-ac09-8e8b6accd170 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:14.369911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2b2b9085-6956-4e16-ac09-8e8b6accd170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:14.380064 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:14.424065 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54b64b-df76-4ec6-9a58-d53d2d9705be None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:14.476159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 71/141] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:42:14.585565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54b64b-df76-4ec6-9a58-d53d2d9705be None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:14.623374 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:14.640800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f8673-ea00-4759-ad8a-e95db0a8d66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:14.641440 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f8673-ea00-4759-ad8a-e95db0a8d66d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:14.641726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f8673-ea00-4759-ad8a-e95db0a8d66d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:14.642006 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f8673-ea00-4759-ad8a-e95db0a8d66d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:14.643306 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f8673-ea00-4759-ad8a-e95db0a8d66d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:14.644909 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f8673-ea00-4759-ad8a-e95db0a8d66d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:14.646495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 71/142] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:42:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:14.652209 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b9085-6956-4e16-ac09-8e8b6accd170 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:14.777463 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b9085-6956-4e16-ac09-8e8b6accd170 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:14.819033 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697cbbc-2680-440c-9754-887535720d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:14.820023 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697cbbc-2680-440c-9754-887535720d2d None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:14.820529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697cbbc-2680-440c-9754-887535720d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:14.821000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697cbbc-2680-440c-9754-887535720d2d None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:14.821856 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9697cbbc-2680-440c-9754-887535720d2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:14.823522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9697cbbc-2680-440c-9754-887535720d2d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:14.848757 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:14.854804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 72/143] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Sep 9 20:42:14 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:42:14.920809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f8673-ea00-4759-ad8a-e95db0a8d66d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:15.051636 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f8673-ea00-4759-ad8a-e95db0a8d66d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:15.088512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06b3cf-f475-4fdc-9661-e0c8cb63a737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:15.089171 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06b3cf-f475-4fdc-9661-e0c8cb63a737 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:15.089454 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06b3cf-f475-4fdc-9661-e0c8cb63a737 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:15.089730 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06b3cf-f475-4fdc-9661-e0c8cb63a737 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:15.104861 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea06b3cf-f475-4fdc-9661-e0c8cb63a737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:15.110248 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ea06b3cf-f475-4fdc-9661-e0c8cb63a737 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 20:42:15.110248 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:15.110248 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:15.110248 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:15.110248 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:15.110248 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:15.110248 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:15.110248 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:15.110248 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:15.110248 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:15.110248 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:15.110248 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:15.110248 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:15.110248 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:15.110248 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:15.110248 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:15.111095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:15.111095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:15.111095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:15.111095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:15.111095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:15.111095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:15.111095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:15.111095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:15.111095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:15.111095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:15.111095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:15.111095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:15.111095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:15.111095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:15.111095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:15.111095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:15.111854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:15.111854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:15.111854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:15.111854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:15.111854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:15.111854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:15.111854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:15.111854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:15.111854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:15.111854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:15.111854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 20:42:15.111854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:15.111854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 72/144] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:15.119027 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697cbbc-2680-440c-9754-887535720d2d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:15.257116 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697cbbc-2680-440c-9754-887535720d2d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:15.301125 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf16dfa-b8d2-4eae-b42a-59d74f9810ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:15.301798 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf16dfa-b8d2-4eae-b42a-59d74f9810ab None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:15.302082 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf16dfa-b8d2-4eae-b42a-59d74f9810ab None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:15.302354 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf16dfa-b8d2-4eae-b42a-59d74f9810ab None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:15.305621 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf16dfa-b8d2-4eae-b42a-59d74f9810ab None admin] RBAC: Adding query filter params (name=reader) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:15.305621 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf16dfa-b8d2-4eae-b42a-59d74f9810ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:15.305621 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf16dfa-b8d2-4eae-b42a-59d74f9810ab None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:15.319750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 73/145] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:15.324998 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06b3cf-f475-4fdc-9661-e0c8cb63a737 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:15.417448 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:15.466287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06b3cf-f475-4fdc-9661-e0c8cb63a737 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:15.506140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e1e27-ed6e-42dd-b54d-7caf78dca049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:15.506787 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e1e27-ed6e-42dd-b54d-7caf78dca049 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:15.507071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e1e27-ed6e-42dd-b54d-7caf78dca049 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:15.507401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e1e27-ed6e-42dd-b54d-7caf78dca049 None admin] PATH_INFO: `/v3/users/f3ff8e8429da4d5eb50e6e2d42a43919` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:15.508543 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e1e27-ed6e-42dd-b54d-7caf78dca049 None admin] RBAC: Authorizing `identity:get_user(user_id=f3ff8e8429da4d5eb50e6e2d42a43919)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:15.510020 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e1e27-ed6e-42dd-b54d-7caf78dca049 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:15.511960 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 73/146] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:15 2022] GET /identity/v3/users/f3ff8e8429da4d5eb50e6e2d42a43919 => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:15.517975 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf16dfa-b8d2-4eae-b42a-59d74f9810ab None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:15.589543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:15.634499 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf16dfa-b8d2-4eae-b42a-59d74f9810ab None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:15.674567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88114c-7977-430f-9f4b-2b4463d7f9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:15.675222 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88114c-7977-430f-9f4b-2b4463d7f9a8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:15.675505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88114c-7977-430f-9f4b-2b4463d7f9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:15.675784 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88114c-7977-430f-9f4b-2b4463d7f9a8 None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:15.676971 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88114c-7977-430f-9f4b-2b4463d7f9a8 None admin] RBAC: Authorizing `identity:get_project(project_id=3518388fd55847e99d38040fb3c91ac5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:15.678437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88114c-7977-430f-9f4b-2b4463d7f9a8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:15.680252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 74/147] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:15 2022] GET /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:15.686141 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e1e27-ed6e-42dd-b54d-7caf78dca049 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:15.806572 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e1e27-ed6e-42dd-b54d-7caf78dca049 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:15.835402 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:15.844848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3d037-d264-4f95-8e7f-95d3d8c61a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:15.845627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3d037-d264-4f95-8e7f-95d3d8c61a80 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:15.845889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3d037-d264-4f95-8e7f-95d3d8c61a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:15.846173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3d037-d264-4f95-8e7f-95d3d8c61a80 None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5/users/f3ff8e8429da4d5eb50e6e2d42a43919/roles/b02b3a3726d145cf941be8e260928951` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:15.848231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3d037-d264-4f95-8e7f-95d3d8c61a80 None admin] RBAC: Authorizing `identity:create_grant(project_id=3518388fd55847e99d38040fb3c91ac5, user_id=f3ff8e8429da4d5eb50e6e2d42a43919, role_id=b02b3a3726d145cf941be8e260928951)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:15.849705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3d037-d264-4f95-8e7f-95d3d8c61a80 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:15.865476 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 74/148] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:42:15 2022] PUT /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5/users/f3ff8e8429da4d5eb50e6e2d42a43919/roles/b02b3a3726d145cf941be8e260928951 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:42:16.221618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee893a5-f968-4ca3-af8f-f770426f0073 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:16.222078 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee893a5-f968-4ca3-af8f-f770426f0073 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:16.222279 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee893a5-f968-4ca3-af8f-f770426f0073 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:16.223951 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 75/149] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:16.229800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bcbab-efa5-4f6e-b806-eea8454b8959 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:16.230098 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bcbab-efa5-4f6e-b806-eea8454b8959 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:16.230377 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16bcbab-efa5-4f6e-b806-eea8454b8959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:16.253881 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e16bcbab-efa5-4f6e-b806-eea8454b8959 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:16.255126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e16bcbab-efa5-4f6e-b806-eea8454b8959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:16.343866 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 75/150] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:16.880721 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee893a5-f968-4ca3-af8f-f770426f0073 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:17.020776 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee893a5-f968-4ca3-af8f-f770426f0073 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:17.057346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:17.065781 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f38ce-e1cb-4214-9758-788903de2f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:17.066436 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f38ce-e1cb-4214-9758-788903de2f00 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:17.066719 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f38ce-e1cb-4214-9758-788903de2f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:17.066996 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f38ce-e1cb-4214-9758-788903de2f00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:17.083557 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f38ce-e1cb-4214-9758-788903de2f00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:17.088495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c11f38ce-e1cb-4214-9758-788903de2f00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:42:17.088495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:17.088495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:17.088495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:17.088495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:17.088495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:17.088495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:17.088495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:17.088495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:17.088495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:17.088495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:17.088495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:17.088495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:17.088495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:17.088495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:17.088495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:17.089344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:17.089344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:17.089344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:17.089344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:17.089344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:17.089344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:17.089344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:17.089344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:17.089344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:17.089344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:17.089344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:17.089344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:17.089344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:17.089344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:17.089344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:17.089344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:17.090188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:17.090188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:17.090188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:17.090188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:17.090188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:17.090188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:17.090188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:17.090188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:17.090188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:17.090188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:17.090188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:42:17.090188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:17.090188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 76/151] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:42:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:17.096713 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bcbab-efa5-4f6e-b806-eea8454b8959 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:17.203305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8a1a3-8b5d-4a3d-9d05-7214366b935a None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:17.204222 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8a1a3-8b5d-4a3d-9d05-7214366b935a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:17.204488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8a1a3-8b5d-4a3d-9d05-7214366b935a None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:17.205969 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 77/152] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:42:17.212417 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2326db-feee-4b62-bfcc-8df8e09b98a6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:17.212705 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2326db-feee-4b62-bfcc-8df8e09b98a6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:17.212984 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2326db-feee-4b62-bfcc-8df8e09b98a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:17.229198 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16bcbab-efa5-4f6e-b806-eea8454b8959 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:17.253333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8b2326db-feee-4b62-bfcc-8df8e09b98a6 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:17.254639 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8b2326db-feee-4b62-bfcc-8df8e09b98a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:17.273148 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:17.330688 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb9d14-fbdd-4c7a-a5b4-5e9af40c2d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:17.331324 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb9d14-fbdd-4c7a-a5b4-5e9af40c2d6b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:17.331607 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb9d14-fbdd-4c7a-a5b4-5e9af40c2d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:17.331885 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb9d14-fbdd-4c7a-a5b4-5e9af40c2d6b None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:17.332591 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb9d14-fbdd-4c7a-a5b4-5e9af40c2d6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:17.332898 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb9d14-fbdd-4c7a-a5b4-5e9af40c2d6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:17.334296 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb9d14-fbdd-4c7a-a5b4-5e9af40c2d6b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:17.358566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 76/153] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:17.370240 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb9d14-fbdd-4c7a-a5b4-5e9af40c2d6b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:17.399189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 78/154] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:17.430458 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35745e49-df4d-4868-817e-d1d9b50f6ccf None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:17.431107 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35745e49-df4d-4868-817e-d1d9b50f6ccf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:17.431594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35745e49-df4d-4868-817e-d1d9b50f6ccf None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:17.434697 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 79/155] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:17.439530 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c39f7-2624-4893-ac8c-fbb54cc801a9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:17.440141 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c39f7-2624-4893-ac8c-fbb54cc801a9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:17.440641 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c39f7-2624-4893-ac8c-fbb54cc801a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:17.474243 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2b0c39f7-2624-4893-ac8c-fbb54cc801a9 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:17.475784 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2b0c39f7-2624-4893-ac8c-fbb54cc801a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:17.523847 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb9d14-fbdd-4c7a-a5b4-5e9af40c2d6b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:17.565868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153d641-2475-4976-9866-80b68373a2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:17.566793 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153d641-2475-4976-9866-80b68373a2af None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:17.567229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153d641-2475-4976-9866-80b68373a2af None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:17.567655 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153d641-2475-4976-9866-80b68373a2af None admin] PATH_INFO: `/v3/users/8564ddd7649c432ab9e6d44eaa5a7f9f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:17.569358 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153d641-2475-4976-9866-80b68373a2af None admin] RBAC: Authorizing `identity:get_user(user_id=8564ddd7649c432ab9e6d44eaa5a7f9f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:17.571287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153d641-2475-4976-9866-80b68373a2af None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:17.573214 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 77/156] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:17 2022] GET /identity/v3/users/8564ddd7649c432ab9e6d44eaa5a7f9f => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:17.582191 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153d641-2475-4976-9866-80b68373a2af None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:17.637299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 80/157] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:42:17.660426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:17.707724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153d641-2475-4976-9866-80b68373a2af None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:17.743974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7982af-4786-4b5b-a3db-8ed8b6067a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:17.744554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7982af-4786-4b5b-a3db-8ed8b6067a12 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:17.744838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7982af-4786-4b5b-a3db-8ed8b6067a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:17.745198 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7982af-4786-4b5b-a3db-8ed8b6067a12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:17.820570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7982af-4786-4b5b-a3db-8ed8b6067a12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:17.822157 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7982af-4786-4b5b-a3db-8ed8b6067a12 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:17.874052 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:17.928496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 78/158] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:17.934249 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c39f7-2624-4893-ac8c-fbb54cc801a9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:17.997173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:18.032628 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7982af-4786-4b5b-a3db-8ed8b6067a12 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:18.073623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c39f7-2624-4893-ac8c-fbb54cc801a9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:18.134594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6210c-30ca-4a30-8fd1-7671dd32485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:18.135263 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6210c-30ca-4a30-8fd1-7671dd32485e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:18.135543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6210c-30ca-4a30-8fd1-7671dd32485e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:18.135866 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6210c-30ca-4a30-8fd1-7671dd32485e None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:18.140177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb6210c-30ca-4a30-8fd1-7671dd32485e None admin] RBAC: Authorizing `identity:get_project(project_id=3518388fd55847e99d38040fb3c91ac5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:18.142112 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb6210c-30ca-4a30-8fd1-7671dd32485e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:18.144852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 81/159] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:17 2022] GET /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:18.151294 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6210c-30ca-4a30-8fd1-7671dd32485e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:18.220032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7982af-4786-4b5b-a3db-8ed8b6067a12 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:18.288439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c21a4-3d67-455e-94fb-122b83d56add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:18.289039 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c21a4-3d67-455e-94fb-122b83d56add None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:18.289397 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c21a4-3d67-455e-94fb-122b83d56add None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:18.289668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c21a4-3d67-455e-94fb-122b83d56add None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:18.320337 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c21a4-3d67-455e-94fb-122b83d56add None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:18.325138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-9f6c21a4-3d67-455e-94fb-122b83d56add None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:18.325138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:18.325138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:18.325138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:18.325138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:18.325138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:18.325138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:18.325138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:18.325138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:18.325138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:18.325138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:18.325138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:18.325138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:18.325138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:18.325138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:18.325138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:18.325984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:18.325984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:18.325984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:18.325984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:18.325984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:18.325984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:18.325984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:18.325984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:18.325984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:18.325984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:18.325984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:18.325984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:18.325984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:18.325984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:18.325984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:18.325984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:18.326778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:18.326778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:18.326778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:18.326778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:18.326778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:18.326778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:18.326778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:18.326778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:18.326778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:18.326778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:18.326778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:18.326778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:18.326778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 79/160] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:42:18.327418 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c21a4-3d67-455e-94fb-122b83d56add None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:18.358060 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:18.396258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6210c-30ca-4a30-8fd1-7671dd32485e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:18.446099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:18.495051 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893a895-e32c-4d48-82af-26f01a425134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:18.496052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893a895-e32c-4d48-82af-26f01a425134 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:18.496470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893a895-e32c-4d48-82af-26f01a425134 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:18.496895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893a895-e32c-4d48-82af-26f01a425134 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:18.498026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893a895-e32c-4d48-82af-26f01a425134 None admin] RBAC: Adding query filter params (role.id=be620fc7968740269d233c5ace94a563, scope.project.id=3518388fd55847e99d38040fb3c91ac5, user.id=8564ddd7649c432ab9e6d44eaa5a7f9f) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:18.500024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893a895-e32c-4d48-82af-26f01a425134 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:18.501816 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893a895-e32c-4d48-82af-26f01a425134 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:18.515497 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 82/161] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:42:18 2022] GET /identity/v3/role_assignments?user.id=8564ddd7649c432ab9e6d44eaa5a7f9f&scope.project.id=3518388fd55847e99d38040fb3c91ac5&role.id=be620fc7968740269d233c5ace94a563 => generated 608 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:18.522336 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893a895-e32c-4d48-82af-26f01a425134 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:18.561742 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c21a4-3d67-455e-94fb-122b83d56add None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:18.658592 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8073d2f-667d-4414-ac98-095b8440863e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:18.659742 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8073d2f-667d-4414-ac98-095b8440863e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:18.661272 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8073d2f-667d-4414-ac98-095b8440863e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:18.661855 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8073d2f-667d-4414-ac98-095b8440863e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:18.689938 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8073d2f-667d-4414-ac98-095b8440863e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:18.695118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c8073d2f-667d-4414-ac98-095b8440863e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:18.695118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:18.695118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:18.695118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:18.695118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:18.695118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:18.695118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:18.695118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:18.695118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:18.695118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:18.695118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:18.695118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:18.695118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:18.695118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:18.695118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:18.695118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:18.696231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:18.696231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:18.696231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:18.696231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:18.696231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:18.696231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:18.696231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:18.696231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:18.696231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:18.696231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:18.696231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:18.696231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:18.696231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:18.696231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:18.696231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:18.696231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:18.697177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:18.697177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:18.697177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:18.697177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:18.697177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:18.697177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:18.697177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:18.697177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:18.697177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:18.697177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:18.697177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:18.697177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:18.704022 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 80/162] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:18.704022 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6946c71-0064-4667-8a52-7bea8da3a7b4 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:18.704022 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6946c71-0064-4667-8a52-7bea8da3a7b4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:18.704022 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6946c71-0064-4667-8a52-7bea8da3a7b4 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:18.704983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 81/163] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:18.714166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6946c71-0064-4667-8a52-7bea8da3a7b4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:18.756622 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893a895-e32c-4d48-82af-26f01a425134 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:18.826588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb6fdb-9d12-4538-bf85-445981075c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:18.827208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb6fdb-9d12-4538-bf85-445981075c92 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:18.827878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb6fdb-9d12-4538-bf85-445981075c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:18.828187 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb6fdb-9d12-4538-bf85-445981075c92 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:18.829439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb6fdb-9d12-4538-bf85-445981075c92 None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:18.829768 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb6fdb-9d12-4538-bf85-445981075c92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:18.831145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb6fdb-9d12-4538-bf85-445981075c92 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:18.846838 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 83/164] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:18.848185 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd75522-cda9-4a4a-b48c-b78118a505b1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:18.848570 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd75522-cda9-4a4a-b48c-b78118a505b1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:18.849047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd75522-cda9-4a4a-b48c-b78118a505b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:18.877611 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2fd75522-cda9-4a4a-b48c-b78118a505b1 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:18.878827 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2fd75522-cda9-4a4a-b48c-b78118a505b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:18.922048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:18.938590 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:19.001844 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6946c71-0064-4667-8a52-7bea8da3a7b4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:19.003350 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 84/165] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:19.004424 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd75522-cda9-4a4a-b48c-b78118a505b1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:19.074392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb5b0a-e9cd-4af1-a015-afa700c93dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:19.075264 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb5b0a-e9cd-4af1-a015-afa700c93dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:19.075712 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb5b0a-e9cd-4af1-a015-afa700c93dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:19.076180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb5b0a-e9cd-4af1-a015-afa700c93dc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:19.077074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb5b0a-e9cd-4af1-a015-afa700c93dc4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:19.077612 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb5b0a-e9cd-4af1-a015-afa700c93dc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:19.079296 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb5b0a-e9cd-4af1-a015-afa700c93dc4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:19.089167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 82/166] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:19.097032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb5b0a-e9cd-4af1-a015-afa700c93dc4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:19.199217 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd75522-cda9-4a4a-b48c-b78118a505b1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:19.241035 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb5b0a-e9cd-4af1-a015-afa700c93dc4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:19.268049 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e77f9-6288-41ff-8599-b17bb151d79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:19.268049 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e77f9-6288-41ff-8599-b17bb151d79d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:19.268049 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e77f9-6288-41ff-8599-b17bb151d79d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:19.268049 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e77f9-6288-41ff-8599-b17bb151d79d None admin] PATH_INFO: `/v3/users/2230c53133ec4c828215f6a48adbb673` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:19.271970 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e77f9-6288-41ff-8599-b17bb151d79d None admin] RBAC: Authorizing `identity:get_user(user_id=2230c53133ec4c828215f6a48adbb673)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:19.273580 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e77f9-6288-41ff-8599-b17bb151d79d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:19.276210 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 85/167] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:19 2022] GET /identity/v3/users/2230c53133ec4c828215f6a48adbb673 => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:19.282712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e77f9-6288-41ff-8599-b17bb151d79d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:19.300392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:19.315695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bfb5a-1795-441b-9451-8ec205f186c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:19.316400 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bfb5a-1795-441b-9451-8ec205f186c7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:19.316685 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bfb5a-1795-441b-9451-8ec205f186c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:19.316963 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bfb5a-1795-441b-9451-8ec205f186c7 None admin] PATH_INFO: `/v3/users/2230c53133ec4c828215f6a48adbb673` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:19.319311 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bfb5a-1795-441b-9451-8ec205f186c7 None admin] RBAC: Authorizing `identity:get_user(user_id=2230c53133ec4c828215f6a48adbb673)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:19.321032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bfb5a-1795-441b-9451-8ec205f186c7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:19.322869 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 83/168] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:19 2022] GET /identity/v3/users/2230c53133ec4c828215f6a48adbb673 => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:19.350166 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:19.356395 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bfb5a-1795-441b-9451-8ec205f186c7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:19.443799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e77f9-6288-41ff-8599-b17bb151d79d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:19.496709 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9169865-9a5c-450e-8f18-55a8f41985a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:19.497573 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9169865-9a5c-450e-8f18-55a8f41985a7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:19.498029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9169865-9a5c-450e-8f18-55a8f41985a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:19.498455 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9169865-9a5c-450e-8f18-55a8f41985a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:19.566230 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bfb5a-1795-441b-9451-8ec205f186c7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:19.593832 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9169865-9a5c-450e-8f18-55a8f41985a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:19.595643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9169865-9a5c-450e-8f18-55a8f41985a7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:19.640860 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3e313-7763-47ea-be3e-d1925112af50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:19.642392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3e313-7763-47ea-be3e-d1925112af50 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:19.642887 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3e313-7763-47ea-be3e-d1925112af50 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:19.643367 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3e313-7763-47ea-be3e-d1925112af50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:19.644333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:19.700057 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 86/169] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:19.700940 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fafc4-3596-41df-94ff-3b446c38a7e0 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:19.701231 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fafc4-3596-41df-94ff-3b446c38a7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:19.701508 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fafc4-3596-41df-94ff-3b446c38a7e0 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:19.707483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 87/170] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:19.708567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fafc4-3596-41df-94ff-3b446c38a7e0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:19.767618 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3e313-7763-47ea-be3e-d1925112af50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:19.768281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:19.780304 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3e313-7763-47ea-be3e-d1925112af50 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:19.840679 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fafc4-3596-41df-94ff-3b446c38a7e0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:19.877425 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ca807-7b39-4558-8243-0a9703e51848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:19.878391 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ca807-7b39-4558-8243-0a9703e51848 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:19.878830 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ca807-7b39-4558-8243-0a9703e51848 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:19.879257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ca807-7b39-4558-8243-0a9703e51848 None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:19.880575 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ca807-7b39-4558-8243-0a9703e51848 None admin] RBAC: Authorizing `identity:get_project(project_id=3518388fd55847e99d38040fb3c91ac5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:19.882155 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ca807-7b39-4558-8243-0a9703e51848 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:19.884307 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 88/171] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:19 2022] GET /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:19.885697 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bda2d-37eb-4bca-8111-c7309829b42a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:19.886145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bda2d-37eb-4bca-8111-c7309829b42a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:19.886566 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bda2d-37eb-4bca-8111-c7309829b42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:19.905398 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ba7bda2d-37eb-4bca-8111-c7309829b42a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:19.907406 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ba7bda2d-37eb-4bca-8111-c7309829b42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:19.923413 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:19.993351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 84/172] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:19.994500 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3e313-7763-47ea-be3e-d1925112af50 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:20.016488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 89/173] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:20.018078 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bda2d-37eb-4bca-8111-c7309829b42a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:20.159743 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:20.164520 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3e313-7763-47ea-be3e-d1925112af50 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:20.181098 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bda2d-37eb-4bca-8111-c7309829b42a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:20.234360 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71d3dd-d05f-45ee-901a-4d956d190b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:20.235638 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71d3dd-d05f-45ee-901a-4d956d190b54 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:20.236123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71d3dd-d05f-45ee-901a-4d956d190b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:20.236410 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71d3dd-d05f-45ee-901a-4d956d190b54 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:20.250478 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b22e9f-ce6b-4723-be3f-d36f641d46a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:20.251349 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b22e9f-ce6b-4723-be3f-d36f641d46a2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:20.251628 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b22e9f-ce6b-4723-be3f-d36f641d46a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:20.251903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b22e9f-ce6b-4723-be3f-d36f641d46a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:20.252669 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b22e9f-ce6b-4723-be3f-d36f641d46a2 None admin] RBAC: Adding query filter params (role.id=c726a7153e6e47a3aa35a96221eb3d78, scope.project.id=3518388fd55847e99d38040fb3c91ac5, user.id=2230c53133ec4c828215f6a48adbb673) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:20.252977 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b22e9f-ce6b-4723-be3f-d36f641d46a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:20.254761 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b22e9f-ce6b-4723-be3f-d36f641d46a2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:20.262381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71d3dd-d05f-45ee-901a-4d956d190b54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:20.269546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 90/174] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:42:20 2022] GET /identity/v3/role_assignments?user.id=2230c53133ec4c828215f6a48adbb673&scope.project.id=3518388fd55847e99d38040fb3c91ac5&role.id=c726a7153e6e47a3aa35a96221eb3d78 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:20.271963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b22e9f-ce6b-4723-be3f-d36f641d46a2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:20.273102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ea71d3dd-d05f-45ee-901a-4d956d190b54 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:20.273102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:20.273102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:20.273102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:20.273102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:20.273102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:20.273102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:20.273102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:20.273102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:20.273102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:20.273102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:20.273102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:20.273102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:20.273102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:20.273102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:20.273102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:20.273955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:20.273955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:20.273955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:20.273955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:20.273955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:20.273955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:20.273955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:20.273955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:20.273955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:20.273955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:20.273955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:20.273955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:20.273955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:20.273955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:20.273955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:20.273955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:20.274748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:20.274748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:20.274748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:20.274748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:20.274748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:20.274748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:20.274748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:20.274748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:20.274748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:20.274748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:20.274748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:20.274748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:20.277162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 85/175] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:42:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:20.277162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbe1ad-b7f5-4fe8-988b-9a0703b871ef None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:20.277335 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbe1ad-b7f5-4fe8-988b-9a0703b871ef None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:20.282645 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbe1ad-b7f5-4fe8-988b-9a0703b871ef None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:20.282788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:20.286169 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 86/176] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:20.286169 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbe1ad-b7f5-4fe8-988b-9a0703b871ef None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:20.507289 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b22e9f-ce6b-4723-be3f-d36f641d46a2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:20.512733 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbe1ad-b7f5-4fe8-988b-9a0703b871ef None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:20.557064 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d129c-645b-4d26-b274-c4b132c036cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:20.557868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d129c-645b-4d26-b274-c4b132c036cc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:20.558256 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d129c-645b-4d26-b274-c4b132c036cc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:20.558539 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d129c-645b-4d26-b274-c4b132c036cc None admin] PATH_INFO: `/v3/projects/f5c6f11d39084c4bb8ce6758e9459db9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:20.559697 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d129c-645b-4d26-b274-c4b132c036cc None admin] RBAC: Authorizing `identity:get_project(project_id=f5c6f11d39084c4bb8ce6758e9459db9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:20.561103 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d7938-6f46-4f11-ba2f-594bec675167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:20.561232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d129c-645b-4d26-b274-c4b132c036cc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:20.561946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d7938-6f46-4f11-ba2f-594bec675167 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:20.562386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d7938-6f46-4f11-ba2f-594bec675167 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:20.562832 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d7938-6f46-4f11-ba2f-594bec675167 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:20.562941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 91/177] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:20 2022] GET /identity/v3/projects/f5c6f11d39084c4bb8ce6758e9459db9 => generated 312 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:20.563844 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d7938-6f46-4f11-ba2f-594bec675167 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:20.564313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d7938-6f46-4f11-ba2f-594bec675167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:20.565016 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2c8ea-a747-4555-afbe-e1878a0fa2ee None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:20.565310 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2c8ea-a747-4555-afbe-e1878a0fa2ee None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:20.565587 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2c8ea-a747-4555-afbe-e1878a0fa2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:20.566369 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d7938-6f46-4f11-ba2f-594bec675167 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:20.580219 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 87/178] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:42:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:20.581328 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d7938-6f46-4f11-ba2f-594bec675167 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:20.589195 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a4c2c8ea-a747-4555-afbe-e1878a0fa2ee None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:20.590590 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a4c2c8ea-a747-4555-afbe-e1878a0fa2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:20.609890 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:20.667556 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:20.672886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 92/179] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:20.684192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee0da9-bf85-486e-9bbc-ddd37cf5c88b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:20.684192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee0da9-bf85-486e-9bbc-ddd37cf5c88b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:20.684192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee0da9-bf85-486e-9bbc-ddd37cf5c88b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:20.684192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 93/180] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:20.684192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee0da9-bf85-486e-9bbc-ddd37cf5c88b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:20.700778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d7938-6f46-4f11-ba2f-594bec675167 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:20.737288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992fb28-1ada-41e0-87af-6f18ee5986c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:20.737904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992fb28-1ada-41e0-87af-6f18ee5986c3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:20.738183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992fb28-1ada-41e0-87af-6f18ee5986c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:20.738458 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992fb28-1ada-41e0-87af-6f18ee5986c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:20.749517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992fb28-1ada-41e0-87af-6f18ee5986c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:20.755385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-9992fb28-1ada-41e0-87af-6f18ee5986c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:42:20.755385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:20.755385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:20.755385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:20.755385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:20.755385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:20.755385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:20.755385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:20.755385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:20.755385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:20.755385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:20.755385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:20.755385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:20.755385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:20.755385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:20.755385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:20.756281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:20.756281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:20.756281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:20.756281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:20.756281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:20.756281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:20.756281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:20.756281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:20.756281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:20.756281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:20.756281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:20.756281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:20.756281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:20.756281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:20.756281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:20.756281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:20.757086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:20.757086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:20.757086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:20.757086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:20.757086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:20.757086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:20.757086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:20.757086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:20.757086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:20.757086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:20.757086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:42:20.757086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:20.757086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 88/181] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:42:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:20.757772 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992fb28-1ada-41e0-87af-6f18ee5986c3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:20.787466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee0da9-bf85-486e-9bbc-ddd37cf5c88b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:20.821760 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f667154-d900-40bb-a485-bbb13cafd288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:20.822367 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f667154-d900-40bb-a485-bbb13cafd288 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:20.822647 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f667154-d900-40bb-a485-bbb13cafd288 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:20.822921 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f667154-d900-40bb-a485-bbb13cafd288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:20.823653 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f667154-d900-40bb-a485-bbb13cafd288 None admin] RBAC: Adding query filter params (role.id=c726a7153e6e47a3aa35a96221eb3d78, scope.project.id=f5c6f11d39084c4bb8ce6758e9459db9, user.id=2230c53133ec4c828215f6a48adbb673) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:20.823964 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f667154-d900-40bb-a485-bbb13cafd288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:20.825432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f667154-d900-40bb-a485-bbb13cafd288 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:20.831209 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 94/182] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:42:20 2022] GET /identity/v3/role_assignments?user.id=2230c53133ec4c828215f6a48adbb673&scope.project.id=f5c6f11d39084c4bb8ce6758e9459db9&role.id=c726a7153e6e47a3aa35a96221eb3d78 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:20.833306 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd815259-f938-4b30-83f5-2fc463ebe3a9 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:20.833593 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd815259-f938-4b30-83f5-2fc463ebe3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:20.833873 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd815259-f938-4b30-83f5-2fc463ebe3a9 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:20.839610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 95/183] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:20.839610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1a9aa-cd84-489b-839c-6acc3325dfb1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:20.839610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1a9aa-cd84-489b-839c-6acc3325dfb1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:20.839610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1a9aa-cd84-489b-839c-6acc3325dfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:20.849786 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:20.865361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-eae1a9aa-cd84-489b-839c-6acc3325dfb1 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:20.867758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-eae1a9aa-cd84-489b-839c-6acc3325dfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:20.878743 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992fb28-1ada-41e0-87af-6f18ee5986c3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:20.934661 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8d613-a26e-450b-b787-c9ba5dd320dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:20.936177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8d613-a26e-450b-b787-c9ba5dd320dd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:20.936995 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8d613-a26e-450b-b787-c9ba5dd320dd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:20.937449 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8d613-a26e-450b-b787-c9ba5dd320dd None admin] PATH_INFO: `/v3/users/2230c53133ec4c828215f6a48adbb673` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:20.939254 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8d613-a26e-450b-b787-c9ba5dd320dd None admin] RBAC: Authorizing `identity:get_user(user_id=2230c53133ec4c828215f6a48adbb673)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:20.941341 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8d613-a26e-450b-b787-c9ba5dd320dd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:20.944204 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 89/184] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:20 2022] GET /identity/v3/users/2230c53133ec4c828215f6a48adbb673 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:20.945477 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8d613-a26e-450b-b787-c9ba5dd320dd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:20.950235 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:20.962207 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 96/185] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:20.965431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc485b0-6b86-435c-9783-beaa56c0884f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:20.965705 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc485b0-6b86-435c-9783-beaa56c0884f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:20.965978 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc485b0-6b86-435c-9783-beaa56c0884f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:20.986160 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8fc485b0-6b86-435c-9783-beaa56c0884f None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:20.987378 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8fc485b0-6b86-435c-9783-beaa56c0884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:21.081565 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 97/186] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:21.082265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc485b0-6b86-435c-9783-beaa56c0884f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:21.103944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8d613-a26e-450b-b787-c9ba5dd320dd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:21.148804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343f116-e43c-4297-9980-162760844304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:21.150562 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343f116-e43c-4297-9980-162760844304 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:21.151304 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343f116-e43c-4297-9980-162760844304 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:21.151769 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343f116-e43c-4297-9980-162760844304 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:21.152894 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343f116-e43c-4297-9980-162760844304 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:21.154177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343f116-e43c-4297-9980-162760844304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:21.158072 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343f116-e43c-4297-9980-162760844304 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:21.171173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 90/187] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:21.172906 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343f116-e43c-4297-9980-162760844304 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:21.191204 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:21.209160 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc485b0-6b86-435c-9783-beaa56c0884f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:21.238268 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:21.252397 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3041d37-9193-4b71-9e38-59346fb85cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:21.253014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3041d37-9193-4b71-9e38-59346fb85cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:21.253292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3041d37-9193-4b71-9e38-59346fb85cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:21.253567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3041d37-9193-4b71-9e38-59346fb85cc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:21.306982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343f116-e43c-4297-9980-162760844304 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:21.338186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3041d37-9193-4b71-9e38-59346fb85cc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:21.340118 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3041d37-9193-4b71-9e38-59346fb85cc2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:21.343063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd343f11-cead-442d-9b41-d922367036fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:21.343813 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd343f11-cead-442d-9b41-d922367036fa None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:21.344773 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd343f11-cead-442d-9b41-d922367036fa None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:21.345048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd343f11-cead-442d-9b41-d922367036fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:21.355025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd343f11-cead-442d-9b41-d922367036fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:21.361426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-cd343f11-cead-442d-9b41-d922367036fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 20:42:21.361426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:21.361426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:21.361426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:21.361426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:21.361426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:21.361426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:21.361426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:21.361426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:21.361426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:21.361426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:21.361426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:21.361426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:21.361426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:21.361426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:21.361426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:21.362298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:21.362298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:21.362298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:21.362298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:21.362298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:21.362298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:21.362298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:21.362298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:21.362298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:21.362298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:21.362298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:21.362298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:21.362298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:21.362298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:21.362298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:21.362298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:21.363061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:21.363061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:21.363061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:21.363061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:21.363061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:21.363061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:21.363061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:21.363061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:21.363061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:21.363061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:21.363061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 20:42:21.363061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:21.363061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 91/188] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:21.363717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd343f11-cead-442d-9b41-d922367036fa None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:21.437847 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:21.447944 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 98/189] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:21.453079 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3041d37-9193-4b71-9e38-59346fb85cc2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:21.470105 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd343f11-cead-442d-9b41-d922367036fa None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:21.477751 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:21.504974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f189ad-6371-4c6e-8fa7-505b918f49a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:21.505606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f189ad-6371-4c6e-8fa7-505b918f49a2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:21.505886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f189ad-6371-4c6e-8fa7-505b918f49a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:21.506159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f189ad-6371-4c6e-8fa7-505b918f49a2 None admin] PATH_INFO: `/v3/users/4fd025350800438b87cf48a72b7afa5c` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:21.519765 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f189ad-6371-4c6e-8fa7-505b918f49a2 None admin] RBAC: Authorizing `identity:get_user(user_id=4fd025350800438b87cf48a72b7afa5c)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:21.521255 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f189ad-6371-4c6e-8fa7-505b918f49a2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:21.522839 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 92/190] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:21 2022] GET /identity/v3/users/4fd025350800438b87cf48a72b7afa5c => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:21.524792 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f189ad-6371-4c6e-8fa7-505b918f49a2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:21.554005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3041d37-9193-4b71-9e38-59346fb85cc2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:21.588401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbebcf-63bd-4bc9-a76e-700320556aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:21.588967 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbebcf-63bd-4bc9-a76e-700320556aef None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:21.589249 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbebcf-63bd-4bc9-a76e-700320556aef None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:21.589522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbebcf-63bd-4bc9-a76e-700320556aef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:21.590639 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdbebcf-63bd-4bc9-a76e-700320556aef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:21.592124 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdbebcf-63bd-4bc9-a76e-700320556aef None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:21.593698 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 99/191] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:42:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:21.594512 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbebcf-63bd-4bc9-a76e-700320556aef None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:21.626514 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f189ad-6371-4c6e-8fa7-505b918f49a2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:21.652980 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:21.661514 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d53e76-af28-4912-9cfb-574c1824f55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:21.662684 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d53e76-af28-4912-9cfb-574c1824f55a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:21.662684 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d53e76-af28-4912-9cfb-574c1824f55a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:21.662684 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d53e76-af28-4912-9cfb-574c1824f55a None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:21.663290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d53e76-af28-4912-9cfb-574c1824f55a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:21.663592 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d53e76-af28-4912-9cfb-574c1824f55a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:21.665013 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d53e76-af28-4912-9cfb-574c1824f55a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:21.674279 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 93/192] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:21.675052 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d53e76-af28-4912-9cfb-574c1824f55a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:21.683217 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:21.692964 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbebcf-63bd-4bc9-a76e-700320556aef None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:21.727007 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bf295-3413-4b03-9a8d-3efc3cec80c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:21.727736 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bf295-3413-4b03-9a8d-3efc3cec80c4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:21.727909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bf295-3413-4b03-9a8d-3efc3cec80c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:21.728215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bf295-3413-4b03-9a8d-3efc3cec80c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:21.738999 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bf295-3413-4b03-9a8d-3efc3cec80c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:21.743858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-329bf295-3413-4b03-9a8d-3efc3cec80c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:21.743858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:21.743858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:21.743858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:21.743858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:21.743858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:21.743858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:21.743858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:21.743858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:21.743858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:21.743858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:21.743858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:21.743858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:21.743858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:21.743858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:21.743858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:21.744812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:21.744812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:21.744812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:21.744812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:21.744812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:21.744812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:21.744812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:21.744812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:21.744812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:21.744812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:21.744812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:21.744812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:21.744812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:21.744812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:21.744812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:21.744812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:21.745579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:21.745579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:21.745579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:21.745579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:21.745579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:21.745579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:21.745579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:21.745579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:21.745579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:21.745579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:21.745579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:21.745579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:21.745579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 100/193] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:42:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:21.748951 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bf295-3413-4b03-9a8d-3efc3cec80c4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:21.780455 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d53e76-af28-4912-9cfb-574c1824f55a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:21.815725 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edd7b5-7287-4e86-a0af-87a93dc8cca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:21.815965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edd7b5-7287-4e86-a0af-87a93dc8cca1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:21.816315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edd7b5-7287-4e86-a0af-87a93dc8cca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:21.816597 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edd7b5-7287-4e86-a0af-87a93dc8cca1 None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:21.817725 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43edd7b5-7287-4e86-a0af-87a93dc8cca1 None admin] RBAC: Authorizing `identity:get_project(project_id=3518388fd55847e99d38040fb3c91ac5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:21.819201 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43edd7b5-7287-4e86-a0af-87a93dc8cca1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:21.820854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 94/194] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:21 2022] GET /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:21.821606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edd7b5-7287-4e86-a0af-87a93dc8cca1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:21.850154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bf295-3413-4b03-9a8d-3efc3cec80c4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:21.881217 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:21.884340 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dacb5ca-98f4-47f1-a62e-5b2c1d9e5ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:21.884961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacb5ca-98f4-47f1-a62e-5b2c1d9e5ada None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:21.885241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacb5ca-98f4-47f1-a62e-5b2c1d9e5ada None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:21.885509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacb5ca-98f4-47f1-a62e-5b2c1d9e5ada None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:21.908476 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:21.924367 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edd7b5-7287-4e86-a0af-87a93dc8cca1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:21.955061 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dacb5ca-98f4-47f1-a62e-5b2c1d9e5ada None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:21.956599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dacb5ca-98f4-47f1-a62e-5b2c1d9e5ada None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:21.958810 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696c4c1-ca2c-478c-9a09-e542079d032b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:21.959419 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696c4c1-ca2c-478c-9a09-e542079d032b None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:21.959695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696c4c1-ca2c-478c-9a09-e542079d032b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:21.959961 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696c4c1-ca2c-478c-9a09-e542079d032b None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:21.960628 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696c4c1-ca2c-478c-9a09-e542079d032b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:21.962058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696c4c1-ca2c-478c-9a09-e542079d032b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:21.988620 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 95/195] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Sep 9 20:42:21 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:42:21.989430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696c4c1-ca2c-478c-9a09-e542079d032b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:22.064604 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 101/196] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:22.065555 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dacb5ca-98f4-47f1-a62e-5b2c1d9e5ada None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:22.119945 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696c4c1-ca2c-478c-9a09-e542079d032b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:22.124740 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:22.135456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:22.160303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe87a6-ca79-44c6-accf-c903fc0c16bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:22.161259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe87a6-ca79-44c6-accf-c903fc0c16bb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:22.161544 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe87a6-ca79-44c6-accf-c903fc0c16bb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:22.161874 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe87a6-ca79-44c6-accf-c903fc0c16bb None admin] PATH_INFO: `/v3/users/f3ff8e8429da4d5eb50e6e2d42a43919` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:22.164067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe87a6-ca79-44c6-accf-c903fc0c16bb None admin] RBAC: Authorizing `identity:get_user(user_id=f3ff8e8429da4d5eb50e6e2d42a43919)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:22.165741 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe87a6-ca79-44c6-accf-c903fc0c16bb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:22.167357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 96/197] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:21 2022] GET /identity/v3/users/f3ff8e8429da4d5eb50e6e2d42a43919 => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:22.169502 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe87a6-ca79-44c6-accf-c903fc0c16bb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:22.185948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dacb5ca-98f4-47f1-a62e-5b2c1d9e5ada None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:22.229898 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37249c9-d176-475f-9b35-656c06d5184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:22.230607 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37249c9-d176-475f-9b35-656c06d5184b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:22.230945 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37249c9-d176-475f-9b35-656c06d5184b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:22.231603 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37249c9-d176-475f-9b35-656c06d5184b None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:22.232088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37249c9-d176-475f-9b35-656c06d5184b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:22.232402 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37249c9-d176-475f-9b35-656c06d5184b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:22.235237 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37249c9-d176-475f-9b35-656c06d5184b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:22.255079 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 102/198] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:42:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:22.255079 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37249c9-d176-475f-9b35-656c06d5184b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:22.295134 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe87a6-ca79-44c6-accf-c903fc0c16bb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:22.339116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f458a-eb6b-4fa6-a830-b4852ceb2eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:22.339757 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f458a-eb6b-4fa6-a830-b4852ceb2eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:22.340143 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f458a-eb6b-4fa6-a830-b4852ceb2eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:22.340427 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f458a-eb6b-4fa6-a830-b4852ceb2eb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:22.341172 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f458a-eb6b-4fa6-a830-b4852ceb2eb5 None admin] RBAC: Adding query filter params (role.id=d9c09fde9a114c2fa299455f8298db09, scope.project.id=3518388fd55847e99d38040fb3c91ac5, user.id=2230c53133ec4c828215f6a48adbb673) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:22.341481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f458a-eb6b-4fa6-a830-b4852ceb2eb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:22.342942 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f458a-eb6b-4fa6-a830-b4852ceb2eb5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:22.350055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 97/199] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:42:22 2022] GET /identity/v3/role_assignments?user.id=2230c53133ec4c828215f6a48adbb673&scope.project.id=3518388fd55847e99d38040fb3c91ac5&role.id=d9c09fde9a114c2fa299455f8298db09 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:22.350888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f458a-eb6b-4fa6-a830-b4852ceb2eb5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:22.385885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37249c9-d176-475f-9b35-656c06d5184b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:22.408808 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:22.412722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:22.436586 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657cc7c-d03a-4d7e-812b-d5a56e8ed6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:22.438954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657cc7c-d03a-4d7e-812b-d5a56e8ed6e4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:22.439695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657cc7c-d03a-4d7e-812b-d5a56e8ed6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:22.440188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657cc7c-d03a-4d7e-812b-d5a56e8ed6e4 None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:22.441799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657cc7c-d03a-4d7e-812b-d5a56e8ed6e4 None admin] RBAC: Authorizing `identity:get_project(project_id=e415362e3ec14b99be6122313166eaaa)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:22.444741 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657cc7c-d03a-4d7e-812b-d5a56e8ed6e4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:22.447353 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 103/200] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:22 2022] GET /identity/v3/projects/e415362e3ec14b99be6122313166eaaa => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:22.452026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657cc7c-d03a-4d7e-812b-d5a56e8ed6e4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:22.488023 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f458a-eb6b-4fa6-a830-b4852ceb2eb5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:22.527755 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94cadf-43b9-469b-a413-f62d197d3037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:22.528525 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94cadf-43b9-469b-a413-f62d197d3037 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:22.528814 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94cadf-43b9-469b-a413-f62d197d3037 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:22.529092 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94cadf-43b9-469b-a413-f62d197d3037 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:22.580869 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657cc7c-d03a-4d7e-812b-d5a56e8ed6e4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:22.619779 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94cadf-43b9-469b-a413-f62d197d3037 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:22.621370 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94cadf-43b9-469b-a413-f62d197d3037 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:22.633857 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e6a52-5247-408d-89de-f3560d2c3aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:22.634505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e6a52-5247-408d-89de-f3560d2c3aef None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:22.634786 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e6a52-5247-408d-89de-f3560d2c3aef None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:22.635060 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e6a52-5247-408d-89de-f3560d2c3aef None admin] PATH_INFO: `/v3/users/4fd025350800438b87cf48a72b7afa5c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:22.637533 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e6a52-5247-408d-89de-f3560d2c3aef None admin] RBAC: Authorizing `identity:get_user(user_id=4fd025350800438b87cf48a72b7afa5c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:22.638531 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e6a52-5247-408d-89de-f3560d2c3aef None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:22.640509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 104/201] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:22 2022] GET /identity/v3/users/4fd025350800438b87cf48a72b7afa5c => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:22.641862 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e6a52-5247-408d-89de-f3560d2c3aef None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:22.678383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:22.700763 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:22.758634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 98/202] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:22.760825 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94cadf-43b9-469b-a413-f62d197d3037 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:22.773097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e6a52-5247-408d-89de-f3560d2c3aef None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:22.820688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f7abf-a4cb-464d-bfd4-8b12c42ef84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:22.821722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f7abf-a4cb-464d-bfd4-8b12c42ef84c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:22.822600 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f7abf-a4cb-464d-bfd4-8b12c42ef84c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:22.823338 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f7abf-a4cb-464d-bfd4-8b12c42ef84c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:22.824341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f7abf-a4cb-464d-bfd4-8b12c42ef84c None admin] RBAC: Adding query filter params (role.id=be620fc7968740269d233c5ace94a563, scope.project.id=e415362e3ec14b99be6122313166eaaa, user.id=4fd025350800438b87cf48a72b7afa5c) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:22.824957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f7abf-a4cb-464d-bfd4-8b12c42ef84c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:22.826753 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f7abf-a4cb-464d-bfd4-8b12c42ef84c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:22.834999 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 105/203] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:42:22 2022] GET /identity/v3/role_assignments?user.id=4fd025350800438b87cf48a72b7afa5c&scope.project.id=e415362e3ec14b99be6122313166eaaa&role.id=be620fc7968740269d233c5ace94a563 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:22.836353 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f7abf-a4cb-464d-bfd4-8b12c42ef84c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:22.939932 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94cadf-43b9-469b-a413-f62d197d3037 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:22.962960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f7abf-a4cb-464d-bfd4-8b12c42ef84c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:22.978385 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:23.000858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1712a-6dc6-4701-8d67-915e920659c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:23.001656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1712a-6dc6-4701-8d67-915e920659c0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:23.001938 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1712a-6dc6-4701-8d67-915e920659c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:23.002230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1712a-6dc6-4701-8d67-915e920659c0 None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:23.003365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1712a-6dc6-4701-8d67-915e920659c0 None admin] RBAC: Authorizing `identity:get_project(project_id=3518388fd55847e99d38040fb3c91ac5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:23.004873 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1712a-6dc6-4701-8d67-915e920659c0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:23.010876 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 106/204] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:22 2022] GET /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:23.013108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1712a-6dc6-4701-8d67-915e920659c0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:23.032828 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce72f5-ccb0-4298-8b29-7f908d7acff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:23.033474 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce72f5-ccb0-4298-8b29-7f908d7acff7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:23.033749 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce72f5-ccb0-4298-8b29-7f908d7acff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:23.034016 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce72f5-ccb0-4298-8b29-7f908d7acff7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:23.073741 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:23.126117 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1712a-6dc6-4701-8d67-915e920659c0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:23.166024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e1a77-876f-4cc0-895a-2d8701a1b6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:23.166640 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e1a77-876f-4cc0-895a-2d8701a1b6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:23.166918 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e1a77-876f-4cc0-895a-2d8701a1b6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:23.167189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e1a77-876f-4cc0-895a-2d8701a1b6d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:23.167928 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e1a77-876f-4cc0-895a-2d8701a1b6d8 None admin] RBAC: Adding query filter params (role.id=b02b3a3726d145cf941be8e260928951, scope.project.id=3518388fd55847e99d38040fb3c91ac5, user.id=f3ff8e8429da4d5eb50e6e2d42a43919) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:23.168277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e1a77-876f-4cc0-895a-2d8701a1b6d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:23.170019 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e1a77-876f-4cc0-895a-2d8701a1b6d8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:23.176442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 107/205] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:42:23 2022] GET /identity/v3/role_assignments?user.id=f3ff8e8429da4d5eb50e6e2d42a43919&scope.project.id=3518388fd55847e99d38040fb3c91ac5&role.id=b02b3a3726d145cf941be8e260928951 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:23.184493 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce72f5-ccb0-4298-8b29-7f908d7acff7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:23.186400 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce72f5-ccb0-4298-8b29-7f908d7acff7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:23.317613 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 99/206] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:23.323595 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e1a77-876f-4cc0-895a-2d8701a1b6d8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:23.398043 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:23.474764 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e1a77-876f-4cc0-895a-2d8701a1b6d8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:23.522844 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cdbd4d-2186-4df6-9449-e4b28e799e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:23.523496 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdbd4d-2186-4df6-9449-e4b28e799e72 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:23.523779 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdbd4d-2186-4df6-9449-e4b28e799e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:23.524101 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cdbd4d-2186-4df6-9449-e4b28e799e72 None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:23.525572 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cdbd4d-2186-4df6-9449-e4b28e799e72 None admin] RBAC: Authorizing `identity:get_project(project_id=e415362e3ec14b99be6122313166eaaa)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:23.527028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cdbd4d-2186-4df6-9449-e4b28e799e72 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:23.529032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 108/207] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:23 2022] GET /identity/v3/projects/e415362e3ec14b99be6122313166eaaa => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:23.535233 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce72f5-ccb0-4298-8b29-7f908d7acff7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:23.590345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:23.650468 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce72f5-ccb0-4298-8b29-7f908d7acff7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:23.691147 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c684a6-ca25-463e-9719-a7c88047926d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:23.691773 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c684a6-ca25-463e-9719-a7c88047926d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:23.692080 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c684a6-ca25-463e-9719-a7c88047926d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:23.692359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c684a6-ca25-463e-9719-a7c88047926d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:23.693090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c684a6-ca25-463e-9719-a7c88047926d None admin] RBAC: Adding query filter params (role.id=d9c09fde9a114c2fa299455f8298db09, scope.project.id=e415362e3ec14b99be6122313166eaaa, user.id=4fd025350800438b87cf48a72b7afa5c) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:23.693400 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c684a6-ca25-463e-9719-a7c88047926d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:23.694856 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c684a6-ca25-463e-9719-a7c88047926d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:23.701054 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 100/208] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:42:23 2022] GET /identity/v3/role_assignments?user.id=4fd025350800438b87cf48a72b7afa5c&scope.project.id=e415362e3ec14b99be6122313166eaaa&role.id=d9c09fde9a114c2fa299455f8298db09 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:24.526047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74060b39-adce-4790-b983-319541e5d6f7 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:24.528687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74060b39-adce-4790-b983-319541e5d6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:24.528687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74060b39-adce-4790-b983-319541e5d6f7 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:24.528687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 109/209] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:24.535073 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d43660-84d1-4fa6-b6ad-9219f53525da None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:24.535596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d43660-84d1-4fa6-b6ad-9219f53525da None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:24.536534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d43660-84d1-4fa6-b6ad-9219f53525da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:24.554972 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-47d43660-84d1-4fa6-b6ad-9219f53525da None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:24.556493 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-47d43660-84d1-4fa6-b6ad-9219f53525da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:24.633784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 101/210] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:42:24.722113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dde541-b9d2-4c88-8f7c-d803cebd6a89 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:24.722715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dde541-b9d2-4c88-8f7c-d803cebd6a89 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:24.723211 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dde541-b9d2-4c88-8f7c-d803cebd6a89 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:24.724770 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 110/211] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:24.730040 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1e6aa-1034-4db7-b9e8-e97610097df6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:24.730330 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1e6aa-1034-4db7-b9e8-e97610097df6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:24.730672 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1e6aa-1034-4db7-b9e8-e97610097df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:24.750927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-bdb1e6aa-1034-4db7-b9e8-e97610097df6 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:24.752154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bdb1e6aa-1034-4db7-b9e8-e97610097df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:24.788166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:24.827554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 102/212] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:24.916741 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dde541-b9d2-4c88-8f7c-d803cebd6a89 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:25.020404 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dde541-b9d2-4c88-8f7c-d803cebd6a89 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:25.034425 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:25.055870 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725921e-f7fb-4f43-80f4-96875cc67c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:25.056527 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725921e-f7fb-4f43-80f4-96875cc67c26 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:25.056801 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725921e-f7fb-4f43-80f4-96875cc67c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:25.057068 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8725921e-f7fb-4f43-80f4-96875cc67c26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:25.068855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8725921e-f7fb-4f43-80f4-96875cc67c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:25.077752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8725921e-f7fb-4f43-80f4-96875cc67c26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:25.077752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:25.077752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:25.077752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:25.077752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:25.077752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:25.077752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:25.077752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:25.077752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:25.077752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:25.077752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:25.077752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:25.077752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:25.077752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:25.077752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:25.077752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:25.078750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:25.078750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:25.078750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:25.078750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:25.078750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:25.078750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:25.078750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:25.078750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:25.078750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:25.078750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:25.078750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:25.078750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:25.078750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:25.078750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:25.078750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:25.078750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:25.079551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:25.079551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:25.079551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:25.079551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:25.079551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:25.079551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:25.079551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:25.079551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:25.079551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:25.079551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:25.079551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:25.079551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:25.080618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 111/213] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:25.086213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1e6aa-1034-4db7-b9e8-e97610097df6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:25.106640 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725921e-f7fb-4f43-80f4-96875cc67c26 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:25.207409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1e6aa-1034-4db7-b9e8-e97610097df6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:25.237052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8725921e-f7fb-4f43-80f4-96875cc67c26 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:25.254416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6d838-9b42-4915-af6c-fffa8ed09bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:25.256036 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6d838-9b42-4915-af6c-fffa8ed09bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:25.256840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6d838-9b42-4915-af6c-fffa8ed09bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:25.257341 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6d838-9b42-4915-af6c-fffa8ed09bd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:25.258537 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6d838-9b42-4915-af6c-fffa8ed09bd9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:25.259546 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6d838-9b42-4915-af6c-fffa8ed09bd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:25.261305 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6d838-9b42-4915-af6c-fffa8ed09bd9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:25.275730 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 103/214] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:25.282591 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6d838-9b42-4915-af6c-fffa8ed09bd9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:25.292806 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104851e-e18a-413d-b58c-7a19d77120ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:25.293843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104851e-e18a-413d-b58c-7a19d77120ef None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:25.294324 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104851e-e18a-413d-b58c-7a19d77120ef None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:25.294818 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104851e-e18a-413d-b58c-7a19d77120ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:25.296238 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104851e-e18a-413d-b58c-7a19d77120ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:25.298569 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104851e-e18a-413d-b58c-7a19d77120ef None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:25.300526 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 112/215] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:42:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:25.308776 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104851e-e18a-413d-b58c-7a19d77120ef None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:25.321388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:25.359363 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:25.396388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6d838-9b42-4915-af6c-fffa8ed09bd9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:25.424410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104851e-e18a-413d-b58c-7a19d77120ef None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:25.434035 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2259fa-ebf6-4208-b129-7f8efb925188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:25.434792 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2259fa-ebf6-4208-b129-7f8efb925188 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:25.435074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2259fa-ebf6-4208-b129-7f8efb925188 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:25.435351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2259fa-ebf6-4208-b129-7f8efb925188 None admin] PATH_INFO: `/v3/users/4b94289e59de40e1abb5b227bd7df51f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:25.450106 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2259fa-ebf6-4208-b129-7f8efb925188 None admin] RBAC: Authorizing `identity:get_user(user_id=4b94289e59de40e1abb5b227bd7df51f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:25.451814 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2259fa-ebf6-4208-b129-7f8efb925188 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:25.454231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 104/216] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:25 2022] GET /identity/v3/users/4b94289e59de40e1abb5b227bd7df51f => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:25.455691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f52e4-771b-4aee-916f-4c2a078bdd0f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:25.455977 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f52e4-771b-4aee-916f-4c2a078bdd0f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:25.456273 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f52e4-771b-4aee-916f-4c2a078bdd0f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:25.460029 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 105/217] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:25.460029 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f52e4-771b-4aee-916f-4c2a078bdd0f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:25.467544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b8bb78-2c4b-428f-8103-d300ebe373ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:25.468601 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8bb78-2c4b-428f-8103-d300ebe373ea None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:25.468952 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8bb78-2c4b-428f-8103-d300ebe373ea None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:25.469219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b8bb78-2c4b-428f-8103-d300ebe373ea None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:25.469878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8bb78-2c4b-428f-8103-d300ebe373ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:25.471329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b8bb78-2c4b-428f-8103-d300ebe373ea None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:25.494945 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 113/218] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Sep 9 20:42:25 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:42:25.494945 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685d90b-8237-4b04-87ed-53e6da22cba7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:25.494945 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685d90b-8237-4b04-87ed-53e6da22cba7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:25.494945 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685d90b-8237-4b04-87ed-53e6da22cba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:25.519938 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f685d90b-8237-4b04-87ed-53e6da22cba7 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:25.521290 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f685d90b-8237-4b04-87ed-53e6da22cba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:25.612522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 114/219] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:25.615141 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f52e4-771b-4aee-916f-4c2a078bdd0f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:25.620369 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:25.669270 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b449da-dae4-46ee-b590-62d672be9d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:25.669940 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b449da-dae4-46ee-b590-62d672be9d6e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:25.670223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b449da-dae4-46ee-b590-62d672be9d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:25.670498 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b449da-dae4-46ee-b590-62d672be9d6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:25.759965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b449da-dae4-46ee-b590-62d672be9d6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:25.761403 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b449da-dae4-46ee-b590-62d672be9d6e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:25.873923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:25.889075 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 106/220] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:25.899288 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685d90b-8237-4b04-87ed-53e6da22cba7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:25.927824 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b449da-dae4-46ee-b590-62d672be9d6e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:25.947345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:26.065497 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685d90b-8237-4b04-87ed-53e6da22cba7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:26.090275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b449da-dae4-46ee-b590-62d672be9d6e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:26.122688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0eee2-7e42-480a-b6b1-d2da49a7df3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:26.124210 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0eee2-7e42-480a-b6b1-d2da49a7df3c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:26.124762 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0eee2-7e42-480a-b6b1-d2da49a7df3c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:26.126299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0eee2-7e42-480a-b6b1-d2da49a7df3c None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:26.128512 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0eee2-7e42-480a-b6b1-d2da49a7df3c None admin] RBAC: Authorizing `identity:get_project(project_id=e415362e3ec14b99be6122313166eaaa)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:26.131140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0eee2-7e42-480a-b6b1-d2da49a7df3c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:26.134420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 115/221] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:25 2022] GET /identity/v3/projects/e415362e3ec14b99be6122313166eaaa => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:26.141460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f51308-af27-423c-90d6-ab97d4509d97 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:26.141743 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f51308-af27-423c-90d6-ab97d4509d97 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:26.142015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f51308-af27-423c-90d6-ab97d4509d97 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:26.143489 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 116/222] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:26.144101 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f51308-af27-423c-90d6-ab97d4509d97 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:26.147778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f6632-633f-49a2-8b4f-2bc3c8f02375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:26.149776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f6632-633f-49a2-8b4f-2bc3c8f02375 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:26.150529 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f6632-633f-49a2-8b4f-2bc3c8f02375 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:26.151006 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f6632-633f-49a2-8b4f-2bc3c8f02375 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:26.166332 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f6632-633f-49a2-8b4f-2bc3c8f02375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:26.177634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-3e0f6632-633f-49a2-8b4f-2bc3c8f02375 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:42:26.177634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:26.177634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:26.177634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:26.177634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:26.177634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:26.177634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:26.177634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:26.177634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:26.177634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:26.177634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:26.177634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:26.177634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:26.177634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:26.177634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:26.177634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:26.178567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:26.178567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:26.178567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:26.178567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:26.178567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:26.178567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:26.178567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:26.178567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:26.178567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:26.178567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:26.178567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:26.178567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:26.178567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:26.178567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:26.178567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:26.178567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:26.179345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:26.179345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:26.179345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:26.179345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:26.179345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:26.179345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:26.179345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:26.179345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:26.179345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:26.179345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:26.179345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:42:26.179345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:26.182110 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 107/223] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:42:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:42:26.184817 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a6a81-08b6-4160-9feb-498f60c1f0b8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:26.185259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a6a81-08b6-4160-9feb-498f60c1f0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:26.185676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a6a81-08b6-4160-9feb-498f60c1f0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:26.213164 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b18a6a81-08b6-4160-9feb-498f60c1f0b8 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:26.214665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b18a6a81-08b6-4160-9feb-498f60c1f0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:26.287858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:26.293601 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:26.300551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f51308-af27-423c-90d6-ab97d4509d97 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:26.334554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 108/224] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:26.336722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a6a81-08b6-4160-9feb-498f60c1f0b8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:26.362642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727a650-6652-4b37-9b36-06af03828c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:26.363277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727a650-6652-4b37-9b36-06af03828c73 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:26.363555 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727a650-6652-4b37-9b36-06af03828c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:26.363822 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727a650-6652-4b37-9b36-06af03828c73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:26.364654 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727a650-6652-4b37-9b36-06af03828c73 None admin] RBAC: Adding query filter params (role.id=c726a7153e6e47a3aa35a96221eb3d78, scope.project.id=e415362e3ec14b99be6122313166eaaa, user.id=4b94289e59de40e1abb5b227bd7df51f) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:26.364966 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727a650-6652-4b37-9b36-06af03828c73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:26.370017 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727a650-6652-4b37-9b36-06af03828c73 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:26.376603 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 117/225] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:42:26 2022] GET /identity/v3/role_assignments?user.id=4b94289e59de40e1abb5b227bd7df51f&scope.project.id=e415362e3ec14b99be6122313166eaaa&role.id=c726a7153e6e47a3aa35a96221eb3d78 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:26.546898 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a6a81-08b6-4160-9feb-498f60c1f0b8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:26.600142 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7514f-eb6a-4684-9038-d5f8647779a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:26.600995 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7514f-eb6a-4684-9038-d5f8647779a8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:26.601436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7514f-eb6a-4684-9038-d5f8647779a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:26.601868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7514f-eb6a-4684-9038-d5f8647779a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:26.602699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7514f-eb6a-4684-9038-d5f8647779a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:26.603147 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7514f-eb6a-4684-9038-d5f8647779a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:26.604717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7514f-eb6a-4684-9038-d5f8647779a8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:26.617802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727a650-6652-4b37-9b36-06af03828c73 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:26.630300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 109/226] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:26.642175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7514f-eb6a-4684-9038-d5f8647779a8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:26.704103 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:26.770439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7514f-eb6a-4684-9038-d5f8647779a8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:26.788692 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727a650-6652-4b37-9b36-06af03828c73 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:26.815387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366af98f-b5ca-43eb-bf66-b9834404d713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:26.816570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366af98f-b5ca-43eb-bf66-b9834404d713 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:26.817048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366af98f-b5ca-43eb-bf66-b9834404d713 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:26.817535 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366af98f-b5ca-43eb-bf66-b9834404d713 None admin] PATH_INFO: `/v3/users/4fd025350800438b87cf48a72b7afa5c` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:26.819559 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366af98f-b5ca-43eb-bf66-b9834404d713 None admin] RBAC: Authorizing `identity:get_user(user_id=4fd025350800438b87cf48a72b7afa5c)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:26.821415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366af98f-b5ca-43eb-bf66-b9834404d713 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:26.823569 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 110/227] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:26 2022] GET /identity/v3/users/4fd025350800438b87cf48a72b7afa5c => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:26.829771 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366af98f-b5ca-43eb-bf66-b9834404d713 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:26.870519 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bdeca-bde0-4387-9819-cd5fa9face01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:26.875950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bdeca-bde0-4387-9819-cd5fa9face01 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:26.876755 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bdeca-bde0-4387-9819-cd5fa9face01 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:26.877262 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bdeca-bde0-4387-9819-cd5fa9face01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:26.905507 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27bdeca-bde0-4387-9819-cd5fa9face01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:26.920326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-b27bdeca-bde0-4387-9819-cd5fa9face01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:26.920326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:26.920326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:26.920326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:26.920326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:26.920326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:26.920326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:26.920326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:26.920326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:26.920326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:26.920326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:26.920326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:26.920326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:26.920326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:26.920326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:26.920326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:26.921248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:26.921248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:26.921248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:26.921248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:26.921248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:26.921248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:26.921248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:26.921248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:26.921248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:26.921248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:26.921248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:26.921248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:26.921248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:26.921248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:26.921248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:26.921248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:26.922192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:26.922192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:26.922192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:26.922192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:26.922192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:26.922192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:26.922192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:26.922192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:26.922192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:26.922192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:26.922192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:26.922192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:26.924607 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 118/228] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:42:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:42:26.930483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bdeca-bde0-4387-9819-cd5fa9face01 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:26.978762 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:27.027509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366af98f-b5ca-43eb-bf66-b9834404d713 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:27.040102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:27.082128 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bdeca-bde0-4387-9819-cd5fa9face01 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:27.095858 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3efe6-2d71-40f3-bc15-8e85cbd85a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:27.096554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3efe6-2d71-40f3-bc15-8e85cbd85a62 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:27.096841 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3efe6-2d71-40f3-bc15-8e85cbd85a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:27.097292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3efe6-2d71-40f3-bc15-8e85cbd85a62 None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:27.102379 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3efe6-2d71-40f3-bc15-8e85cbd85a62 None admin] RBAC: Authorizing `identity:get_project(project_id=e415362e3ec14b99be6122313166eaaa)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:27.103924 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3efe6-2d71-40f3-bc15-8e85cbd85a62 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:27.105799 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 111/229] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:26 2022] GET /identity/v3/projects/e415362e3ec14b99be6122313166eaaa => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:27.112491 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3efe6-2d71-40f3-bc15-8e85cbd85a62 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:27.121648 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52333c4d-2cc1-4353-bec2-1d5bb1b241f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:27.122560 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52333c4d-2cc1-4353-bec2-1d5bb1b241f3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:27.123133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52333c4d-2cc1-4353-bec2-1d5bb1b241f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:27.123603 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52333c4d-2cc1-4353-bec2-1d5bb1b241f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:27.124499 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52333c4d-2cc1-4353-bec2-1d5bb1b241f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:27.125043 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52333c4d-2cc1-4353-bec2-1d5bb1b241f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:27.128038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52333c4d-2cc1-4353-bec2-1d5bb1b241f3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:27.140090 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 119/230] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:42:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:27.146405 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52333c4d-2cc1-4353-bec2-1d5bb1b241f3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:27.260952 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:27.284738 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52333c4d-2cc1-4353-bec2-1d5bb1b241f3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:27.312748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3efe6-2d71-40f3-bc15-8e85cbd85a62 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:27.324899 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a638659-a842-4043-94f3-d57f9161f0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:27.325796 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a638659-a842-4043-94f3-d57f9161f0ff None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:27.326291 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a638659-a842-4043-94f3-d57f9161f0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:27.326761 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a638659-a842-4043-94f3-d57f9161f0ff None admin] PATH_INFO: `/v3/users/4fd025350800438b87cf48a72b7afa5c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:27.328622 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a638659-a842-4043-94f3-d57f9161f0ff None admin] RBAC: Authorizing `identity:get_user(user_id=4fd025350800438b87cf48a72b7afa5c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:27.331038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a638659-a842-4043-94f3-d57f9161f0ff None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:27.333788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 120/231] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:27 2022] GET /identity/v3/users/4fd025350800438b87cf48a72b7afa5c => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:27.339372 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a638659-a842-4043-94f3-d57f9161f0ff None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:27.392780 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3625a-2fa9-45e0-96e2-e400908d80f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:27.393809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3625a-2fa9-45e0-96e2-e400908d80f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:27.395454 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3625a-2fa9-45e0-96e2-e400908d80f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:27.395932 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3625a-2fa9-45e0-96e2-e400908d80f3 None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa/users/4fd025350800438b87cf48a72b7afa5c/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:27.401476 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3625a-2fa9-45e0-96e2-e400908d80f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e415362e3ec14b99be6122313166eaaa, user_id=4fd025350800438b87cf48a72b7afa5c, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:27.403249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3625a-2fa9-45e0-96e2-e400908d80f3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:27.431415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 112/232] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:42:27 2022] PUT /identity/v3/projects/e415362e3ec14b99be6122313166eaaa/users/4fd025350800438b87cf48a72b7afa5c/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:42:27.499303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a638659-a842-4043-94f3-d57f9161f0ff None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:27.538078 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bd52b-cf64-4b49-adfd-ba3d12b9a356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:27.539082 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bd52b-cf64-4b49-adfd-ba3d12b9a356 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:27.539583 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bd52b-cf64-4b49-adfd-ba3d12b9a356 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:27.540112 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bd52b-cf64-4b49-adfd-ba3d12b9a356 None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:27.541510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bd52b-cf64-4b49-adfd-ba3d12b9a356 None admin] RBAC: Authorizing `identity:get_project(project_id=e415362e3ec14b99be6122313166eaaa)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:27.543258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bd52b-cf64-4b49-adfd-ba3d12b9a356 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:27.545321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 121/233] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:27 2022] GET /identity/v3/projects/e415362e3ec14b99be6122313166eaaa => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:27.551179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3625a-2fa9-45e0-96e2-e400908d80f3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:27.615162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:27.699323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3625a-2fa9-45e0-96e2-e400908d80f3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:27.739444 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de123e1-86ea-48cc-8805-c2caa20d86b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:27.740145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de123e1-86ea-48cc-8805-c2caa20d86b4 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:27.740423 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de123e1-86ea-48cc-8805-c2caa20d86b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:27.740697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de123e1-86ea-48cc-8805-c2caa20d86b4 None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa/users/4fd025350800438b87cf48a72b7afa5c/roles/d9c09fde9a114c2fa299455f8298db09` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:27.742912 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de123e1-86ea-48cc-8805-c2caa20d86b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e415362e3ec14b99be6122313166eaaa, user_id=4fd025350800438b87cf48a72b7afa5c, role_id=d9c09fde9a114c2fa299455f8298db09)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:27.744597 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de123e1-86ea-48cc-8805-c2caa20d86b4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:27.760685 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 113/234] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:42:27 2022] PUT /identity/v3/projects/e415362e3ec14b99be6122313166eaaa/users/4fd025350800438b87cf48a72b7afa5c/roles/d9c09fde9a114c2fa299455f8298db09 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:42:28.387413 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48696119-a25d-4341-994b-418f654418c0 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:28.388418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48696119-a25d-4341-994b-418f654418c0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:28.388910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48696119-a25d-4341-994b-418f654418c0 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:28.390900 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 122/235] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:28.395933 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f5279-39df-4c3a-a496-dcdc838e9d87 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:28.396246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f5279-39df-4c3a-a496-dcdc838e9d87 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:28.396523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f5279-39df-4c3a-a496-dcdc838e9d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:28.420429 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-666f5279-39df-4c3a-a496-dcdc838e9d87 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:28.421654 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-666f5279-39df-4c3a-a496-dcdc838e9d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:28.457437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28848bd6-da3c-483d-9a03-c7bbcf43c236 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:28.457805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28848bd6-da3c-483d-9a03-c7bbcf43c236 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:28.458158 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28848bd6-da3c-483d-9a03-c7bbcf43c236 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:28.459566 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 123/236] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:42:28.465469 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61ac5e-c3c8-4c6a-a403-fa5f25fc57c1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:28.465940 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61ac5e-c3c8-4c6a-a403-fa5f25fc57c1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:28.466222 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61ac5e-c3c8-4c6a-a403-fa5f25fc57c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:28.501514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-aa61ac5e-c3c8-4c6a-a403-fa5f25fc57c1 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:28.502708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aa61ac5e-c3c8-4c6a-a403-fa5f25fc57c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:28.520554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 114/237] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:28.526913 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:28.583358 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 124/238] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:42:28.905541 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f5279-39df-4c3a-a496-dcdc838e9d87 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:28.941876 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:28.969497 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61ac5e-c3c8-4c6a-a403-fa5f25fc57c1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:29.080005 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f5279-39df-4c3a-a496-dcdc838e9d87 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:29.141928 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61ac5e-c3c8-4c6a-a403-fa5f25fc57c1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:29.145912 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab0e51-8e1f-4f4a-aed4-0774792753cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:29.146565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab0e51-8e1f-4f4a-aed4-0774792753cb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:29.146853 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab0e51-8e1f-4f4a-aed4-0774792753cb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:29.147129 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab0e51-8e1f-4f4a-aed4-0774792753cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:29.168413 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab0e51-8e1f-4f4a-aed4-0774792753cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:29.173606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-afab0e51-8e1f-4f4a-aed4-0774792753cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 20:42:29.173606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:29.173606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:29.173606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:29.173606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:29.173606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:29.173606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:29.173606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:29.173606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:29.173606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:29.173606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:29.173606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:29.173606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:29.173606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:29.173606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:29.173606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:29.174698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:29.174698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:29.174698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:29.174698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:29.174698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:29.174698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:29.174698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:29.174698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:29.174698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:29.174698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:29.174698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:29.174698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:29.174698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:29.174698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:29.174698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:29.174698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:29.175692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:29.175692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:29.175692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:29.175692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:29.175692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:29.175692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:29.175692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:29.175692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:29.175692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:29.175692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:29.175692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 20:42:29.175692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:29.177807 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 115/239] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:29.179335 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c1535-ee22-4eeb-95b1-4826aff235b2 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:29.180376 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c1535-ee22-4eeb-95b1-4826aff235b2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:29.180862 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c1535-ee22-4eeb-95b1-4826aff235b2 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:29.182408 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 116/240] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:29.183328 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c1535-ee22-4eeb-95b1-4826aff235b2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:29.200617 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e658f-9996-4e2c-b295-8760e0f6631f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:29.201387 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e658f-9996-4e2c-b295-8760e0f6631f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:29.201777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e658f-9996-4e2c-b295-8760e0f6631f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:29.202152 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e658f-9996-4e2c-b295-8760e0f6631f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:29.204027 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e658f-9996-4e2c-b295-8760e0f6631f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:29.205574 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e658f-9996-4e2c-b295-8760e0f6631f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:29.207324 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 125/241] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:42:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:29.208638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf1b73-00c9-46fd-b049-fd7ae7699faf None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:29.209038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf1b73-00c9-46fd-b049-fd7ae7699faf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:29.209410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf1b73-00c9-46fd-b049-fd7ae7699faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:29.229244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-04cf1b73-00c9-46fd-b049-fd7ae7699faf None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:29.230429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-04cf1b73-00c9-46fd-b049-fd7ae7699faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:29.242829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:29.302323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:29.319979 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 126/242] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:29.321430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf1b73-00c9-46fd-b049-fd7ae7699faf None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:29.322692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c1535-ee22-4eeb-95b1-4826aff235b2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:29.386431 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd12b4-4e18-4149-a854-cd543fe6e0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:29.387297 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd12b4-4e18-4149-a854-cd543fe6e0ff None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:29.388400 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd12b4-4e18-4149-a854-cd543fe6e0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:29.388930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd12b4-4e18-4149-a854-cd543fe6e0ff None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:29.389828 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd12b4-4e18-4149-a854-cd543fe6e0ff None admin] RBAC: Adding query filter params (name=reader) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:29.390355 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd12b4-4e18-4149-a854-cd543fe6e0ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:29.393049 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd12b4-4e18-4149-a854-cd543fe6e0ff None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:29.403544 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 117/243] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:29.411279 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd12b4-4e18-4149-a854-cd543fe6e0ff None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:29.514706 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf1b73-00c9-46fd-b049-fd7ae7699faf None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:29.551695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205a05c-cfe8-4b09-96e8-acd2eecfe44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:29.552698 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205a05c-cfe8-4b09-96e8-acd2eecfe44d None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:29.553930 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205a05c-cfe8-4b09-96e8-acd2eecfe44d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:29.554405 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205a05c-cfe8-4b09-96e8-acd2eecfe44d None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:29.555264 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205a05c-cfe8-4b09-96e8-acd2eecfe44d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:29.556990 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205a05c-cfe8-4b09-96e8-acd2eecfe44d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:29.591344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 127/244] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Sep 9 20:42:29 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:42:29.603579 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd12b4-4e18-4149-a854-cd543fe6e0ff None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:29.646832 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0d57b-0919-4263-b079-fd1db8dbcc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:29.647921 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0d57b-0919-4263-b079-fd1db8dbcc77 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:29.648449 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0d57b-0919-4263-b079-fd1db8dbcc77 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:29.648939 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0d57b-0919-4263-b079-fd1db8dbcc77 None admin] PATH_INFO: `/v3/users/5d3fd9ca09d942cf9b0538bc73cfb275` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:29.666173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205a05c-cfe8-4b09-96e8-acd2eecfe44d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:29.666372 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0d57b-0919-4263-b079-fd1db8dbcc77 None admin] RBAC: Authorizing `identity:get_user(user_id=5d3fd9ca09d942cf9b0538bc73cfb275)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:29.667780 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0d57b-0919-4263-b079-fd1db8dbcc77 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:29.669793 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 118/245] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:29 2022] GET /identity/v3/users/5d3fd9ca09d942cf9b0538bc73cfb275 => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:29.675272 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:29.679539 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0d57b-0919-4263-b079-fd1db8dbcc77 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:29.708398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:29.857093 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205a05c-cfe8-4b09-96e8-acd2eecfe44d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:29.863365 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0d57b-0919-4263-b079-fd1db8dbcc77 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:29.898024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94e975-86fa-4357-9022-ecf3e840398e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:29.899331 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94e975-86fa-4357-9022-ecf3e840398e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:29.899808 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94e975-86fa-4357-9022-ecf3e840398e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:29.900559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94e975-86fa-4357-9022-ecf3e840398e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:29.902938 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac5e79-43db-45b4-ba27-2573036dc626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:29.903835 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac5e79-43db-45b4-ba27-2573036dc626 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:29.903962 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac5e79-43db-45b4-ba27-2573036dc626 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:29.904244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac5e79-43db-45b4-ba27-2573036dc626 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:29.914388 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94e975-86fa-4357-9022-ecf3e840398e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:29.920300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-aa94e975-86fa-4357-9022-ecf3e840398e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:29.920300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:29.920300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:29.920300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:29.920300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:29.920300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:29.920300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:29.920300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:29.920300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:29.920300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:29.920300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:29.920300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:29.920300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:29.920300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:29.920300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:29.920300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:29.921244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:29.921244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:29.921244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:29.921244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:29.921244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:29.921244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:29.921244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:29.921244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:29.921244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:29.921244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:29.921244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:29.921244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:29.921244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:29.921244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:29.921244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:29.921244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:29.922631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:29.922631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:29.922631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:29.922631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:29.922631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:29.922631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:29.922631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:29.922631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:29.922631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:29.922631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:29.922631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:29.922631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:29.925614 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 128/246] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:42:29.931502 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94e975-86fa-4357-9022-ecf3e840398e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:29.992734 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac5e79-43db-45b4-ba27-2573036dc626 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:29.994325 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac5e79-43db-45b4-ba27-2573036dc626 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:30.005364 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:30.008463 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:30.054309 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94e975-86fa-4357-9022-ecf3e840398e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:30.096076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20112eae-c423-4c8d-97ab-c7f8f53e1331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:30.097052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20112eae-c423-4c8d-97ab-c7f8f53e1331 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:30.097547 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20112eae-c423-4c8d-97ab-c7f8f53e1331 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:30.097996 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20112eae-c423-4c8d-97ab-c7f8f53e1331 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:30.098855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20112eae-c423-4c8d-97ab-c7f8f53e1331 None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:30.099391 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20112eae-c423-4c8d-97ab-c7f8f53e1331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:30.100977 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20112eae-c423-4c8d-97ab-c7f8f53e1331 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:30.112233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 129/247] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:30.118113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20112eae-c423-4c8d-97ab-c7f8f53e1331 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:30.131436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 119/248] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 20:42:30.136363 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac5e79-43db-45b4-ba27-2573036dc626 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:30.250637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20112eae-c423-4c8d-97ab-c7f8f53e1331 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:30.275927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac5e79-43db-45b4-ba27-2573036dc626 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:30.289171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:30.294493 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:30.310471 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2f341-a030-44a3-ad80-86177207c998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:30.310975 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2f341-a030-44a3-ad80-86177207c998 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:30.311352 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2f341-a030-44a3-ad80-86177207c998 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:30.311723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2f341-a030-44a3-ad80-86177207c998 None admin] PATH_INFO: `/v3/users/4b94289e59de40e1abb5b227bd7df51f` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:30.313220 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2f341-a030-44a3-ad80-86177207c998 None admin] RBAC: Authorizing `identity:get_user(user_id=4b94289e59de40e1abb5b227bd7df51f)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:30.315058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2f341-a030-44a3-ad80-86177207c998 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:30.316654 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 130/249] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:30 2022] GET /identity/v3/users/4b94289e59de40e1abb5b227bd7df51f => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:30.322312 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2f341-a030-44a3-ad80-86177207c998 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:30.333677 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0045eb-05fe-4447-bf69-3b456f45978a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:30.334642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0045eb-05fe-4447-bf69-3b456f45978a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:30.335095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0045eb-05fe-4447-bf69-3b456f45978a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:30.335540 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0045eb-05fe-4447-bf69-3b456f45978a None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:30.337048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0045eb-05fe-4447-bf69-3b456f45978a None admin] RBAC: Authorizing `identity:get_project(project_id=e415362e3ec14b99be6122313166eaaa)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:30.338804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0045eb-05fe-4447-bf69-3b456f45978a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:30.341158 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 120/250] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:30 2022] GET /identity/v3/projects/e415362e3ec14b99be6122313166eaaa => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:30.348381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0045eb-05fe-4447-bf69-3b456f45978a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:30.476155 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2f341-a030-44a3-ad80-86177207c998 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:30.509076 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0045eb-05fe-4447-bf69-3b456f45978a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:30.517453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc17a86-8290-420f-ac95-4820f417fdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:30.518141 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc17a86-8290-420f-ac95-4820f417fdca None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:30.518429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc17a86-8290-420f-ac95-4820f417fdca None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:30.518705 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc17a86-8290-420f-ac95-4820f417fdca None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:30.519875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc17a86-8290-420f-ac95-4820f417fdca None admin] RBAC: Authorizing `identity:get_project(project_id=e415362e3ec14b99be6122313166eaaa)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:30.521353 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc17a86-8290-420f-ac95-4820f417fdca None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:30.523002 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 131/251] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:30 2022] GET /identity/v3/projects/e415362e3ec14b99be6122313166eaaa => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:30.524204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d45538-fff5-43d0-b028-6f58af609edb None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:30.524702 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d45538-fff5-43d0-b028-6f58af609edb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:30.525238 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d45538-fff5-43d0-b028-6f58af609edb None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:30.527237 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 132/252] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:30.528297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee0c0a-1ad8-4026-8c04-8e634182ce51 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:30.528577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee0c0a-1ad8-4026-8c04-8e634182ce51 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:30.528855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee0c0a-1ad8-4026-8c04-8e634182ce51 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:30.534253 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 133/253] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:30.535028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee0c0a-1ad8-4026-8c04-8e634182ce51 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:30.547148 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be882695-ea74-4e9a-9bc6-d647cfc3a598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:30.548143 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be882695-ea74-4e9a-9bc6-d647cfc3a598 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:30.548436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be882695-ea74-4e9a-9bc6-d647cfc3a598 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:30.548698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be882695-ea74-4e9a-9bc6-d647cfc3a598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:30.549429 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be882695-ea74-4e9a-9bc6-d647cfc3a598 None admin] RBAC: Adding query filter params (role.id=b02b3a3726d145cf941be8e260928951, scope.project.id=e415362e3ec14b99be6122313166eaaa, user.id=5d3fd9ca09d942cf9b0538bc73cfb275) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:30.549734 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be882695-ea74-4e9a-9bc6-d647cfc3a598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:30.551201 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be882695-ea74-4e9a-9bc6-d647cfc3a598 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:30.556896 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 121/254] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:42:30 2022] GET /identity/v3/role_assignments?user.id=5d3fd9ca09d942cf9b0538bc73cfb275&scope.project.id=e415362e3ec14b99be6122313166eaaa&role.id=b02b3a3726d145cf941be8e260928951 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:30.558149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abeba3-328f-4b52-8760-a3bdd2ce5a53 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:30.558435 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abeba3-328f-4b52-8760-a3bdd2ce5a53 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:30.558704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abeba3-328f-4b52-8760-a3bdd2ce5a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:30.579295 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f3abeba3-328f-4b52-8760-a3bdd2ce5a53 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:30.580739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f3abeba3-328f-4b52-8760-a3bdd2ce5a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:30.652865 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:30.665507 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:30.675323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 122/255] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:30.676767 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3effc-b881-4de2-8069-bb44eb709421 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:30.677050 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3effc-b881-4de2-8069-bb44eb709421 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:30.677322 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3effc-b881-4de2-8069-bb44eb709421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:30.697643 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7fc3effc-b881-4de2-8069-bb44eb709421 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:30.699292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7fc3effc-b881-4de2-8069-bb44eb709421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:30.756835 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee0c0a-1ad8-4026-8c04-8e634182ce51 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:30.827660 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 123/256] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:30.842055 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69531db1-881d-4989-9738-07f6d1605ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:30.842728 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69531db1-881d-4989-9738-07f6d1605ff4 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:30.843010 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69531db1-881d-4989-9738-07f6d1605ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:30.843342 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69531db1-881d-4989-9738-07f6d1605ff4 None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa/users/4b94289e59de40e1abb5b227bd7df51f/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:30.847774 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69531db1-881d-4989-9738-07f6d1605ff4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e415362e3ec14b99be6122313166eaaa, user_id=4b94289e59de40e1abb5b227bd7df51f, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:30.849283 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69531db1-881d-4989-9738-07f6d1605ff4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:30.867290 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 134/257] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:42:30 2022] PUT /identity/v3/projects/e415362e3ec14b99be6122313166eaaa/users/4b94289e59de40e1abb5b227bd7df51f/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:42:31.045255 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3effc-b881-4de2-8069-bb44eb709421 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:31.196012 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:31.199894 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3effc-b881-4de2-8069-bb44eb709421 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:31.248084 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4480136-67d7-421a-b7d1-8f574eff348e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:31.248822 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4480136-67d7-421a-b7d1-8f574eff348e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:31.249107 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4480136-67d7-421a-b7d1-8f574eff348e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:31.249383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4480136-67d7-421a-b7d1-8f574eff348e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:31.264990 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4480136-67d7-421a-b7d1-8f574eff348e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:31.270509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-a4480136-67d7-421a-b7d1-8f574eff348e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:42:31.270509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:31.270509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:31.270509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:31.270509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:31.270509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:31.270509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:31.270509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:31.270509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:31.270509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:31.270509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:31.270509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:31.270509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:31.270509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:31.270509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:31.270509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:31.271383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:31.271383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:31.271383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:31.271383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:31.271383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:31.271383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:31.271383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:31.271383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:31.271383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:31.271383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:31.271383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:31.271383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:31.271383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:31.271383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:31.271383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:31.271383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:31.272992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:31.272992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:31.272992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:31.272992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:31.272992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:31.272992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:31.272992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:31.272992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:31.272992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:31.272992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:31.272992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:42:31.272992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:31.272992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 124/258] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:42:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:42:31.277733 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69531db1-881d-4989-9738-07f6d1605ff4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:31.356469 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4480136-67d7-421a-b7d1-8f574eff348e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:31.442320 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69531db1-881d-4989-9738-07f6d1605ff4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:31.472457 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:31.505184 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31faf2eb-15b1-41be-951d-24cb8bc7f5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:31.505806 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faf2eb-15b1-41be-951d-24cb8bc7f5c5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:31.506089 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faf2eb-15b1-41be-951d-24cb8bc7f5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:31.506368 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31faf2eb-15b1-41be-951d-24cb8bc7f5c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:31.507044 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31faf2eb-15b1-41be-951d-24cb8bc7f5c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:31.507350 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31faf2eb-15b1-41be-951d-24cb8bc7f5c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:31.508762 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31faf2eb-15b1-41be-951d-24cb8bc7f5c5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:31.523301 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 135/259] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:31.530109 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31faf2eb-15b1-41be-951d-24cb8bc7f5c5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:31.533522 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4480136-67d7-421a-b7d1-8f574eff348e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:31.601225 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37183585-b30a-4310-8ced-e8048c38c567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:31.601795 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37183585-b30a-4310-8ced-e8048c38c567 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:31.602079 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37183585-b30a-4310-8ced-e8048c38c567 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:31.602352 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37183585-b30a-4310-8ced-e8048c38c567 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:31.620543 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37183585-b30a-4310-8ced-e8048c38c567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:31.628373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-37183585-b30a-4310-8ced-e8048c38c567 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:31.628373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:31.628373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:31.628373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:31.628373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:31.628373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:31.628373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:31.628373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:31.628373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:31.628373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:31.628373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:31.628373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:31.628373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:31.628373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:31.628373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:31.628373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:31.629315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:31.629315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:31.629315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:31.629315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:31.629315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:31.629315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:31.629315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:31.629315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:31.629315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:31.629315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:31.629315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:31.629315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:31.629315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:31.629315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:31.629315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:31.629315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:31.630666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:31.630666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:31.630666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:31.630666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:31.630666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:31.630666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:31.630666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:31.630666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:31.630666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:31.630666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:31.630666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:31.630666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:31.630666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 125/260] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:42:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:42:31.645028 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37183585-b30a-4310-8ced-e8048c38c567 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:31.679615 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31faf2eb-15b1-41be-951d-24cb8bc7f5c5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:31.695851 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:31.721074 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad0a43-90dc-4561-abdf-f55091ebc0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:31.721982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad0a43-90dc-4561-abdf-f55091ebc0e9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:31.722261 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad0a43-90dc-4561-abdf-f55091ebc0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:31.722538 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad0a43-90dc-4561-abdf-f55091ebc0e9 None admin] PATH_INFO: `/v3/users/4fd025350800438b87cf48a72b7afa5c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:31.723706 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad0a43-90dc-4561-abdf-f55091ebc0e9 None admin] RBAC: Authorizing `identity:get_user(user_id=4fd025350800438b87cf48a72b7afa5c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:31.725877 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad0a43-90dc-4561-abdf-f55091ebc0e9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:31.727952 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 136/261] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:31 2022] GET /identity/v3/users/4fd025350800438b87cf48a72b7afa5c => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:31.733074 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad0a43-90dc-4561-abdf-f55091ebc0e9 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:31.793708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:31.853273 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37183585-b30a-4310-8ced-e8048c38c567 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:31.862318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad0a43-90dc-4561-abdf-f55091ebc0e9 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:31.900935 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73781d43-2e59-4295-88e2-bfe807a7b5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:31.901551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73781d43-2e59-4295-88e2-bfe807a7b5ae None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:31.901823 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73781d43-2e59-4295-88e2-bfe807a7b5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:31.902093 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73781d43-2e59-4295-88e2-bfe807a7b5ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:31.924164 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6da8d-2be6-4ac3-9260-439b2de59106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:31.924836 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6da8d-2be6-4ac3-9260-439b2de59106 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:31.925126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6da8d-2be6-4ac3-9260-439b2de59106 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:31.925409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6da8d-2be6-4ac3-9260-439b2de59106 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:31.926081 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6da8d-2be6-4ac3-9260-439b2de59106 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:31.926387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6da8d-2be6-4ac3-9260-439b2de59106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:31.927803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6da8d-2be6-4ac3-9260-439b2de59106 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:31.946406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 126/262] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:42:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:31.952185 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6da8d-2be6-4ac3-9260-439b2de59106 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:31.975122 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73781d43-2e59-4295-88e2-bfe807a7b5ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:31.976617 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73781d43-2e59-4295-88e2-bfe807a7b5ae None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:32.030094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:32.092463 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 137/263] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 20:42:32.100125 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:32.101303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73781d43-2e59-4295-88e2-bfe807a7b5ae None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:32.122805 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6da8d-2be6-4ac3-9260-439b2de59106 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:32.173346 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f07a0-bcbf-40fc-bd13-037eaf4faa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:32.174401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f07a0-bcbf-40fc-bd13-037eaf4faa40 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:32.174887 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f07a0-bcbf-40fc-bd13-037eaf4faa40 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:32.175438 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f07a0-bcbf-40fc-bd13-037eaf4faa40 None admin] PATH_INFO: `/v3/users/4fd025350800438b87cf48a72b7afa5c` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:32.177653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f07a0-bcbf-40fc-bd13-037eaf4faa40 None admin] RBAC: Authorizing `identity:get_user(user_id=4fd025350800438b87cf48a72b7afa5c)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:32.179335 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f07a0-bcbf-40fc-bd13-037eaf4faa40 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:32.181183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 127/264] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:31 2022] GET /identity/v3/users/4fd025350800438b87cf48a72b7afa5c => generated 283 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:32.186642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f07a0-bcbf-40fc-bd13-037eaf4faa40 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:32.232141 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73781d43-2e59-4295-88e2-bfe807a7b5ae None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:32.264128 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccafa0-8d8c-4f81-baa4-1076e210f4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:32.264128 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccafa0-8d8c-4f81-baa4-1076e210f4eb None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:32.264128 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccafa0-8d8c-4f81-baa4-1076e210f4eb None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:32.264466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccafa0-8d8c-4f81-baa4-1076e210f4eb None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:32.265329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccafa0-8d8c-4f81-baa4-1076e210f4eb None admin] RBAC: Authorizing `identity:get_project(project_id=e415362e3ec14b99be6122313166eaaa)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:32.267293 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccafa0-8d8c-4f81-baa4-1076e210f4eb None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:32.269266 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 138/265] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:32 2022] GET /identity/v3/projects/e415362e3ec14b99be6122313166eaaa => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:32.275269 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccafa0-8d8c-4f81-baa4-1076e210f4eb None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:32.314066 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:32.387529 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f07a0-bcbf-40fc-bd13-037eaf4faa40 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:32.447456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093f5fa-9bcc-4c78-b0fc-896c33630925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:32.448101 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093f5fa-9bcc-4c78-b0fc-896c33630925 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:32.448386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093f5fa-9bcc-4c78-b0fc-896c33630925 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:32.448655 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093f5fa-9bcc-4c78-b0fc-896c33630925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:32.482891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccafa0-8d8c-4f81-baa4-1076e210f4eb None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:32.492327 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:32.562082 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628c15b-79c3-4b58-9486-82dc653c4136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:32.564156 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628c15b-79c3-4b58-9486-82dc653c4136 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:32.564439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628c15b-79c3-4b58-9486-82dc653c4136 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:32.566112 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628c15b-79c3-4b58-9486-82dc653c4136 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:32.566856 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628c15b-79c3-4b58-9486-82dc653c4136 None admin] RBAC: Adding query filter params (role.id=be620fc7968740269d233c5ace94a563, scope.project.id=e415362e3ec14b99be6122313166eaaa, user.id=4fd025350800438b87cf48a72b7afa5c) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:32.567165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628c15b-79c3-4b58-9486-82dc653c4136 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:32.568669 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628c15b-79c3-4b58-9486-82dc653c4136 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:32.579477 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093f5fa-9bcc-4c78-b0fc-896c33630925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:32.580972 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093f5fa-9bcc-4c78-b0fc-896c33630925 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:32.584754 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 139/266] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:42:32 2022] GET /identity/v3/role_assignments?user.id=4fd025350800438b87cf48a72b7afa5c&scope.project.id=e415362e3ec14b99be6122313166eaaa&role.id=be620fc7968740269d233c5ace94a563 => generated 608 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:32.740836 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 128/267] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 20:42:32.747141 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628c15b-79c3-4b58-9486-82dc653c4136 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:32.848512 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:32.875923 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628c15b-79c3-4b58-9486-82dc653c4136 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:32.931476 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cabf3a-9619-44cf-8750-cd0c0ebe6c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:32.932559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cabf3a-9619-44cf-8750-cd0c0ebe6c2c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:32.933043 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cabf3a-9619-44cf-8750-cd0c0ebe6c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:32.933525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cabf3a-9619-44cf-8750-cd0c0ebe6c2c None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:32.935708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cabf3a-9619-44cf-8750-cd0c0ebe6c2c None admin] RBAC: Authorizing `identity:get_project(project_id=e415362e3ec14b99be6122313166eaaa)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:32.937995 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cabf3a-9619-44cf-8750-cd0c0ebe6c2c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:32.940023 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 140/268] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:32 2022] GET /identity/v3/projects/e415362e3ec14b99be6122313166eaaa => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:32.945977 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093f5fa-9bcc-4c78-b0fc-896c33630925 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:33.009445 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:33.015205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648e7bd-a46e-44b0-a1d9-c053f2019f9c None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:33.016448 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648e7bd-a46e-44b0-a1d9-c053f2019f9c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:33.016989 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2648e7bd-a46e-44b0-a1d9-c053f2019f9c None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:33.018563 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 141/269] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:33.029735 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f63d9-9553-4f89-8d70-6ca573e009f0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:33.030331 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f63d9-9553-4f89-8d70-6ca573e009f0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:33.030816 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f63d9-9553-4f89-8d70-6ca573e009f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:33.053867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-cc7f63d9-9553-4f89-8d70-6ca573e009f0 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:33.055437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cc7f63d9-9553-4f89-8d70-6ca573e009f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:33.107012 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093f5fa-9bcc-4c78-b0fc-896c33630925 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:33.139799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 142/270] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:42:33.169612 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06682739-760e-47cd-88b2-da83afa49802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:33.170414 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06682739-760e-47cd-88b2-da83afa49802 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:33.170797 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06682739-760e-47cd-88b2-da83afa49802 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:33.171178 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06682739-760e-47cd-88b2-da83afa49802 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:33.172023 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06682739-760e-47cd-88b2-da83afa49802 None admin] RBAC: Adding query filter params (role.id=d9c09fde9a114c2fa299455f8298db09, scope.project.id=e415362e3ec14b99be6122313166eaaa, user.id=4fd025350800438b87cf48a72b7afa5c) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:33.172344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06682739-760e-47cd-88b2-da83afa49802 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:33.173807 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06682739-760e-47cd-88b2-da83afa49802 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:33.183308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 129/271] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:42:32 2022] GET /identity/v3/role_assignments?user.id=4fd025350800438b87cf48a72b7afa5c&scope.project.id=e415362e3ec14b99be6122313166eaaa&role.id=d9c09fde9a114c2fa299455f8298db09 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:33.466582 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f63d9-9553-4f89-8d70-6ca573e009f0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:33.510429 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c080b-a732-47b9-bff6-0094e53e870a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:33.510754 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c080b-a732-47b9-bff6-0094e53e870a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:33.510980 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c080b-a732-47b9-bff6-0094e53e870a None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:33.512632 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 130/272] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:33.519330 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac082c2f-e3df-4b26-af2b-bdc4b20d4e56 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:33.519623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac082c2f-e3df-4b26-af2b-bdc4b20d4e56 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:33.519898 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac082c2f-e3df-4b26-af2b-bdc4b20d4e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:33.555141 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ac082c2f-e3df-4b26-af2b-bdc4b20d4e56 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:33.556534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ac082c2f-e3df-4b26-af2b-bdc4b20d4e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:33.576870 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:33.605000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f63d9-9553-4f89-8d70-6ca573e009f0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:33.655913 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf34bd-ac4e-4e85-a552-a53383b6d361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:33.657150 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf34bd-ac4e-4e85-a552-a53383b6d361 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:33.657633 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf34bd-ac4e-4e85-a552-a53383b6d361 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:33.658103 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf34bd-ac4e-4e85-a552-a53383b6d361 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:33.659475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf34bd-ac4e-4e85-a552-a53383b6d361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:33.659919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 131/273] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:42:33.661521 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf34bd-ac4e-4e85-a552-a53383b6d361 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:33.663315 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 143/274] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:42:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:33.668980 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac082c2f-e3df-4b26-af2b-bdc4b20d4e56 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:33.727953 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:33.796407 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac082c2f-e3df-4b26-af2b-bdc4b20d4e56 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:33.823699 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed86aa-422f-40a9-9bac-72881af8ada8 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:33.824047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed86aa-422f-40a9-9bac-72881af8ada8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:33.824283 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed86aa-422f-40a9-9bac-72881af8ada8 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:33.826504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 144/275] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:33.835256 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d4c74-716d-4712-8cfc-bc0ec202d942 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:33.835256 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d4c74-716d-4712-8cfc-bc0ec202d942 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:33.835256 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d4c74-716d-4712-8cfc-bc0ec202d942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:33.841415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c33b5-551f-4baa-b1ef-ec4a3ddf6733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:33.841743 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c33b5-551f-4baa-b1ef-ec4a3ddf6733 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:33.842022 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c33b5-551f-4baa-b1ef-ec4a3ddf6733 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:33.842293 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c33b5-551f-4baa-b1ef-ec4a3ddf6733 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:33.842942 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c33b5-551f-4baa-b1ef-ec4a3ddf6733 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:33.845055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c33b5-551f-4baa-b1ef-ec4a3ddf6733 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:33.854910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-950d4c74-716d-4712-8cfc-bc0ec202d942 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:33.856422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-950d4c74-716d-4712-8cfc-bc0ec202d942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:33.876071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 132/276] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Sep 9 20:42:33 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:42:33.933800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 145/277] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:42:33.991116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c33b5-551f-4baa-b1ef-ec4a3ddf6733 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:34.101195 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:34.104790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c33b5-551f-4baa-b1ef-ec4a3ddf6733 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:34.143375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6077ae-28bf-4ca8-a06a-a6aa4774e920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:34.144102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6077ae-28bf-4ca8-a06a-a6aa4774e920 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:34.144322 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6077ae-28bf-4ca8-a06a-a6aa4774e920 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:34.144595 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6077ae-28bf-4ca8-a06a-a6aa4774e920 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:34.155818 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6077ae-28bf-4ca8-a06a-a6aa4774e920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:34.162145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6d6077ae-28bf-4ca8-a06a-a6aa4774e920 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:34.162145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:34.162145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:34.162145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:34.162145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:34.162145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:34.162145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:34.162145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:34.162145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:34.162145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:34.162145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:34.162145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:34.162145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:34.162145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:34.162145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:34.162145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:34.163025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:34.163025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:34.163025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:34.163025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:34.163025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:34.163025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:34.163025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:34.163025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:34.163025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:34.163025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:34.163025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:34.163025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:34.163025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:34.163025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:34.163025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:34.163025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:34.163800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:34.163800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:34.163800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:34.163800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:34.163800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:34.163800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:34.163800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:34.163800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:34.163800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:34.163800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:34.163800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:34.163800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:34.163800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 133/278] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:34.169510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d4c74-716d-4712-8cfc-bc0ec202d942 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:34.221176 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6077ae-28bf-4ca8-a06a-a6aa4774e920 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:34.287566 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:34.315634 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950d4c74-716d-4712-8cfc-bc0ec202d942 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:34.356567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654c6b9-dbfd-4e22-9ac7-b8bdc36d5c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:34.357217 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654c6b9-dbfd-4e22-9ac7-b8bdc36d5c2b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:34.357499 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654c6b9-dbfd-4e22-9ac7-b8bdc36d5c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:34.357772 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654c6b9-dbfd-4e22-9ac7-b8bdc36d5c2b None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:34.358440 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654c6b9-dbfd-4e22-9ac7-b8bdc36d5c2b None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:34.358750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654c6b9-dbfd-4e22-9ac7-b8bdc36d5c2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:34.361086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654c6b9-dbfd-4e22-9ac7-b8bdc36d5c2b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:34.364284 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6077ae-28bf-4ca8-a06a-a6aa4774e920 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:34.370385 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 146/279] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:34.371636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422e2ff-79d6-4216-9cbd-382152b43a5f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:34.372269 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422e2ff-79d6-4216-9cbd-382152b43a5f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:34.372375 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422e2ff-79d6-4216-9cbd-382152b43a5f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:34.373802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 147/280] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:34.378210 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422e2ff-79d6-4216-9cbd-382152b43a5f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:34.404879 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6f478a-404b-4de7-894a-24bc01cfd6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:34.405574 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f478a-404b-4de7-894a-24bc01cfd6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:34.406610 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f478a-404b-4de7-894a-24bc01cfd6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:34.406995 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6f478a-404b-4de7-894a-24bc01cfd6b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:34.420578 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6f478a-404b-4de7-894a-24bc01cfd6b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:34.426499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7e6f478a-404b-4de7-894a-24bc01cfd6b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 20:42:34.426499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:34.426499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:34.426499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:34.426499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:34.426499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:34.426499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:34.426499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:34.426499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:34.426499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:34.426499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:34.426499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:34.426499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:34.426499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:34.426499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:34.426499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:34.427353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:34.427353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:34.427353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:34.427353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:34.427353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:34.427353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:34.427353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:34.427353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:34.427353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:34.427353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:34.427353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:34.427353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:34.427353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:34.427353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:34.427353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:34.427353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:34.428179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:34.428179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:34.428179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:34.428179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:34.428179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:34.428179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:34.428179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:34.428179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:34.428179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:34.428179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:34.428179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 20:42:34.428179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:34.428179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 134/281] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:42:34.429271 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d236df7-1aea-46d5-ae34-bbb9f04fb630 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:34.429424 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d236df7-1aea-46d5-ae34-bbb9f04fb630 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:34.430664 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d236df7-1aea-46d5-ae34-bbb9f04fb630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:34.448799 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2d236df7-1aea-46d5-ae34-bbb9f04fb630 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:34.450014 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2d236df7-1aea-46d5-ae34-bbb9f04fb630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:34.468102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:34.500856 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422e2ff-79d6-4216-9cbd-382152b43a5f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:34.543422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a51c5b-a9bc-49c0-a447-4ce6d0417e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:34.543892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 135/282] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:34.544713 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a51c5b-a9bc-49c0-a447-4ce6d0417e56 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:34.544816 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d236df7-1aea-46d5-ae34-bbb9f04fb630 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:34.545271 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a51c5b-a9bc-49c0-a447-4ce6d0417e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:34.545735 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a51c5b-a9bc-49c0-a447-4ce6d0417e56 None admin] PATH_INFO: `/v3/users/deca921134ad47f8a467fb8c2a40390e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:34.571850 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:34.576553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a51c5b-a9bc-49c0-a447-4ce6d0417e56 None admin] RBAC: Authorizing `identity:get_user(user_id=deca921134ad47f8a467fb8c2a40390e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:34.578357 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a51c5b-a9bc-49c0-a447-4ce6d0417e56 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:34.583571 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 148/283] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:34 2022] GET /identity/v3/users/deca921134ad47f8a467fb8c2a40390e => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:34.596061 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a51c5b-a9bc-49c0-a447-4ce6d0417e56 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:34.757199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d236df7-1aea-46d5-ae34-bbb9f04fb630 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:34.774208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a51c5b-a9bc-49c0-a447-4ce6d0417e56 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:34.800476 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faedea-d2e7-4545-b193-4b78ab7b42f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:34.801596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faedea-d2e7-4545-b193-4b78ab7b42f5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:34.802022 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faedea-d2e7-4545-b193-4b78ab7b42f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:34.802623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faedea-d2e7-4545-b193-4b78ab7b42f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:34.803432 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19faedea-d2e7-4545-b193-4b78ab7b42f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:34.803883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19faedea-d2e7-4545-b193-4b78ab7b42f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:34.805850 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19faedea-d2e7-4545-b193-4b78ab7b42f5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:34.815413 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 136/284] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:34.822731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faedea-d2e7-4545-b193-4b78ab7b42f5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:34.836753 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2c786-5ff4-40d4-ab95-b919a67efb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:34.837362 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2c786-5ff4-40d4-ab95-b919a67efb96 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:34.837637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2c786-5ff4-40d4-ab95-b919a67efb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:34.837904 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2c786-5ff4-40d4-ab95-b919a67efb96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:34.838633 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2c786-5ff4-40d4-ab95-b919a67efb96 None admin] RBAC: Adding query filter params (role.id=c726a7153e6e47a3aa35a96221eb3d78, user.id=deca921134ad47f8a467fb8c2a40390e, scope.system=all) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:34.838938 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2c786-5ff4-40d4-ab95-b919a67efb96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:34.840411 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2c786-5ff4-40d4-ab95-b919a67efb96 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:34.852138 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 149/285] 10.222.0.15 () {56 vars in 1308 bytes} [Fri Sep 9 20:42:34 2022] GET /identity/v3/role_assignments?user.id=deca921134ad47f8a467fb8c2a40390e&scope.system=all&role.id=c726a7153e6e47a3aa35a96221eb3d78 => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:34.862465 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:34.863012 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2c786-5ff4-40d4-ab95-b919a67efb96 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:34.945589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:34.989546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2c786-5ff4-40d4-ab95-b919a67efb96 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:35.028739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9caa0d-6d34-4fb7-8c9a-6bf4b0354111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:35.029308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9caa0d-6d34-4fb7-8c9a-6bf4b0354111 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:35.029587 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9caa0d-6d34-4fb7-8c9a-6bf4b0354111 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:35.029861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9caa0d-6d34-4fb7-8c9a-6bf4b0354111 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:35.042018 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9caa0d-6d34-4fb7-8c9a-6bf4b0354111 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:35.047274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-7c9caa0d-6d34-4fb7-8c9a-6bf4b0354111 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:35.047274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:35.047274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:35.047274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:35.047274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:35.047274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:35.047274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:35.047274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:35.047274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:35.047274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:35.047274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:35.047274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:35.047274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:35.047274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:35.047274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:35.047274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:35.048295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:35.048295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:35.048295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:35.048295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:35.048295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:35.048295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:35.048295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:35.048295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:35.048295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:35.048295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:35.048295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:35.048295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:35.048295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:35.048295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:35.048295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:35.048295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:35.049094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:35.049094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:35.049094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:35.049094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:35.049094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:35.049094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:35.049094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:35.049094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:35.049094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:35.049094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:35.049094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:35.049094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:35.050420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 150/286] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:35.054787 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faedea-d2e7-4545-b193-4b78ab7b42f5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:35.065745 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9caa0d-6d34-4fb7-8c9a-6bf4b0354111 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:35.157951 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8fc90-3c08-4687-ad62-252b79eb11c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:35.158613 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8fc90-3c08-4687-ad62-252b79eb11c4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:35.158891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8fc90-3c08-4687-ad62-252b79eb11c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:35.159160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8fc90-3c08-4687-ad62-252b79eb11c4 None admin] PATH_INFO: `/v3/users/5d3fd9ca09d942cf9b0538bc73cfb275` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:35.164748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8fc90-3c08-4687-ad62-252b79eb11c4 None admin] RBAC: Authorizing `identity:get_user(user_id=5d3fd9ca09d942cf9b0538bc73cfb275)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:35.166238 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8fc90-3c08-4687-ad62-252b79eb11c4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:35.168224 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 137/287] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:34 2022] GET /identity/v3/users/5d3fd9ca09d942cf9b0538bc73cfb275 => generated 297 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:35.174606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8fc90-3c08-4687-ad62-252b79eb11c4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:35.187487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9caa0d-6d34-4fb7-8c9a-6bf4b0354111 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:35.212608 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:35.228555 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5600038-ec35-4c4e-b2e5-9f6d4317bfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:35.229687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5600038-ec35-4c4e-b2e5-9f6d4317bfd0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:35.230944 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5600038-ec35-4c4e-b2e5-9f6d4317bfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:35.232089 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5600038-ec35-4c4e-b2e5-9f6d4317bfd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:35.232964 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5600038-ec35-4c4e-b2e5-9f6d4317bfd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:35.233638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5600038-ec35-4c4e-b2e5-9f6d4317bfd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:35.236243 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5600038-ec35-4c4e-b2e5-9f6d4317bfd0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:35.255265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 151/288] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:35.262897 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5600038-ec35-4c4e-b2e5-9f6d4317bfd0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:35.326209 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:35.349985 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8fc90-3c08-4687-ad62-252b79eb11c4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:35.386902 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185bb37-9dc0-4cc7-9570-f09463c548d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:35.387540 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185bb37-9dc0-4cc7-9570-f09463c548d9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:35.387818 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185bb37-9dc0-4cc7-9570-f09463c548d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:35.388116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185bb37-9dc0-4cc7-9570-f09463c548d9 None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:35.389345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185bb37-9dc0-4cc7-9570-f09463c548d9 None admin] RBAC: Authorizing `identity:get_project(project_id=e415362e3ec14b99be6122313166eaaa)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:35.390941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185bb37-9dc0-4cc7-9570-f09463c548d9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:35.392772 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 138/289] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:35 2022] GET /identity/v3/projects/e415362e3ec14b99be6122313166eaaa => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:35.398200 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185bb37-9dc0-4cc7-9570-f09463c548d9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:35.478182 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5600038-ec35-4c4e-b2e5-9f6d4317bfd0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:35.536226 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefab7f0-485d-4dcc-a3e3-6be58fac5e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:35.536876 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefab7f0-485d-4dcc-a3e3-6be58fac5e70 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:35.537158 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefab7f0-485d-4dcc-a3e3-6be58fac5e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:35.537438 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefab7f0-485d-4dcc-a3e3-6be58fac5e70 None admin] PATH_INFO: `/v3/users/4b94289e59de40e1abb5b227bd7df51f` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:35.539613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefab7f0-485d-4dcc-a3e3-6be58fac5e70 None admin] RBAC: Authorizing `identity:get_user(user_id=4b94289e59de40e1abb5b227bd7df51f)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:35.541109 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefab7f0-485d-4dcc-a3e3-6be58fac5e70 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:35.544574 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 152/290] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:35 2022] GET /identity/v3/users/4b94289e59de40e1abb5b227bd7df51f => generated 297 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:35.549739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefab7f0-485d-4dcc-a3e3-6be58fac5e70 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:35.563618 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185bb37-9dc0-4cc7-9570-f09463c548d9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:35.629676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddddbfa-6747-4103-8a27-e834c34ac5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:35.630346 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddddbfa-6747-4103-8a27-e834c34ac5e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:35.630625 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddddbfa-6747-4103-8a27-e834c34ac5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:35.630900 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddddbfa-6747-4103-8a27-e834c34ac5e7 None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa/users/5d3fd9ca09d942cf9b0538bc73cfb275/roles/b02b3a3726d145cf941be8e260928951` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:35.633238 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddddbfa-6747-4103-8a27-e834c34ac5e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e415362e3ec14b99be6122313166eaaa, user_id=5d3fd9ca09d942cf9b0538bc73cfb275, role_id=b02b3a3726d145cf941be8e260928951)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:35.636705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddddbfa-6747-4103-8a27-e834c34ac5e7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:35.647597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:35.658291 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 139/291] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:42:35 2022] PUT /identity/v3/projects/e415362e3ec14b99be6122313166eaaa/users/5d3fd9ca09d942cf9b0538bc73cfb275/roles/b02b3a3726d145cf941be8e260928951 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:42:35.705816 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefab7f0-485d-4dcc-a3e3-6be58fac5e70 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:35.741783 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672188f-ae73-4551-9ba7-6214f7d63d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:35.742404 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672188f-ae73-4551-9ba7-6214f7d63d93 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:35.742686 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672188f-ae73-4551-9ba7-6214f7d63d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:35.742962 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672188f-ae73-4551-9ba7-6214f7d63d93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:35.832441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672188f-ae73-4551-9ba7-6214f7d63d93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:35.833852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672188f-ae73-4551-9ba7-6214f7d63d93 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:35.907730 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:35.975393 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 153/292] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:35.980906 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddddbfa-6747-4103-8a27-e834c34ac5e7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:36.006398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:36.111262 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddddbfa-6747-4103-8a27-e834c34ac5e7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:36.156772 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417dc8e2-74f5-448b-b9a9-05bab368b0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:36.157550 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dc8e2-74f5-448b-b9a9-05bab368b0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:36.157841 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dc8e2-74f5-448b-b9a9-05bab368b0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:36.158119 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dc8e2-74f5-448b-b9a9-05bab368b0a5 None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:36.159390 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417dc8e2-74f5-448b-b9a9-05bab368b0a5 None admin] RBAC: Authorizing `identity:get_project(project_id=e415362e3ec14b99be6122313166eaaa)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:36.160878 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417dc8e2-74f5-448b-b9a9-05bab368b0a5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:36.162838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 140/293] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:35 2022] GET /identity/v3/projects/e415362e3ec14b99be6122313166eaaa => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:36.168426 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672188f-ae73-4551-9ba7-6214f7d63d93 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:36.328220 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672188f-ae73-4551-9ba7-6214f7d63d93 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:36.382595 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72943001-73d4-4c35-8b74-050c4229f030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:36.383529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72943001-73d4-4c35-8b74-050c4229f030 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:36.384036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72943001-73d4-4c35-8b74-050c4229f030 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:36.384509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72943001-73d4-4c35-8b74-050c4229f030 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:36.385470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72943001-73d4-4c35-8b74-050c4229f030 None admin] RBAC: Adding query filter params (role.id=c726a7153e6e47a3aa35a96221eb3d78, scope.project.id=e415362e3ec14b99be6122313166eaaa, user.id=4b94289e59de40e1abb5b227bd7df51f) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:36.385976 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72943001-73d4-4c35-8b74-050c4229f030 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:36.387620 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72943001-73d4-4c35-8b74-050c4229f030 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:36.396453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 154/294] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:42:36 2022] GET /identity/v3/role_assignments?user.id=4b94289e59de40e1abb5b227bd7df51f&scope.project.id=e415362e3ec14b99be6122313166eaaa&role.id=c726a7153e6e47a3aa35a96221eb3d78 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:36.582802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af7be6-e55b-438b-8f5d-69504b55ad53 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:36.583198 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af7be6-e55b-438b-8f5d-69504b55ad53 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:36.583380 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af7be6-e55b-438b-8f5d-69504b55ad53 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:36.585057 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 141/295] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:36.590974 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe606abc-cd78-4f36-b347-a1ba750d251d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:36.591595 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe606abc-cd78-4f36-b347-a1ba750d251d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:36.592127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe606abc-cd78-4f36-b347-a1ba750d251d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:36.625679 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fe606abc-cd78-4f36-b347-a1ba750d251d None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:36.627267 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fe606abc-cd78-4f36-b347-a1ba750d251d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:36.645618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:36.699966 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1948b-0062-41b8-ba3c-4d6d6fe5bb17 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:36.700310 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1948b-0062-41b8-ba3c-4d6d6fe5bb17 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:36.700545 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1948b-0062-41b8-ba3c-4d6d6fe5bb17 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:36.701876 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 142/296] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:42:36.709601 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c074c8-a950-4eb3-9148-2c7bfc69131a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:36.709883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c074c8-a950-4eb3-9148-2c7bfc69131a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:36.710167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c074c8-a950-4eb3-9148-2c7bfc69131a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:36.718775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 155/297] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:42:36.730658 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-53c074c8-a950-4eb3-9148-2c7bfc69131a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:36.731862 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-53c074c8-a950-4eb3-9148-2c7bfc69131a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:36.811046 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 143/298] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:42:37.018282 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe606abc-cd78-4f36-b347-a1ba750d251d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:37.114867 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c074c8-a950-4eb3-9148-2c7bfc69131a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:37.125895 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:37.131969 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe606abc-cd78-4f36-b347-a1ba750d251d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:37.171482 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25efcb-d8da-4ce2-bf92-95c6ba1b5692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:37.173428 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25efcb-d8da-4ce2-bf92-95c6ba1b5692 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:37.173911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25efcb-d8da-4ce2-bf92-95c6ba1b5692 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:37.174404 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25efcb-d8da-4ce2-bf92-95c6ba1b5692 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:37.185926 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25efcb-d8da-4ce2-bf92-95c6ba1b5692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:37.192308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-3b25efcb-d8da-4ce2-bf92-95c6ba1b5692 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 20:42:37.192308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:37.192308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:37.192308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:37.192308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:37.192308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:37.192308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:37.192308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:37.192308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:37.192308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:37.192308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:37.192308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:37.192308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:37.192308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:37.192308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:37.192308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:37.193177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:37.193177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:37.193177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:37.193177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:37.193177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:37.193177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:37.193177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:37.193177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:37.193177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:37.193177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:37.193177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:37.193177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:37.193177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:37.193177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:37.193177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:37.193177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:37.193948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:37.193948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:37.193948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:37.193948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:37.193948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:37.193948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:37.193948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:37.193948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:37.193948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:37.193948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:37.193948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 20:42:37.193948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:37.196709 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 156/299] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:37.202697 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25efcb-d8da-4ce2-bf92-95c6ba1b5692 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:37.215726 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:37.249106 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c074c8-a950-4eb3-9148-2c7bfc69131a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:37.303108 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9176f34-0362-4009-bc86-66419e98681a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:37.304246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9176f34-0362-4009-bc86-66419e98681a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:37.304246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9176f34-0362-4009-bc86-66419e98681a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:37.306272 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9176f34-0362-4009-bc86-66419e98681a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:37.306976 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9176f34-0362-4009-bc86-66419e98681a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:37.308694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9176f34-0362-4009-bc86-66419e98681a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:37.312067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 144/300] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:42:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:37.316625 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9176f34-0362-4009-bc86-66419e98681a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:37.336722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25efcb-d8da-4ce2-bf92-95c6ba1b5692 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:37.385736 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e5710-4962-4f47-b0b1-4954f4aebad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:37.386635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e5710-4962-4f47-b0b1-4954f4aebad2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:37.387115 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e5710-4962-4f47-b0b1-4954f4aebad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:37.388120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e5710-4962-4f47-b0b1-4954f4aebad2 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:37.388971 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e5710-4962-4f47-b0b1-4954f4aebad2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:37.389700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e5710-4962-4f47-b0b1-4954f4aebad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:37.392113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227e5710-4962-4f47-b0b1-4954f4aebad2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:37.403844 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 157/301] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:37.409512 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e5710-4962-4f47-b0b1-4954f4aebad2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:37.419752 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:37.450619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9176f34-0362-4009-bc86-66419e98681a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:37.487662 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:37.491799 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4b6b1-4517-4407-a092-9b78865945b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:37.492735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4b6b1-4517-4407-a092-9b78865945b1 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:37.493866 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4b6b1-4517-4407-a092-9b78865945b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:37.494340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4b6b1-4517-4407-a092-9b78865945b1 None admin] PATH_INFO: `/v3/groups` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:37.495164 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4b6b1-4517-4407-a092-9b78865945b1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:37.496828 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4b6b1-4517-4407-a092-9b78865945b1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:37.524695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 145/302] 10.222.0.15 () {60 vars in 1134 bytes} [Fri Sep 9 20:42:37 2022] POST /identity/v3/groups => generated 229 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:42:37.540270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e5710-4962-4f47-b0b1-4954f4aebad2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:37.555075 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33f848-12ee-43bf-acb0-fc8b8b1193d5 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:37.555370 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33f848-12ee-43bf-acb0-fc8b8b1193d5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:37.555801 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d33f848-12ee-43bf-acb0-fc8b8b1193d5 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:37.557551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 146/303] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:42:37.565014 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896766c-ab5b-431f-beea-6912619e075d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:37.565473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896766c-ab5b-431f-beea-6912619e075d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:37.566009 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896766c-ab5b-431f-beea-6912619e075d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:37.585462 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790ce35-2637-45d8-a5cb-47acfe353889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:37.586400 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790ce35-2637-45d8-a5cb-47acfe353889 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:37.586824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790ce35-2637-45d8-a5cb-47acfe353889 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:37.587230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790ce35-2637-45d8-a5cb-47acfe353889 None admin] PATH_INFO: `/v3/users/2d73f32d7792483d92731d09be95bd17` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:37.588625 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a896766c-ab5b-431f-beea-6912619e075d None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:37.590136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a896766c-ab5b-431f-beea-6912619e075d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:37.603540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790ce35-2637-45d8-a5cb-47acfe353889 None admin] RBAC: Authorizing `identity:get_user(user_id=2d73f32d7792483d92731d09be95bd17)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:37.605290 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790ce35-2637-45d8-a5cb-47acfe353889 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:37.607333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 158/304] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:37 2022] GET /identity/v3/users/2d73f32d7792483d92731d09be95bd17 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:37.615034 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790ce35-2637-45d8-a5cb-47acfe353889 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:37.674243 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 147/305] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:42:37.736159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790ce35-2637-45d8-a5cb-47acfe353889 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:37.764012 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:37.773391 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb93dc-2f33-4633-bd41-c9f366faa27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:37.774296 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb93dc-2f33-4633-bd41-c9f366faa27e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:37.774776 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb93dc-2f33-4633-bd41-c9f366faa27e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:37.775512 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb93dc-2f33-4633-bd41-c9f366faa27e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:37.776508 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb93dc-2f33-4633-bd41-c9f366faa27e None admin] RBAC: Adding query filter params (role.id=b02b3a3726d145cf941be8e260928951, user.id=2d73f32d7792483d92731d09be95bd17, scope.system=all) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:37.777040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb93dc-2f33-4633-bd41-c9f366faa27e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:37.778712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb93dc-2f33-4633-bd41-c9f366faa27e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:37.784838 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 159/306] 10.222.0.15 () {56 vars in 1308 bytes} [Fri Sep 9 20:42:37 2022] GET /identity/v3/role_assignments?user.id=2d73f32d7792483d92731d09be95bd17&scope.system=all&role.id=b02b3a3726d145cf941be8e260928951 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:37.949828 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896766c-ab5b-431f-beea-6912619e075d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:38.014127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:38.054287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a896766c-ab5b-431f-beea-6912619e075d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:38.090694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baee882-6f86-4f79-96d3-f3a9429fd3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:38.091333 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baee882-6f86-4f79-96d3-f3a9429fd3bb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:38.091607 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baee882-6f86-4f79-96d3-f3a9429fd3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:38.091873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baee882-6f86-4f79-96d3-f3a9429fd3bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:38.102379 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baee882-6f86-4f79-96d3-f3a9429fd3bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:38.107159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6baee882-6f86-4f79-96d3-f3a9429fd3bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:38.107159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:38.107159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:38.107159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:38.107159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:38.107159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:38.107159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:38.107159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:38.107159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:38.107159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:38.107159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:38.107159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:38.107159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:38.107159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:38.107159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:38.107159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:38.108056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:38.108056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:38.108056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:38.108056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:38.108056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:38.108056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:38.108056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:38.108056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:38.108056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:38.108056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:38.108056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:38.108056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:38.108056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:38.108056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:38.108056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:38.108056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:38.108831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:38.108831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:38.108831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:38.108831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:38.108831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:38.108831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:38.108831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:38.108831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:38.108831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:38.108831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:38.108831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:38.108831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:38.108831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 148/307] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:38.114357 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb93dc-2f33-4633-bd41-c9f366faa27e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:38.228473 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb93dc-2f33-4633-bd41-c9f366faa27e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:38.263930 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5ee01-e4f1-4f73-b746-254d497b544f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:38.264573 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5ee01-e4f1-4f73-b746-254d497b544f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:38.264855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5ee01-e4f1-4f73-b746-254d497b544f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:38.265123 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5ee01-e4f1-4f73-b746-254d497b544f None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:38.266331 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5ee01-e4f1-4f73-b746-254d497b544f None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:38.266823 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5ee01-e4f1-4f73-b746-254d497b544f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:38.268213 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5ee01-e4f1-4f73-b746-254d497b544f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:38.277156 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 160/308] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:38.283300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5ee01-e4f1-4f73-b746-254d497b544f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:38.283768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029052b-5f8c-47a4-bba9-a596e3cac031 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:38.284217 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029052b-5f8c-47a4-bba9-a596e3cac031 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:38.284351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029052b-5f8c-47a4-bba9-a596e3cac031 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:38.285677 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 149/309] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:38.291234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ddab7-0d6a-4655-bf7f-1abf58a486f5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:38.291610 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ddab7-0d6a-4655-bf7f-1abf58a486f5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:38.291944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ddab7-0d6a-4655-bf7f-1abf58a486f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:38.316919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-431ddab7-0d6a-4655-bf7f-1abf58a486f5 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:38.318587 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-431ddab7-0d6a-4655-bf7f-1abf58a486f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:38.345273 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:38.395414 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 150/310] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:42:38.403524 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5ee01-e4f1-4f73-b746-254d497b544f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:38.435643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebb7d3-0a98-4f47-93a2-690826f9b370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:38.436313 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebb7d3-0a98-4f47-93a2-690826f9b370 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:38.436593 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebb7d3-0a98-4f47-93a2-690826f9b370 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:38.436867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eebb7d3-0a98-4f47-93a2-690826f9b370 None admin] PATH_INFO: `/v3/users/deca921134ad47f8a467fb8c2a40390e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:38.438031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebb7d3-0a98-4f47-93a2-690826f9b370 None admin] RBAC: Authorizing `identity:get_user(user_id=deca921134ad47f8a467fb8c2a40390e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:38.439469 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eebb7d3-0a98-4f47-93a2-690826f9b370 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:38.441152 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 161/311] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:38 2022] GET /identity/v3/users/deca921134ad47f8a467fb8c2a40390e => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:38.446789 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ddab7-0d6a-4655-bf7f-1abf58a486f5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:38.506000 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:38.555149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ddab7-0d6a-4655-bf7f-1abf58a486f5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:38.590236 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63445d84-a5c1-4e42-8121-8e57256d62bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:38.590896 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63445d84-a5c1-4e42-8121-8e57256d62bf None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:38.591176 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63445d84-a5c1-4e42-8121-8e57256d62bf None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:38.591451 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63445d84-a5c1-4e42-8121-8e57256d62bf None admin] PATH_INFO: `/v3/system/users/deca921134ad47f8a467fb8c2a40390e/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:38.592909 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63445d84-a5c1-4e42-8121-8e57256d62bf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=deca921134ad47f8a467fb8c2a40390e, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:38.594525 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63445d84-a5c1-4e42-8121-8e57256d62bf None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:38.606103 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 151/312] 10.222.0.15 () {58 vars in 1334 bytes} [Fri Sep 9 20:42:38 2022] PUT /identity/v3/system/users/deca921134ad47f8a467fb8c2a40390e/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:42:38.679582 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebb7d3-0a98-4f47-93a2-690826f9b370 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:38.800842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eebb7d3-0a98-4f47-93a2-690826f9b370 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:38.824624 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:38.842123 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcf592-5495-44fd-a571-a22992438b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:38.843060 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcf592-5495-44fd-a571-a22992438b93 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:38.844329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcf592-5495-44fd-a571-a22992438b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:38.844807 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcf592-5495-44fd-a571-a22992438b93 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:38.855492 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dcf592-5495-44fd-a571-a22992438b93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:38.862029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-54dcf592-5495-44fd-a571-a22992438b93 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 20:42:38.862029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:38.862029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:38.862029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:38.862029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:38.862029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:38.862029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:38.862029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:38.862029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:38.862029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:38.862029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:38.862029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:38.862029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:38.862029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:38.862029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:38.862029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:38.862911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:38.862911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:38.862911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:38.862911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:38.862911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:38.862911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:38.862911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:38.862911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:38.862911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:38.862911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:38.862911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:38.862911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:38.862911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:38.862911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:38.862911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:38.862911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:38.863681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:38.863681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:38.863681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:38.863681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:38.863681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:38.863681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:38.863681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:38.863681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:38.863681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:38.863681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:38.863681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 20:42:38.863681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:38.866346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 162/313] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:38.872314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63445d84-a5c1-4e42-8121-8e57256d62bf None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:38.985501 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63445d84-a5c1-4e42-8121-8e57256d62bf None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:39.004388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:39.023182 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34d797-7d55-4d95-8712-5d3929d74e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:39.023789 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34d797-7d55-4d95-8712-5d3929d74e59 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:39.024091 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34d797-7d55-4d95-8712-5d3929d74e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:39.024366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34d797-7d55-4d95-8712-5d3929d74e59 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:39.025020 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34d797-7d55-4d95-8712-5d3929d74e59 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:39.025584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34d797-7d55-4d95-8712-5d3929d74e59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:39.026955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34d797-7d55-4d95-8712-5d3929d74e59 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:39.036271 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 152/314] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:39.041827 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcf592-5495-44fd-a571-a22992438b93 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:39.159827 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcf592-5495-44fd-a571-a22992438b93 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:39.195251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f67a7-9005-4740-9bbd-de4c4674bcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:39.195874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f67a7-9005-4740-9bbd-de4c4674bcc3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:39.196208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f67a7-9005-4740-9bbd-de4c4674bcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:39.196478 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f67a7-9005-4740-9bbd-de4c4674bcc3 None admin] PATH_INFO: `/v3/users/5d3fd9ca09d942cf9b0538bc73cfb275` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:39.197840 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f67a7-9005-4740-9bbd-de4c4674bcc3 None admin] RBAC: Authorizing `identity:get_user(user_id=5d3fd9ca09d942cf9b0538bc73cfb275)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:39.199324 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f67a7-9005-4740-9bbd-de4c4674bcc3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:39.201263 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 163/315] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:39 2022] GET /identity/v3/users/5d3fd9ca09d942cf9b0538bc73cfb275 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:39.207734 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34d797-7d55-4d95-8712-5d3929d74e59 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:39.329292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34d797-7d55-4d95-8712-5d3929d74e59 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:39.368741 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a754e-5c33-4e35-8a6f-f37eda059bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:39.369716 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a754e-5c33-4e35-8a6f-f37eda059bcf None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:39.370217 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a754e-5c33-4e35-8a6f-f37eda059bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:39.370688 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a754e-5c33-4e35-8a6f-f37eda059bcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:39.426082 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:39.448951 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a754e-5c33-4e35-8a6f-f37eda059bcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:39.450739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a754e-5c33-4e35-8a6f-f37eda059bcf None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:39.561955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 153/316] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:39.567957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f67a7-9005-4740-9bbd-de4c4674bcc3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:39.617896 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:39.675626 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f67a7-9005-4740-9bbd-de4c4674bcc3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:39.712670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16867a9-cf0e-4daf-bf12-02f175893b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:39.713217 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16867a9-cf0e-4daf-bf12-02f175893b73 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:39.713493 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16867a9-cf0e-4daf-bf12-02f175893b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:39.713764 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16867a9-cf0e-4daf-bf12-02f175893b73 None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:39.714885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16867a9-cf0e-4daf-bf12-02f175893b73 None admin] RBAC: Authorizing `identity:get_project(project_id=e415362e3ec14b99be6122313166eaaa)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:39.716362 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16867a9-cf0e-4daf-bf12-02f175893b73 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:39.718318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 164/317] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:39 2022] GET /identity/v3/projects/e415362e3ec14b99be6122313166eaaa => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:39.724072 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a754e-5c33-4e35-8a6f-f37eda059bcf None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:39.815628 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:39.836766 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a754e-5c33-4e35-8a6f-f37eda059bcf None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:39.873172 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da996a98-537f-44d3-97f6-c6ec9697a26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:39.873784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da996a98-537f-44d3-97f6-c6ec9697a26e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:39.874068 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da996a98-537f-44d3-97f6-c6ec9697a26e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:39.874340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da996a98-537f-44d3-97f6-c6ec9697a26e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:39.875310 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da996a98-537f-44d3-97f6-c6ec9697a26e None admin] RBAC: Adding query filter params (role.id=b02b3a3726d145cf941be8e260928951, scope.project.id=e415362e3ec14b99be6122313166eaaa, user.id=5d3fd9ca09d942cf9b0538bc73cfb275) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:39.875620 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da996a98-537f-44d3-97f6-c6ec9697a26e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:39.877104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da996a98-537f-44d3-97f6-c6ec9697a26e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:39.883242 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 154/318] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:42:39 2022] GET /identity/v3/role_assignments?user.id=5d3fd9ca09d942cf9b0538bc73cfb275&scope.project.id=e415362e3ec14b99be6122313166eaaa&role.id=b02b3a3726d145cf941be8e260928951 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:39.916486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39efcaa-8789-4eee-98e5-321c0630ad67 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:39.916998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39efcaa-8789-4eee-98e5-321c0630ad67 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:39.917070 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39efcaa-8789-4eee-98e5-321c0630ad67 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:39.918757 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 165/319] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:39.925449 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf2105-9c1a-460d-8b96-1068338b1119 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:39.925747 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf2105-9c1a-460d-8b96-1068338b1119 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:39.926006 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf2105-9c1a-460d-8b96-1068338b1119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:39.949986 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-23bf2105-9c1a-460d-8b96-1068338b1119 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:39.951249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-23bf2105-9c1a-460d-8b96-1068338b1119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:40.034029 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 155/320] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:40.093722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30892f-134d-4a40-99cb-65ab516f01ef None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:40.094037 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30892f-134d-4a40-99cb-65ab516f01ef None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:40.094270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30892f-134d-4a40-99cb-65ab516f01ef None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:40.095743 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 166/321] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:40.101201 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66571486-8f15-42cc-b03b-20d36f983707 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:40.101749 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66571486-8f15-42cc-b03b-20d36f983707 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:40.102240 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66571486-8f15-42cc-b03b-20d36f983707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:40.121704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-66571486-8f15-42cc-b03b-20d36f983707 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:40.122902 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-66571486-8f15-42cc-b03b-20d36f983707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:40.197080 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 156/322] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:40.307975 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30892f-134d-4a40-99cb-65ab516f01ef None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:40.410735 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30892f-134d-4a40-99cb-65ab516f01ef None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:40.427339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:40.447192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5c8a0-765f-4078-b19d-763bee02e403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:40.448099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5c8a0-765f-4078-b19d-763bee02e403 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:40.448528 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5c8a0-765f-4078-b19d-763bee02e403 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:40.448948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5c8a0-765f-4078-b19d-763bee02e403 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:40.450199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5c8a0-765f-4078-b19d-763bee02e403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:40.451776 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba5c8a0-765f-4078-b19d-763bee02e403 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:40.454151 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 167/323] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:42:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:40.459303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66571486-8f15-42cc-b03b-20d36f983707 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:40.463952 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:40.471444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5c8a0-765f-4078-b19d-763bee02e403 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:40.572301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66571486-8f15-42cc-b03b-20d36f983707 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:40.577124 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5c8a0-765f-4078-b19d-763bee02e403 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:40.607393 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55da36-fb8c-4c05-a65e-f50846dd57b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:40.608019 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55da36-fb8c-4c05-a65e-f50846dd57b6 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:40.608303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55da36-fb8c-4c05-a65e-f50846dd57b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:40.608579 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55da36-fb8c-4c05-a65e-f50846dd57b6 None admin] PATH_INFO: `/v3/groups` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:40.609856 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55da36-fb8c-4c05-a65e-f50846dd57b6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:40.611305 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55da36-fb8c-4c05-a65e-f50846dd57b6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:40.611592 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c9f5d-6dbe-4f1a-8a19-cde875b27405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:40.612251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c9f5d-6dbe-4f1a-8a19-cde875b27405 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:40.612535 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c9f5d-6dbe-4f1a-8a19-cde875b27405 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:40.612808 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c9f5d-6dbe-4f1a-8a19-cde875b27405 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:40.626934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c9f5d-6dbe-4f1a-8a19-cde875b27405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:40.628850 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 157/324] 10.222.0.15 () {60 vars in 1134 bytes} [Fri Sep 9 20:42:40 2022] POST /identity/v3/groups => generated 226 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:42:40.632299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-905c9f5d-6dbe-4f1a-8a19-cde875b27405 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 20:42:40.632299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:40.632299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:40.632299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:40.632299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:40.632299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:40.632299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:40.632299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:40.632299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:40.632299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:40.632299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:40.632299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:40.632299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:40.632299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:40.632299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:40.632299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:40.633212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:40.633212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:40.633212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:40.633212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:40.633212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:40.633212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:40.633212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:40.633212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:40.633212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:40.633212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:40.633212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:40.633212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:40.633212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:40.633212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:40.633212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:40.633212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:40.634014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:40.634014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:40.634014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:40.634014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:40.634014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:40.634014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:40.634014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:40.634014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:40.634014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:40.634014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:40.634014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 20:42:40.634014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:40.638537 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 168/325] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:40.639746 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55da36-fb8c-4c05-a65e-f50846dd57b6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:40.712129 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:40.758522 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55da36-fb8c-4c05-a65e-f50846dd57b6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:40.798165 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd43950-e47a-4720-be6f-38543d5b96e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:40.798808 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd43950-e47a-4720-be6f-38543d5b96e4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:40.799088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd43950-e47a-4720-be6f-38543d5b96e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:40.799356 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd43950-e47a-4720-be6f-38543d5b96e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:40.800072 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd43950-e47a-4720-be6f-38543d5b96e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:40.800379 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd43950-e47a-4720-be6f-38543d5b96e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:40.801901 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd43950-e47a-4720-be6f-38543d5b96e4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:40.813618 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 158/326] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:40.818907 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c9f5d-6dbe-4f1a-8a19-cde875b27405 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:40.872492 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:40.908917 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22992f-df08-4ab2-b5b2-6f843ad8e1b6 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:40.909233 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22992f-df08-4ab2-b5b2-6f843ad8e1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:40.911260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22992f-df08-4ab2-b5b2-6f843ad8e1b6 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:40.911260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 159/327] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:42:40.917433 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcd086-3df5-419f-be45-16f82ad42e33 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:40.917714 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcd086-3df5-419f-be45-16f82ad42e33 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:40.917988 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efcd086-3df5-419f-be45-16f82ad42e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:40.935433 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c9f5d-6dbe-4f1a-8a19-cde875b27405 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:40.942238 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7efcd086-3df5-419f-be45-16f82ad42e33 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:40.943461 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7efcd086-3df5-419f-be45-16f82ad42e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:40.979610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508eb6c-ca40-406e-8e30-00d07c783180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:40.980299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508eb6c-ca40-406e-8e30-00d07c783180 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:40.980577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508eb6c-ca40-406e-8e30-00d07c783180 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:40.980852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508eb6c-ca40-406e-8e30-00d07c783180 None admin] PATH_INFO: `/v3/users/2d73f32d7792483d92731d09be95bd17` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:40.982622 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508eb6c-ca40-406e-8e30-00d07c783180 None admin] RBAC: Authorizing `identity:get_user(user_id=2d73f32d7792483d92731d09be95bd17)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:40.985001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508eb6c-ca40-406e-8e30-00d07c783180 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:40.986593 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 169/328] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:40 2022] GET /identity/v3/users/2d73f32d7792483d92731d09be95bd17 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:40.992265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508eb6c-ca40-406e-8e30-00d07c783180 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:41.037982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 160/329] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:42:41.107448 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508eb6c-ca40-406e-8e30-00d07c783180 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:41.121512 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:41.147024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14826cb6-cb9c-4cae-8ea8-843581ef1647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:41.147608 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14826cb6-cb9c-4cae-8ea8-843581ef1647 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:41.147883 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14826cb6-cb9c-4cae-8ea8-843581ef1647 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:41.148189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14826cb6-cb9c-4cae-8ea8-843581ef1647 None admin] PATH_INFO: `/v3/system/users/2d73f32d7792483d92731d09be95bd17/roles/b02b3a3726d145cf941be8e260928951` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:41.149653 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14826cb6-cb9c-4cae-8ea8-843581ef1647 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2d73f32d7792483d92731d09be95bd17, role_id=b02b3a3726d145cf941be8e260928951)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:41.151349 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14826cb6-cb9c-4cae-8ea8-843581ef1647 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:41.162492 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 170/330] 10.222.0.15 () {58 vars in 1334 bytes} [Fri Sep 9 20:42:40 2022] PUT /identity/v3/system/users/2d73f32d7792483d92731d09be95bd17/roles/b02b3a3726d145cf941be8e260928951 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:42:41.322367 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcd086-3df5-419f-be45-16f82ad42e33 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:41.388570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:41.440724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efcd086-3df5-419f-be45-16f82ad42e33 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:41.488501 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50eec7-1b4a-4618-abfa-7c428eb84988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:41.489838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50eec7-1b4a-4618-abfa-7c428eb84988 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:41.490258 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50eec7-1b4a-4618-abfa-7c428eb84988 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:41.490668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50eec7-1b4a-4618-abfa-7c428eb84988 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:41.503892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50eec7-1b4a-4618-abfa-7c428eb84988 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:41.509055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-3d50eec7-1b4a-4618-abfa-7c428eb84988 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:41.509055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:41.509055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:41.509055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:41.509055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:41.509055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:41.509055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:41.509055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:41.509055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:41.509055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:41.509055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:41.509055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:41.509055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:41.509055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:41.509055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:41.509055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:41.510104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:41.510104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:41.510104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:41.510104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:41.510104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:41.510104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:41.510104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:41.510104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:41.510104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:41.510104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:41.510104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:41.510104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:41.510104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:41.510104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:41.510104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:41.510104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:41.511090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:41.511090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:41.511090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:41.511090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:41.511090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:41.511090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:41.511090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:41.511090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:41.511090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:41.511090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:41.511090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:41.511090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:41.513340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 161/331] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:41.520023 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14826cb6-cb9c-4cae-8ea8-843581ef1647 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:41.641829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14826cb6-cb9c-4cae-8ea8-843581ef1647 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:41.679757 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ce5d6-64d2-4200-a244-0043eca7773b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:41.680406 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ce5d6-64d2-4200-a244-0043eca7773b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:41.680680 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ce5d6-64d2-4200-a244-0043eca7773b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:41.680954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ce5d6-64d2-4200-a244-0043eca7773b None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:41.681624 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ce5d6-64d2-4200-a244-0043eca7773b None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:41.681922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ce5d6-64d2-4200-a244-0043eca7773b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:41.683301 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ce5d6-64d2-4200-a244-0043eca7773b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:41.694686 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 171/332] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:41.700221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50eec7-1b4a-4618-abfa-7c428eb84988 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:41.844451 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50eec7-1b4a-4618-abfa-7c428eb84988 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:41.864820 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:41.886764 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f907dc-483b-4fc1-9068-af2ca7546b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:41.887880 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f907dc-483b-4fc1-9068-af2ca7546b1d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:41.888431 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f907dc-483b-4fc1-9068-af2ca7546b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:41.888901 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f907dc-483b-4fc1-9068-af2ca7546b1d None admin] PATH_INFO: `/v3/users/deca921134ad47f8a467fb8c2a40390e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:41.891387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f907dc-483b-4fc1-9068-af2ca7546b1d None admin] RBAC: Authorizing `identity:get_user(user_id=deca921134ad47f8a467fb8c2a40390e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:41.893578 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f907dc-483b-4fc1-9068-af2ca7546b1d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:41.895805 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 162/333] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:41 2022] GET /identity/v3/users/deca921134ad47f8a467fb8c2a40390e => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:41.901569 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ce5d6-64d2-4200-a244-0043eca7773b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:41.949559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:42.025926 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ce5d6-64d2-4200-a244-0043eca7773b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:42.067049 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc4c87-a454-4304-8266-7aa15da4e39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:42.067664 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc4c87-a454-4304-8266-7aa15da4e39b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:42.067947 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc4c87-a454-4304-8266-7aa15da4e39b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:42.068258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc4c87-a454-4304-8266-7aa15da4e39b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:42.068987 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc4c87-a454-4304-8266-7aa15da4e39b None admin] RBAC: Adding query filter params (role.id=c726a7153e6e47a3aa35a96221eb3d78, user.id=deca921134ad47f8a467fb8c2a40390e, scope.system=all) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:42.069296 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc4c87-a454-4304-8266-7aa15da4e39b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:42.070746 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc4c87-a454-4304-8266-7aa15da4e39b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:42.085521 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 172/334] 10.222.0.15 () {56 vars in 1308 bytes} [Fri Sep 9 20:42:41 2022] GET /identity/v3/role_assignments?user.id=deca921134ad47f8a467fb8c2a40390e&scope.system=all&role.id=c726a7153e6e47a3aa35a96221eb3d78 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:43.325768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293099da-36af-40b3-a056-e6e708b1662d None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:43.326290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293099da-36af-40b3-a056-e6e708b1662d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:43.326544 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293099da-36af-40b3-a056-e6e708b1662d None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:43.328872 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 163/335] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:43.334054 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10faea6b-3f26-4b83-bcfa-415be490167f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:43.334460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10faea6b-3f26-4b83-bcfa-415be490167f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:43.334595 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10faea6b-3f26-4b83-bcfa-415be490167f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:43.357454 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-10faea6b-3f26-4b83-bcfa-415be490167f None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:43.358703 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-10faea6b-3f26-4b83-bcfa-415be490167f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:43.436391 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 173/336] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:43.577564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2a70a-49b1-48c5-a082-338eab93fe59 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:43.578301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2a70a-49b1-48c5-a082-338eab93fe59 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:43.578599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2a70a-49b1-48c5-a082-338eab93fe59 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:43.580206 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 164/337] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:43.585972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab01731-80c7-4617-9b05-4bbec731abac None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:43.586253 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab01731-80c7-4617-9b05-4bbec731abac None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:43.586524 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab01731-80c7-4617-9b05-4bbec731abac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:43.610269 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5ab01731-80c7-4617-9b05-4bbec731abac None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:43.611479 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5ab01731-80c7-4617-9b05-4bbec731abac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:43.647050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:43.701431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 174/338] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:42:43.839120 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2a70a-49b1-48c5-a082-338eab93fe59 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:43.975812 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2a70a-49b1-48c5-a082-338eab93fe59 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:44.011817 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4d579-3ca5-4559-a21a-924a08041a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:44.012505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4d579-3ca5-4559-a21a-924a08041a2d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:44.012789 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4d579-3ca5-4559-a21a-924a08041a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:44.013064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4d579-3ca5-4559-a21a-924a08041a2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:44.029689 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4d579-3ca5-4559-a21a-924a08041a2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:44.035302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-70f4d579-3ca5-4559-a21a-924a08041a2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:44.035302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:44.035302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:44.035302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:44.035302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:44.035302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:44.035302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:44.035302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:44.035302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:44.035302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:44.035302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:44.035302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:44.035302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:44.035302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:44.035302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:44.035302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:44.036207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:44.036207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:44.036207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:44.036207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:44.036207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:44.036207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:44.036207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:44.036207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:44.036207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:44.036207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:44.036207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:44.036207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:44.036207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:44.036207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:44.036207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:44.036207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:44.037002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:44.037002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:44.037002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:44.037002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:44.037002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:44.037002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:44.037002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:44.037002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:44.037002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:44.037002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:44.037002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:44.037002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:44.037587 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 165/339] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:44.042471 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab01731-80c7-4617-9b05-4bbec731abac None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:44.161643 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4d579-3ca5-4559-a21a-924a08041a2d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:44.162625 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab01731-80c7-4617-9b05-4bbec731abac None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:44.218628 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c14eb-4d3b-4437-80c0-b9cc9b7c1814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:44.219252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c14eb-4d3b-4437-80c0-b9cc9b7c1814 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:44.219535 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c14eb-4d3b-4437-80c0-b9cc9b7c1814 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:44.219811 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c14eb-4d3b-4437-80c0-b9cc9b7c1814 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:44.220520 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c14eb-4d3b-4437-80c0-b9cc9b7c1814 None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:44.220833 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c14eb-4d3b-4437-80c0-b9cc9b7c1814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:44.222212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c14eb-4d3b-4437-80c0-b9cc9b7c1814 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:44.238484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 175/340] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:44.244205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c14eb-4d3b-4437-80c0-b9cc9b7c1814 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:44.248342 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:44.286329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:44.354328 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4d579-3ca5-4559-a21a-924a08041a2d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:44.411211 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd54d9-2601-4010-b7d4-620c058dff0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:44.411977 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd54d9-2601-4010-b7d4-620c058dff0f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:44.412230 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd54d9-2601-4010-b7d4-620c058dff0f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:44.412503 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd54d9-2601-4010-b7d4-620c058dff0f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:44.424169 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd54d9-2601-4010-b7d4-620c058dff0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:44.433303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c14eb-4d3b-4437-80c0-b9cc9b7c1814 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:44.435244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-46dd54d9-2601-4010-b7d4-620c058dff0f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:44.435244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:44.435244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:44.435244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:44.435244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:44.435244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:44.435244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:44.435244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:44.435244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:44.435244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:44.435244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:44.435244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:44.435244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:44.435244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:44.435244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:44.435244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:44.436111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:44.436111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:44.436111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:44.436111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:44.436111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:44.436111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:44.436111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:44.436111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:44.436111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:44.436111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:44.436111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:44.436111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:44.436111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:44.436111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:44.436111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:44.436111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:44.436893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:44.436893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:44.436893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:44.436893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:44.436893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:44.436893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:44.436893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:44.436893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:44.436893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:44.436893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:44.436893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:44.436893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:44.436893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 166/341] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:42:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:42:44.444560 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd54d9-2601-4010-b7d4-620c058dff0f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:44.500420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28cecf-2693-4466-8277-29c8951a971e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:44.501575 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28cecf-2693-4466-8277-29c8951a971e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:44.502080 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28cecf-2693-4466-8277-29c8951a971e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:44.502546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28cecf-2693-4466-8277-29c8951a971e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:44.605627 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28cecf-2693-4466-8277-29c8951a971e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:44.607102 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28cecf-2693-4466-8277-29c8951a971e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:44.626817 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:44.639943 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd54d9-2601-4010-b7d4-620c058dff0f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:44.645286 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:44.715755 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b520675a-d573-465e-adf2-a1a351a626d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:44.716738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520675a-d573-465e-adf2-a1a351a626d4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:44.717244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520675a-d573-465e-adf2-a1a351a626d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:44.717727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b520675a-d573-465e-adf2-a1a351a626d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:44.719185 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520675a-d573-465e-adf2-a1a351a626d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:44.719681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520675a-d573-465e-adf2-a1a351a626d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:44.720387 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 176/342] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 20:42:44.721505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b520675a-d573-465e-adf2-a1a351a626d4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:44.721694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7c52f-b37b-40e1-8677-cd4103347050 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:44.721944 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7c52f-b37b-40e1-8677-cd4103347050 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:44.722219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7c52f-b37b-40e1-8677-cd4103347050 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:44.723462 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 177/343] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:44.728913 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7c52f-b37b-40e1-8677-cd4103347050 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:44.737682 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 167/344] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:42:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:44.743937 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30301f3-e75c-4e8d-9b24-9caa586d7359 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:44.744509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30301f3-e75c-4e8d-9b24-9caa586d7359 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:44.744976 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30301f3-e75c-4e8d-9b24-9caa586d7359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:44.779925 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c30301f3-e75c-4e8d-9b24-9caa586d7359 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:44.781715 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c30301f3-e75c-4e8d-9b24-9caa586d7359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:44.889751 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7c52f-b37b-40e1-8677-cd4103347050 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:44.891578 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 168/345] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:42:44.892495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30301f3-e75c-4e8d-9b24-9caa586d7359 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:44.919831 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:44.951958 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ca9ba-a8d8-40f2-b320-07600b5762a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:44.953251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ca9ba-a8d8-40f2-b320-07600b5762a1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:44.953497 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ca9ba-a8d8-40f2-b320-07600b5762a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:44.953750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ca9ba-a8d8-40f2-b320-07600b5762a1 None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:44.958406 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ca9ba-a8d8-40f2-b320-07600b5762a1 None admin] RBAC: Authorizing `identity:get_project(project_id=3518388fd55847e99d38040fb3c91ac5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:44.959927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ca9ba-a8d8-40f2-b320-07600b5762a1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:44.961974 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 178/346] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:44 2022] GET /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:44.967421 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ca9ba-a8d8-40f2-b320-07600b5762a1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:45.028099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:45.038129 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30301f3-e75c-4e8d-9b24-9caa586d7359 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:45.088516 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ca9ba-a8d8-40f2-b320-07600b5762a1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:45.100503 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad3a22-a596-42e8-9dde-dea8a503c230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:45.101124 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad3a22-a596-42e8-9dde-dea8a503c230 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:45.101405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad3a22-a596-42e8-9dde-dea8a503c230 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:45.101677 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad3a22-a596-42e8-9dde-dea8a503c230 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:45.134815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4ac4d-0c3c-403c-8d2d-612c079ee559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:45.135464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4ac4d-0c3c-403c-8d2d-612c079ee559 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:45.135744 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4ac4d-0c3c-403c-8d2d-612c079ee559 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:45.136043 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4ac4d-0c3c-403c-8d2d-612c079ee559 None admin] PATH_INFO: `/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:45.153271 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4ac4d-0c3c-403c-8d2d-612c079ee559 None admin] RBAC: Authorizing `identity:get_group(group_id=56f2cd5979dd4d80ba84d3e8189f7601)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:45.154739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d4ac4d-0c3c-403c-8d2d-612c079ee559 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:45.160903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 179/347] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Sep 9 20:42:44 2022] GET /identity/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:45.166232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4ac4d-0c3c-403c-8d2d-612c079ee559 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:45.239955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad3a22-a596-42e8-9dde-dea8a503c230 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:45.243626 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad3a22-a596-42e8-9dde-dea8a503c230 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:45.281995 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:45.382992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:45.386751 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d4ac4d-0c3c-403c-8d2d-612c079ee559 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:45.397749 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 169/348] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:45.399083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e8905-daa7-4539-9ff4-dbfe6d080419 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:45.399369 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e8905-daa7-4539-9ff4-dbfe6d080419 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:45.399644 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e8905-daa7-4539-9ff4-dbfe6d080419 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:45.404025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 170/349] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:45.404025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f1bb5-bc4a-488a-a4ce-cd4b787f2eca None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:45.404025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f1bb5-bc4a-488a-a4ce-cd4b787f2eca None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:45.404025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f1bb5-bc4a-488a-a4ce-cd4b787f2eca None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:45.404302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 171/350] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:45.404917 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f1bb5-bc4a-488a-a4ce-cd4b787f2eca None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:45.437322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc93e0-4d6e-42b1-995b-45660ccc13a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:45.438933 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc93e0-4d6e-42b1-995b-45660ccc13a1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:45.439679 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc93e0-4d6e-42b1-995b-45660ccc13a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:45.440189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc93e0-4d6e-42b1-995b-45660ccc13a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:45.441145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc93e0-4d6e-42b1-995b-45660ccc13a1 None admin] RBAC: Adding query filter params (group.id=56f2cd5979dd4d80ba84d3e8189f7601, role.id=c726a7153e6e47a3aa35a96221eb3d78, scope.project.id=3518388fd55847e99d38040fb3c91ac5) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:45.442368 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc93e0-4d6e-42b1-995b-45660ccc13a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:45.442897 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc93e0-4d6e-42b1-995b-45660ccc13a1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:45.450198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 180/351] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Sep 9 20:42:45 2022] GET /identity/v3/role_assignments?group.id=56f2cd5979dd4d80ba84d3e8189f7601&scope.project.id=3518388fd55847e99d38040fb3c91ac5&role.id=c726a7153e6e47a3aa35a96221eb3d78 => generated 260 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:45.451406 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87618cff-3203-493e-9938-562b3864b71b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:45.451689 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87618cff-3203-493e-9938-562b3864b71b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:45.451958 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87618cff-3203-493e-9938-562b3864b71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:45.475919 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-87618cff-3203-493e-9938-562b3864b71b None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:45.477687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-87618cff-3203-493e-9938-562b3864b71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:45.548368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498f1bb5-bc4a-488a-a4ce-cd4b787f2eca None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:45.562698 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 181/352] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:45.563845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87618cff-3203-493e-9938-562b3864b71b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:45.592026 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b329cd-f9e1-4590-864d-fca586042713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:45.593031 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b329cd-f9e1-4590-864d-fca586042713 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:45.594370 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b329cd-f9e1-4590-864d-fca586042713 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:45.595037 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b329cd-f9e1-4590-864d-fca586042713 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:45.607351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b329cd-f9e1-4590-864d-fca586042713 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:45.613770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-35b329cd-f9e1-4590-864d-fca586042713 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 20:42:45.613770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:45.613770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:45.613770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:45.613770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:45.613770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:45.613770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:45.613770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:45.613770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:45.613770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:45.613770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:45.613770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:45.613770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:45.613770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:45.613770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:45.613770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:45.614652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:45.614652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:45.614652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:45.614652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:45.614652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:45.614652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:45.614652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:45.614652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:45.614652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:45.614652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:45.614652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:45.614652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:45.614652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:45.614652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:45.614652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:45.614652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:45.615464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:45.615464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:45.615464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:45.615464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:45.615464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:45.615464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:45.615464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:45.615464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:45.615464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:45.615464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:45.615464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 09 20:42:45.615464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:45.617096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:45.618824 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 172/353] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:45.620498 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfb52c-c163-4f94-89ac-61eec394335f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:45.621083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfb52c-c163-4f94-89ac-61eec394335f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:45.621645 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acfb52c-c163-4f94-89ac-61eec394335f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:45.648534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7acfb52c-c163-4f94-89ac-61eec394335f None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:45.649749 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7acfb52c-c163-4f94-89ac-61eec394335f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:45.721933 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87618cff-3203-493e-9938-562b3864b71b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:45.726940 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:45.757316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 173/354] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:45.758518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfb52c-c163-4f94-89ac-61eec394335f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:45.788968 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fde82-9364-4681-bc27-4df1a44e42e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:45.789611 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fde82-9364-4681-bc27-4df1a44e42e4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:45.789889 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fde82-9364-4681-bc27-4df1a44e42e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:45.790153 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fde82-9364-4681-bc27-4df1a44e42e4 None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:45.791915 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845fde82-9364-4681-bc27-4df1a44e42e4 None admin] RBAC: Authorizing `identity:get_project(project_id=3518388fd55847e99d38040fb3c91ac5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:45.792961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845fde82-9364-4681-bc27-4df1a44e42e4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:45.794662 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 182/355] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:45 2022] GET /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:45.801841 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fde82-9364-4681-bc27-4df1a44e42e4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:45.910687 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acfb52c-c163-4f94-89ac-61eec394335f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:45.979960 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd3c8a-b517-4ade-b811-206716bfc2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:45.980610 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd3c8a-b517-4ade-b811-206716bfc2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:45.980884 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd3c8a-b517-4ade-b811-206716bfc2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:45.981151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd3c8a-b517-4ade-b811-206716bfc2e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:45.981817 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd3c8a-b517-4ade-b811-206716bfc2e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:45.982118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd3c8a-b517-4ade-b811-206716bfc2e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:45.983511 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd3c8a-b517-4ade-b811-206716bfc2e4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:45.989171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fde82-9364-4681-bc27-4df1a44e42e4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:46.006034 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 174/356] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:46.007061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd3c8a-b517-4ade-b811-206716bfc2e4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:46.013131 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:46.052837 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59365ad0-3547-4df2-946d-2696fcb70707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:46.053399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59365ad0-3547-4df2-946d-2696fcb70707 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:46.053671 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59365ad0-3547-4df2-946d-2696fcb70707 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:46.053937 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59365ad0-3547-4df2-946d-2696fcb70707 None admin] PATH_INFO: `/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:46.055130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59365ad0-3547-4df2-946d-2696fcb70707 None admin] RBAC: Authorizing `identity:get_group(group_id=56f2cd5979dd4d80ba84d3e8189f7601)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:46.057634 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59365ad0-3547-4df2-946d-2696fcb70707 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:46.066110 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 183/357] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Sep 9 20:42:45 2022] GET /identity/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601 => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:46.067824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59365ad0-3547-4df2-946d-2696fcb70707 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:46.110846 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:46.190109 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd3c8a-b517-4ade-b811-206716bfc2e4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:46.230130 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a3768-a34e-45c6-a5c9-b90908a079ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:46.230789 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a3768-a34e-45c6-a5c9-b90908a079ba None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:46.231072 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a3768-a34e-45c6-a5c9-b90908a079ba None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:46.231373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a3768-a34e-45c6-a5c9-b90908a079ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:46.247355 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3a3768-a34e-45c6-a5c9-b90908a079ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:46.250857 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59365ad0-3547-4df2-946d-2696fcb70707 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:46.254697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-bc3a3768-a34e-45c6-a5c9-b90908a079ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:46.254697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:46.254697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:46.254697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:46.254697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:46.254697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:46.254697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:46.254697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:46.254697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:46.254697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:46.254697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:46.254697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:46.254697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:46.254697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:46.254697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:46.254697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:46.255580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:46.255580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:46.255580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:46.255580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:46.255580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:46.255580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:46.255580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:46.255580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:46.255580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:46.255580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:46.255580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:46.255580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:46.255580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:46.255580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:46.255580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:46.255580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:46.256806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:46.256806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:46.256806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:46.256806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:46.256806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:46.256806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:46.256806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:46.256806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:46.256806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:46.256806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:46.256806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:46.256806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:46.256806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 175/358] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:42:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:46.257730 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a3768-a34e-45c6-a5c9-b90908a079ba None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:46.295748 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789abc5-ef61-4277-b58a-0e49aef16708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:46.296836 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789abc5-ef61-4277-b58a-0e49aef16708 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:46.297331 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789abc5-ef61-4277-b58a-0e49aef16708 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:46.297613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7789abc5-ef61-4277-b58a-0e49aef16708 None admin] PATH_INFO: `/v3/users/2d73f32d7792483d92731d09be95bd17` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:46.298892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789abc5-ef61-4277-b58a-0e49aef16708 None admin] RBAC: Authorizing `identity:get_user(user_id=2d73f32d7792483d92731d09be95bd17)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:46.300860 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7789abc5-ef61-4277-b58a-0e49aef16708 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:46.307748 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 184/359] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:42:46 2022] GET /identity/v3/users/2d73f32d7792483d92731d09be95bd17 => generated 293 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:46.309206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789abc5-ef61-4277-b58a-0e49aef16708 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:46.376567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:46.387400 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a3768-a34e-45c6-a5c9-b90908a079ba None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:46.399351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:46.434179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88766b6-c91c-483a-9e39-5e7263dd94e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:46.435360 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88766b6-c91c-483a-9e39-5e7263dd94e0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:46.435813 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88766b6-c91c-483a-9e39-5e7263dd94e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:46.436274 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88766b6-c91c-483a-9e39-5e7263dd94e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:46.437183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88766b6-c91c-483a-9e39-5e7263dd94e0 None admin] RBAC: Adding query filter params (group.id=56f2cd5979dd4d80ba84d3e8189f7601, role.id=d9c09fde9a114c2fa299455f8298db09, scope.project.id=3518388fd55847e99d38040fb3c91ac5) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:46.437677 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88766b6-c91c-483a-9e39-5e7263dd94e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:46.439317 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88766b6-c91c-483a-9e39-5e7263dd94e0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:46.445669 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 176/360] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Sep 9 20:42:46 2022] GET /identity/v3/role_assignments?group.id=56f2cd5979dd4d80ba84d3e8189f7601&scope.project.id=3518388fd55847e99d38040fb3c91ac5&role.id=d9c09fde9a114c2fa299455f8298db09 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:46.447218 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9387f-1065-4f73-bd46-08ad284eb6fd None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:46.447419 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7789abc5-ef61-4277-b58a-0e49aef16708 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:46.448213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9387f-1065-4f73-bd46-08ad284eb6fd None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:46.449098 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9387f-1065-4f73-bd46-08ad284eb6fd None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:46.451074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 177/361] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:46.452156 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9387f-1065-4f73-bd46-08ad284eb6fd None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:46.501963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25a0aa-eca0-4fea-9b26-0c4f5c893d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:46.502615 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25a0aa-eca0-4fea-9b26-0c4f5c893d6e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:46.502896 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25a0aa-eca0-4fea-9b26-0c4f5c893d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:46.503172 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25a0aa-eca0-4fea-9b26-0c4f5c893d6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:46.519204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25a0aa-eca0-4fea-9b26-0c4f5c893d6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:46.527106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-bb25a0aa-eca0-4fea-9b26-0c4f5c893d6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:46.527106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:46.527106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:46.527106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:46.527106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:46.527106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:46.527106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:46.527106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:46.527106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:46.527106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:46.527106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:46.527106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:46.527106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:46.527106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:46.527106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:46.527106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:46.528374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:46.528374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:46.528374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:46.528374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:46.528374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:46.528374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:46.528374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:46.528374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:46.528374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:46.528374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:46.528374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:46.528374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:46.528374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:46.528374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:46.528374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:46.528374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:46.529171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:46.529171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:46.529171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:46.529171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:46.529171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:46.529171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:46.529171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:46.529171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:46.529171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:46.529171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:46.529171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:46.529171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:46.529786 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 185/362] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:46.530285 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25a0aa-eca0-4fea-9b26-0c4f5c893d6e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:46.606171 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9387f-1065-4f73-bd46-08ad284eb6fd None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:46.649075 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a9e84-98fa-44cb-b6c6-c0041609e6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:46.649647 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a9e84-98fa-44cb-b6c6-c0041609e6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:46.649873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a9e84-98fa-44cb-b6c6-c0041609e6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:46.650405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a9e84-98fa-44cb-b6c6-c0041609e6f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:46.651086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a9e84-98fa-44cb-b6c6-c0041609e6f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:46.651391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a9e84-98fa-44cb-b6c6-c0041609e6f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:46.653780 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a9e84-98fa-44cb-b6c6-c0041609e6f0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:46.667484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 178/363] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:42:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:46.669044 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaa14b-5665-4b79-bde1-74812a67aa80 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:46.669331 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaa14b-5665-4b79-bde1-74812a67aa80 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:46.669606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaa14b-5665-4b79-bde1-74812a67aa80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:46.678083 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25a0aa-eca0-4fea-9b26-0c4f5c893d6e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:46.688797 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-cbeaa14b-5665-4b79-bde1-74812a67aa80 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:46.689611 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:46.690615 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cbeaa14b-5665-4b79-bde1-74812a67aa80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:46.728378 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ff206-a2e5-46dc-a762-f4eb0f2e6902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:46.729024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ff206-a2e5-46dc-a762-f4eb0f2e6902 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:46.729132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:46.729298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ff206-a2e5-46dc-a762-f4eb0f2e6902 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:46.729958 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ff206-a2e5-46dc-a762-f4eb0f2e6902 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:46.730786 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ff206-a2e5-46dc-a762-f4eb0f2e6902 None admin] RBAC: Adding query filter params (role.id=b02b3a3726d145cf941be8e260928951, user.id=2d73f32d7792483d92731d09be95bd17, scope.system=all) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:46.731100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ff206-a2e5-46dc-a762-f4eb0f2e6902 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:46.733918 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ff206-a2e5-46dc-a762-f4eb0f2e6902 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:46.749703 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 186/364] 10.222.0.15 () {56 vars in 1308 bytes} [Fri Sep 9 20:42:46 2022] GET /identity/v3/role_assignments?user.id=2d73f32d7792483d92731d09be95bd17&scope.system=all&role.id=b02b3a3726d145cf941be8e260928951 => generated 510 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:46.751565 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ff206-a2e5-46dc-a762-f4eb0f2e6902 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:46.794831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 179/365] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:46.796042 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeaa14b-5665-4b79-bde1-74812a67aa80 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:46.932391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeaa14b-5665-4b79-bde1-74812a67aa80 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:46.946204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ff206-a2e5-46dc-a762-f4eb0f2e6902 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:46.977452 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067070a4-bc63-4753-a35a-49c80d85d5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:46.978552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067070a4-bc63-4753-a35a-49c80d85d5cf None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:46.979025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067070a4-bc63-4753-a35a-49c80d85d5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:46.979748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067070a4-bc63-4753-a35a-49c80d85d5cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:47.019951 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:47.022285 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19378bb-279f-44d8-8abf-e4f86a29ed69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:47.022970 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19378bb-279f-44d8-8abf-e4f86a29ed69 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:47.023275 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19378bb-279f-44d8-8abf-e4f86a29ed69 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:47.023593 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19378bb-279f-44d8-8abf-e4f86a29ed69 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:47.024459 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19378bb-279f-44d8-8abf-e4f86a29ed69 None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:47.024774 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19378bb-279f-44d8-8abf-e4f86a29ed69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:47.026448 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19378bb-279f-44d8-8abf-e4f86a29ed69 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:47.044648 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 187/366] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:47.049916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19378bb-279f-44d8-8abf-e4f86a29ed69 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:47.109155 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067070a4-bc63-4753-a35a-49c80d85d5cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:47.110839 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067070a4-bc63-4753-a35a-49c80d85d5cf None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:47.113472 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:47.249330 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19378bb-279f-44d8-8abf-e4f86a29ed69 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:47.291213 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40591a0-3fe1-4f5e-a11c-286084350362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:47.291853 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 180/367] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:47.291976 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40591a0-3fe1-4f5e-a11c-286084350362 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:47.292198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40591a0-3fe1-4f5e-a11c-286084350362 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:47.292476 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40591a0-3fe1-4f5e-a11c-286084350362 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:47.292647 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067070a4-bc63-4753-a35a-49c80d85d5cf None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:47.391197 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40591a0-3fe1-4f5e-a11c-286084350362 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:47.391444 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:47.391833 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40591a0-3fe1-4f5e-a11c-286084350362 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:47.426166 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:47.436667 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067070a4-bc63-4753-a35a-49c80d85d5cf None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:47.493280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cf6fe-27cc-46f0-aa1e-2665c5a05ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:47.493955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cf6fe-27cc-46f0-aa1e-2665c5a05ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:47.494238 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cf6fe-27cc-46f0-aa1e-2665c5a05ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:47.494516 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cf6fe-27cc-46f0-aa1e-2665c5a05ff1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:47.509213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2cf6fe-27cc-46f0-aa1e-2665c5a05ff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:47.514773 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 188/368] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:47.515955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ff2cf6fe-27cc-46f0-aa1e-2665c5a05ff1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:42:47.515955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:47.515955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:47.515955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:47.515955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:47.515955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:47.515955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:47.515955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:47.515955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:47.515955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:47.515955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:47.515955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:47.515955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:47.515955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:47.515955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:47.515955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:47.516888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:47.516888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:47.516888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:47.516888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:47.516888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:47.516888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:47.516888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:47.516888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:47.516888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:47.516888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:47.516888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:47.516888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:47.516888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:47.516888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:47.516888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:47.516888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:47.517717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:47.517717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:47.517717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:47.517717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:47.517717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:47.517717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:47.517717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:47.517717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:47.517717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:47.517717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:47.517717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:42:47.517717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:47.523739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40591a0-3fe1-4f5e-a11c-286084350362 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:47.523969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 181/369] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:42:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:47.523969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cf6fe-27cc-46f0-aa1e-2665c5a05ff1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:47.638297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40591a0-3fe1-4f5e-a11c-286084350362 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:47.657589 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2cf6fe-27cc-46f0-aa1e-2665c5a05ff1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:47.669211 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:47.678174 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f9d00-a5bf-40f4-b839-f188aff76b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:47.678734 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f9d00-a5bf-40f4-b839-f188aff76b80 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:47.679013 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f9d00-a5bf-40f4-b839-f188aff76b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:47.679285 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f9d00-a5bf-40f4-b839-f188aff76b80 None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:47.680555 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f9d00-a5bf-40f4-b839-f188aff76b80 None admin] RBAC: Authorizing `identity:get_project(project_id=e415362e3ec14b99be6122313166eaaa)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:47.682061 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f9d00-a5bf-40f4-b839-f188aff76b80 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:47.683981 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 189/370] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:47 2022] GET /identity/v3/projects/e415362e3ec14b99be6122313166eaaa => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:47.684858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f9d00-a5bf-40f4-b839-f188aff76b80 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:47.689427 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:47.716188 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93671c4e-6405-4658-ba3a-3a9d9eb9a9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:47.717116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93671c4e-6405-4658-ba3a-3a9d9eb9a9c4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:47.717555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93671c4e-6405-4658-ba3a-3a9d9eb9a9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:47.718022 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93671c4e-6405-4658-ba3a-3a9d9eb9a9c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:47.719001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93671c4e-6405-4658-ba3a-3a9d9eb9a9c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:47.719461 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93671c4e-6405-4658-ba3a-3a9d9eb9a9c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:47.721042 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93671c4e-6405-4658-ba3a-3a9d9eb9a9c4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:47.735024 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 182/371] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:47.736195 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93671c4e-6405-4658-ba3a-3a9d9eb9a9c4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:47.821130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f9d00-a5bf-40f4-b839-f188aff76b80 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:47.856123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93671c4e-6405-4658-ba3a-3a9d9eb9a9c4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:47.869486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc35fe0-97a0-4f3e-a28f-dbba3e0cda38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:47.870142 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc35fe0-97a0-4f3e-a28f-dbba3e0cda38 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:47.870424 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc35fe0-97a0-4f3e-a28f-dbba3e0cda38 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:47.870699 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc35fe0-97a0-4f3e-a28f-dbba3e0cda38 None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:47.872268 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc35fe0-97a0-4f3e-a28f-dbba3e0cda38 None admin] RBAC: Authorizing `identity:get_project(project_id=e415362e3ec14b99be6122313166eaaa)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:47.874000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc35fe0-97a0-4f3e-a28f-dbba3e0cda38 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:47.876542 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 190/372] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:47 2022] GET /identity/v3/projects/e415362e3ec14b99be6122313166eaaa => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:47.878378 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc35fe0-97a0-4f3e-a28f-dbba3e0cda38 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:47.909999 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f3c6f-1523-41fa-8044-c76ba6787557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:47.910527 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f3c6f-1523-41fa-8044-c76ba6787557 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:47.910813 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f3c6f-1523-41fa-8044-c76ba6787557 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:47.911090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f3c6f-1523-41fa-8044-c76ba6787557 None admin] PATH_INFO: `/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:47.912563 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f3c6f-1523-41fa-8044-c76ba6787557 None admin] RBAC: Authorizing `identity:get_group(group_id=56f2cd5979dd4d80ba84d3e8189f7601)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:47.915019 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f3c6f-1523-41fa-8044-c76ba6787557 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:47.917572 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 183/373] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Sep 9 20:42:47 2022] GET /identity/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:47.918636 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f3c6f-1523-41fa-8044-c76ba6787557 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:47.958296 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:48.005832 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:48.007770 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc35fe0-97a0-4f3e-a28f-dbba3e0cda38 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:48.051968 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d20f4-da77-4ea2-91fa-62130e340deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:48.052630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d20f4-da77-4ea2-91fa-62130e340deb None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:48.052912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d20f4-da77-4ea2-91fa-62130e340deb None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:48.053182 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d20f4-da77-4ea2-91fa-62130e340deb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:48.065927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f3c6f-1523-41fa-8044-c76ba6787557 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:48.112880 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a04cb7-5ba5-4b11-b671-de9dc2203c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:48.113462 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a04cb7-5ba5-4b11-b671-de9dc2203c31 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:48.113748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a04cb7-5ba5-4b11-b671-de9dc2203c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:48.114027 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a04cb7-5ba5-4b11-b671-de9dc2203c31 None admin] PATH_INFO: `/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:48.115160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a04cb7-5ba5-4b11-b671-de9dc2203c31 None admin] RBAC: Authorizing `identity:get_group(group_id=56f2cd5979dd4d80ba84d3e8189f7601)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:48.116759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a04cb7-5ba5-4b11-b671-de9dc2203c31 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:48.121281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 184/374] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Sep 9 20:42:47 2022] GET /identity/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:48.122106 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a04cb7-5ba5-4b11-b671-de9dc2203c31 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:48.139023 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d20f4-da77-4ea2-91fa-62130e340deb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:48.140788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1d20f4-da77-4ea2-91fa-62130e340deb None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:48.225895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:48.262575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a04cb7-5ba5-4b11-b671-de9dc2203c31 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:48.276696 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 191/375] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:48.277554 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d20f4-da77-4ea2-91fa-62130e340deb None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:48.296035 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:48.313010 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c6553-5e53-458a-a53f-794c12ab82f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:48.313773 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c6553-5e53-458a-a53f-794c12ab82f4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:48.314124 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c6553-5e53-458a-a53f-794c12ab82f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:48.314471 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c6553-5e53-458a-a53f-794c12ab82f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:48.315861 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c6553-5e53-458a-a53f-794c12ab82f4 None admin] RBAC: Adding query filter params (group.id=56f2cd5979dd4d80ba84d3e8189f7601, role.id=d9c09fde9a114c2fa299455f8298db09, scope.project.id=e415362e3ec14b99be6122313166eaaa) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:48.316582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c6553-5e53-458a-a53f-794c12ab82f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:48.318135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c6553-5e53-458a-a53f-794c12ab82f4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:48.325242 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 185/376] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Sep 9 20:42:48 2022] GET /identity/v3/role_assignments?group.id=56f2cd5979dd4d80ba84d3e8189f7601&scope.project.id=e415362e3ec14b99be6122313166eaaa&role.id=d9c09fde9a114c2fa299455f8298db09 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:48.325545 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c6553-5e53-458a-a53f-794c12ab82f4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:48.430899 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d20f4-da77-4ea2-91fa-62130e340deb None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:48.467812 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c6553-5e53-458a-a53f-794c12ab82f4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:48.489743 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b1507-1b4c-4463-a28a-bc2608d0bd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:48.490923 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b1507-1b4c-4463-a28a-bc2608d0bd3c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:48.491539 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b1507-1b4c-4463-a28a-bc2608d0bd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:48.492085 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b1507-1b4c-4463-a28a-bc2608d0bd3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:48.493034 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b1507-1b4c-4463-a28a-bc2608d0bd3c None admin] RBAC: Adding query filter params (group.id=56f2cd5979dd4d80ba84d3e8189f7601, role.id=c726a7153e6e47a3aa35a96221eb3d78, scope.project.id=e415362e3ec14b99be6122313166eaaa) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:48.493551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b1507-1b4c-4463-a28a-bc2608d0bd3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:48.495400 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b1507-1b4c-4463-a28a-bc2608d0bd3c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:48.503075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 192/377] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Sep 9 20:42:48 2022] GET /identity/v3/role_assignments?group.id=56f2cd5979dd4d80ba84d3e8189f7601&scope.project.id=e415362e3ec14b99be6122313166eaaa&role.id=c726a7153e6e47a3aa35a96221eb3d78 => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:48.504981 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d293f-28e6-4ca0-acc3-8776c08c5c93 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:48.505499 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d293f-28e6-4ca0-acc3-8776c08c5c93 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:48.505999 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d293f-28e6-4ca0-acc3-8776c08c5c93 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:48.507796 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 193/378] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:48.515934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd188bb-9185-4ca6-84e9-49cd79e24d6f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:48.517137 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd188bb-9185-4ca6-84e9-49cd79e24d6f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:48.517622 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd188bb-9185-4ca6-84e9-49cd79e24d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:48.522425 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0bd03-a72f-4119-9248-d8204179223c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:48.523111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0bd03-a72f-4119-9248-d8204179223c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:48.523392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0bd03-a72f-4119-9248-d8204179223c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:48.523667 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0bd03-a72f-4119-9248-d8204179223c None admin] PATH_INFO: `/v3/projects/36e4c2d50d8d40f5b9937dbb73fb973f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:48.526600 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0bd03-a72f-4119-9248-d8204179223c None admin] RBAC: Authorizing `identity:get_project(project_id=36e4c2d50d8d40f5b9937dbb73fb973f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:48.531262 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0bd03-a72f-4119-9248-d8204179223c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:48.531262 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 186/379] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:48 2022] GET /identity/v3/projects/36e4c2d50d8d40f5b9937dbb73fb973f => generated 344 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:48.536140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0bd03-a72f-4119-9248-d8204179223c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:48.554712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-bdd188bb-9185-4ca6-84e9-49cd79e24d6f None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:48.555939 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bdd188bb-9185-4ca6-84e9-49cd79e24d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:48.614488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:48.616479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:48.691200 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0bd03-a72f-4119-9248-d8204179223c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:48.737029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 194/380] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:42:48.758367 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5151f-caa3-4108-80ed-c2020b47e3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:48.759033 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5151f-caa3-4108-80ed-c2020b47e3b0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:48.759318 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5151f-caa3-4108-80ed-c2020b47e3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:48.759592 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5151f-caa3-4108-80ed-c2020b47e3b0 None admin] PATH_INFO: `/v3/groups/37adaadaaae649529b8eeda3118178c6` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:48.776666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5151f-caa3-4108-80ed-c2020b47e3b0 None admin] RBAC: Authorizing `identity:get_group(group_id=37adaadaaae649529b8eeda3118178c6)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:48.778165 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5151f-caa3-4108-80ed-c2020b47e3b0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:48.780104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 187/381] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Sep 9 20:42:48 2022] GET /identity/v3/groups/37adaadaaae649529b8eeda3118178c6 => generated 229 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:48.786859 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd188bb-9185-4ca6-84e9-49cd79e24d6f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:48.915713 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd188bb-9185-4ca6-84e9-49cd79e24d6f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:48.954528 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4726d54-3da7-4cb5-bd5c-59dd497be473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:48.955066 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4726d54-3da7-4cb5-bd5c-59dd497be473 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:48.955346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4726d54-3da7-4cb5-bd5c-59dd497be473 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:48.955620 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4726d54-3da7-4cb5-bd5c-59dd497be473 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:48.956380 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4726d54-3da7-4cb5-bd5c-59dd497be473 None admin] RBAC: Adding query filter params (group.id=37adaadaaae649529b8eeda3118178c6, role.id=be620fc7968740269d233c5ace94a563, scope.project.id=36e4c2d50d8d40f5b9937dbb73fb973f) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:48.956691 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4726d54-3da7-4cb5-bd5c-59dd497be473 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:48.958127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4726d54-3da7-4cb5-bd5c-59dd497be473 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:48.964662 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 195/382] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Sep 9 20:42:48 2022] GET /identity/v3/role_assignments?group.id=37adaadaaae649529b8eeda3118178c6&scope.project.id=36e4c2d50d8d40f5b9937dbb73fb973f&role.id=be620fc7968740269d233c5ace94a563 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:49.031716 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5151f-caa3-4108-80ed-c2020b47e3b0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:49.198494 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5151f-caa3-4108-80ed-c2020b47e3b0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:49.222569 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:49.225444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad198336-8246-494f-822c-b472df4ce378 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:49.225724 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad198336-8246-494f-822c-b472df4ce378 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:49.225997 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad198336-8246-494f-822c-b472df4ce378 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:49.227606 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 196/383] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:42:49.233767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a93727-230b-480e-a0be-74e177fdd099 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:49.234616 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a93727-230b-480e-a0be-74e177fdd099 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:49.234887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a93727-230b-480e-a0be-74e177fdd099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:49.242627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add9020-8939-45ac-a37b-2afe13041e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:49.243268 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add9020-8939-45ac-a37b-2afe13041e30 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:49.243545 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add9020-8939-45ac-a37b-2afe13041e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:49.243817 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add9020-8939-45ac-a37b-2afe13041e30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:49.257507 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add9020-8939-45ac-a37b-2afe13041e30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:49.268008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-9add9020-8939-45ac-a37b-2afe13041e30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:49.268008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:49.268008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:49.268008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:49.268008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:49.268008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:49.268008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:49.268008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:49.268008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:49.268008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:49.268008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:49.268008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:49.268008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:49.268008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:49.268008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:49.268008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:49.268974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:49.268974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:49.268974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:49.268974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:49.268974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:49.268974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:49.268974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:49.268974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:49.268974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:49.268974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:49.268974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:49.268974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:49.268974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:49.268974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:49.268974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:49.268974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:49.269774 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:49.269774 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:49.269774 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:49.269774 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:49.269774 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:49.269774 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:49.269774 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:49.269774 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:49.269774 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:49.269774 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:49.269774 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:49.269774 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:49.270928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 188/384] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:49.274660 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add9020-8939-45ac-a37b-2afe13041e30 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:49.276237 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-58a93727-230b-480e-a0be-74e177fdd099 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:49.277434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-58a93727-230b-480e-a0be-74e177fdd099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:49.320272 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:49.417764 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 197/385] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:49.448503 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add9020-8939-45ac-a37b-2afe13041e30 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:49.495621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6eff86-4f91-4a66-a822-2eb55f8c8a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:49.496256 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6eff86-4f91-4a66-a822-2eb55f8c8a2d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:49.496470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6eff86-4f91-4a66-a822-2eb55f8c8a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:49.496719 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6eff86-4f91-4a66-a822-2eb55f8c8a2d None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:49.497526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6eff86-4f91-4a66-a822-2eb55f8c8a2d None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:49.497834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6eff86-4f91-4a66-a822-2eb55f8c8a2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:49.499239 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6eff86-4f91-4a66-a822-2eb55f8c8a2d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:49.509035 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 189/386] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:49.514516 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a93727-230b-480e-a0be-74e177fdd099 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:49.640100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a93727-230b-480e-a0be-74e177fdd099 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:49.676295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c119465-c3db-4a9c-866e-90e773bcfd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:49.676936 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c119465-c3db-4a9c-866e-90e773bcfd1f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:49.677217 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c119465-c3db-4a9c-866e-90e773bcfd1f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:49.677492 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c119465-c3db-4a9c-866e-90e773bcfd1f None admin] PATH_INFO: `/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:49.678664 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c119465-c3db-4a9c-866e-90e773bcfd1f None admin] RBAC: Authorizing `identity:get_group(group_id=56f2cd5979dd4d80ba84d3e8189f7601)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:49.680128 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c119465-c3db-4a9c-866e-90e773bcfd1f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:49.682059 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 198/387] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Sep 9 20:42:49 2022] GET /identity/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:49.687330 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6eff86-4f91-4a66-a822-2eb55f8c8a2d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:49.741314 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c119465-c3db-4a9c-866e-90e773bcfd1f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:49.760428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:49.776702 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:49.824290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6eff86-4f91-4a66-a822-2eb55f8c8a2d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:49.868882 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee518fa4-4b11-49c7-bfdd-159c6650cf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:49.869535 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee518fa4-4b11-49c7-bfdd-159c6650cf7b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:49.869813 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee518fa4-4b11-49c7-bfdd-159c6650cf7b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:49.870086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee518fa4-4b11-49c7-bfdd-159c6650cf7b None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:49.871803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee518fa4-4b11-49c7-bfdd-159c6650cf7b None admin] RBAC: Authorizing `identity:get_project(project_id=3518388fd55847e99d38040fb3c91ac5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:49.873300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee518fa4-4b11-49c7-bfdd-159c6650cf7b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:49.877509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 190/388] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:49 2022] GET /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:49.883752 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee518fa4-4b11-49c7-bfdd-159c6650cf7b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:49.913405 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c119465-c3db-4a9c-866e-90e773bcfd1f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:49.955960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac3088-0a81-4196-9d90-469bf67a80a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:49.956630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac3088-0a81-4196-9d90-469bf67a80a2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:49.956909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac3088-0a81-4196-9d90-469bf67a80a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:49.957177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac3088-0a81-4196-9d90-469bf67a80a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:49.969658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac3088-0a81-4196-9d90-469bf67a80a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:49.975589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-1cac3088-0a81-4196-9d90-469bf67a80a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:49.975589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:49.975589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:49.975589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:49.975589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:49.975589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:49.975589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:49.975589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:49.975589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:49.975589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:49.975589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:49.975589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:49.975589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:49.975589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:49.975589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:49.975589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:49.976505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:49.976505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:49.976505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:49.976505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:49.976505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:49.976505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:49.976505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:49.976505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:49.976505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:49.976505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:49.976505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:49.976505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:49.976505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:49.976505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:49.976505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:49.976505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:49.977855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:49.977855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:49.977855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:49.977855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:49.977855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:49.977855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:49.977855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:49.977855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:49.977855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:49.977855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:49.977855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:49.977855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:49.977855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 199/389] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:42:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:42:49.985072 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac3088-0a81-4196-9d90-469bf67a80a2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:50.099699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee518fa4-4b11-49c7-bfdd-159c6650cf7b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:50.110807 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:50.160203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:50.166337 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53edc3-c946-4e5d-92fb-4ec7b99b3efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:50.167029 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53edc3-c946-4e5d-92fb-4ec7b99b3efd None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:50.167310 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53edc3-c946-4e5d-92fb-4ec7b99b3efd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:50.167600 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53edc3-c946-4e5d-92fb-4ec7b99b3efd None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5/groups/56f2cd5979dd4d80ba84d3e8189f7601/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:50.172890 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53edc3-c946-4e5d-92fb-4ec7b99b3efd None admin] RBAC: Authorizing `identity:create_grant(project_id=3518388fd55847e99d38040fb3c91ac5, group_id=56f2cd5979dd4d80ba84d3e8189f7601, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:50.176372 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53edc3-c946-4e5d-92fb-4ec7b99b3efd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:50.203100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac3088-0a81-4196-9d90-469bf67a80a2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:50.210456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 191/390] 10.222.0.15 () {58 vars in 1442 bytes} [Fri Sep 9 20:42:49 2022] PUT /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5/groups/56f2cd5979dd4d80ba84d3e8189f7601/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:42:50.260787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b71179-bca5-4ef6-af2c-5a0135c61b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:50.261423 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b71179-bca5-4ef6-af2c-5a0135c61b78 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:50.261708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b71179-bca5-4ef6-af2c-5a0135c61b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:50.261982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b71179-bca5-4ef6-af2c-5a0135c61b78 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:50.262663 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b71179-bca5-4ef6-af2c-5a0135c61b78 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:50.262967 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b71179-bca5-4ef6-af2c-5a0135c61b78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:50.264391 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b71179-bca5-4ef6-af2c-5a0135c61b78 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:50.281689 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 200/391] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:42:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:50.288061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53edc3-c946-4e5d-92fb-4ec7b99b3efd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:50.459534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53edc3-c946-4e5d-92fb-4ec7b99b3efd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:50.496417 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f9359-2f60-4aa5-9dbf-3daac6e81016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:50.497159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f9359-2f60-4aa5-9dbf-3daac6e81016 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:50.497405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f9359-2f60-4aa5-9dbf-3daac6e81016 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:50.497677 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f9359-2f60-4aa5-9dbf-3daac6e81016 None admin] PATH_INFO: `/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:50.498784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f9359-2f60-4aa5-9dbf-3daac6e81016 None admin] RBAC: Authorizing `identity:get_group(group_id=56f2cd5979dd4d80ba84d3e8189f7601)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:50.500825 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0f9359-2f60-4aa5-9dbf-3daac6e81016 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:50.502806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 192/392] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Sep 9 20:42:50 2022] GET /identity/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:50.508304 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b71179-bca5-4ef6-af2c-5a0135c61b78 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:50.620517 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b71179-bca5-4ef6-af2c-5a0135c61b78 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:50.663834 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce04fef-69ff-4759-86a1-8b64d72ead19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:50.664566 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce04fef-69ff-4759-86a1-8b64d72ead19 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:50.664834 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce04fef-69ff-4759-86a1-8b64d72ead19 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:50.665113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce04fef-69ff-4759-86a1-8b64d72ead19 None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:50.666335 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce04fef-69ff-4759-86a1-8b64d72ead19 None admin] RBAC: Authorizing `identity:get_project(project_id=3518388fd55847e99d38040fb3c91ac5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:50.667763 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce04fef-69ff-4759-86a1-8b64d72ead19 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:50.669747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 201/393] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:50 2022] GET /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:50.676617 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f9359-2f60-4aa5-9dbf-3daac6e81016 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:50.722518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:50.790874 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f9359-2f60-4aa5-9dbf-3daac6e81016 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:50.826803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532e056-4fce-4fc0-ab8e-d6deec1acd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:50.827510 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532e056-4fce-4fc0-ab8e-d6deec1acd21 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:50.827792 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532e056-4fce-4fc0-ab8e-d6deec1acd21 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:50.828092 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532e056-4fce-4fc0-ab8e-d6deec1acd21 None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5/groups/56f2cd5979dd4d80ba84d3e8189f7601/roles/d9c09fde9a114c2fa299455f8298db09` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:50.830381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532e056-4fce-4fc0-ab8e-d6deec1acd21 None admin] RBAC: Authorizing `identity:create_grant(project_id=3518388fd55847e99d38040fb3c91ac5, group_id=56f2cd5979dd4d80ba84d3e8189f7601, role_id=d9c09fde9a114c2fa299455f8298db09)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:50.831921 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532e056-4fce-4fc0-ab8e-d6deec1acd21 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:50.848690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 193/394] 10.222.0.15 () {58 vars in 1442 bytes} [Fri Sep 9 20:42:50 2022] PUT /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5/groups/56f2cd5979dd4d80ba84d3e8189f7601/roles/d9c09fde9a114c2fa299455f8298db09 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:42:51.332434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f0b96-8212-4459-86a0-7e5228d42d50 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:51.333080 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f0b96-8212-4459-86a0-7e5228d42d50 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:51.333573 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f0b96-8212-4459-86a0-7e5228d42d50 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:51.335395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 202/395] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:51.340968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802237d2-16c3-438d-8312-cc2767622b55 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:51.341482 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802237d2-16c3-438d-8312-cc2767622b55 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:51.341961 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802237d2-16c3-438d-8312-cc2767622b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:51.362373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-802237d2-16c3-438d-8312-cc2767622b55 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:51.363928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-802237d2-16c3-438d-8312-cc2767622b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:51.439002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 194/396] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:51.637897 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e79594-fa9d-473e-9aef-f1b858876dbf None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:51.639722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e79594-fa9d-473e-9aef-f1b858876dbf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:51.639722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e79594-fa9d-473e-9aef-f1b858876dbf None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:51.641000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 203/397] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:51.646556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5437e-8e88-400f-a9af-94452c59f397 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:51.647421 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5437e-8e88-400f-a9af-94452c59f397 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:51.647896 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5437e-8e88-400f-a9af-94452c59f397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:51.669374 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-71c5437e-8e88-400f-a9af-94452c59f397 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:51.671036 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-71c5437e-8e88-400f-a9af-94452c59f397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:51.693033 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7e2e1-690a-4b0e-a886-e5a5928412ea None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:51.693530 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7e2e1-690a-4b0e-a886-e5a5928412ea None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:51.693603 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7e2e1-690a-4b0e-a886-e5a5928412ea None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:51.695128 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 204/398] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:51.696647 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:51.701553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86477801-6917-4ae5-93ed-b963c38e820c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:51.701837 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86477801-6917-4ae5-93ed-b963c38e820c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:51.702134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86477801-6917-4ae5-93ed-b963c38e820c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:51.733652 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-86477801-6917-4ae5-93ed-b963c38e820c None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:51.736766 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-86477801-6917-4ae5-93ed-b963c38e820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:51.747830 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:51.787882 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 195/399] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:51.829716 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5437e-8e88-400f-a9af-94452c59f397 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:51.861822 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 205/400] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:42:51.946974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5437e-8e88-400f-a9af-94452c59f397 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:51.995408 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767b1c1-e317-47fa-b738-b2d2cad89247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:51.996083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767b1c1-e317-47fa-b738-b2d2cad89247 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:51.996366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767b1c1-e317-47fa-b738-b2d2cad89247 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:51.996636 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767b1c1-e317-47fa-b738-b2d2cad89247 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:52.007456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767b1c1-e317-47fa-b738-b2d2cad89247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:52.018300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c767b1c1-e317-47fa-b738-b2d2cad89247 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:52.018300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:52.018300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:52.018300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:52.018300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:52.018300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:52.018300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:52.018300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:52.018300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:52.018300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:52.018300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:52.018300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:52.018300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:52.018300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:52.018300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:52.018300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:52.019173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:52.019173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:52.019173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:52.019173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:52.019173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:52.019173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:52.019173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:52.019173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:52.019173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:52.019173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:52.019173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:52.019173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:52.019173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:52.019173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:52.019173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:52.019173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:52.019946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:52.019946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:52.019946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:52.019946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:52.019946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:52.019946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:52.019946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:52.019946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:52.019946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:52.019946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:52.019946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:52.019946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:52.019946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 196/401] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:42:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:42:52.026984 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86477801-6917-4ae5-93ed-b963c38e820c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:52.126902 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767b1c1-e317-47fa-b738-b2d2cad89247 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:52.158404 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86477801-6917-4ae5-93ed-b963c38e820c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:52.162048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:52.226226 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5d287-aac1-414e-b5c6-cfe35ba67d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:52.226807 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5d287-aac1-414e-b5c6-cfe35ba67d56 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:52.227082 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5d287-aac1-414e-b5c6-cfe35ba67d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:52.227395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5d287-aac1-414e-b5c6-cfe35ba67d56 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:52.228086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5d287-aac1-414e-b5c6-cfe35ba67d56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:52.228389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5d287-aac1-414e-b5c6-cfe35ba67d56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:52.230812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5d287-aac1-414e-b5c6-cfe35ba67d56 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:52.247235 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 206/402] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:42:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:52.252243 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5d287-aac1-414e-b5c6-cfe35ba67d56 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:52.258627 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:52.315899 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767b1c1-e317-47fa-b738-b2d2cad89247 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:52.367359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b0c34-5fcf-4010-bd77-0c5820862a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:52.368014 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b0c34-5fcf-4010-bd77-0c5820862a28 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:52.368405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b0c34-5fcf-4010-bd77-0c5820862a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:52.368577 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b0c34-5fcf-4010-bd77-0c5820862a28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:52.379625 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b0c34-5fcf-4010-bd77-0c5820862a28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:52.384512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-9f1b0c34-5fcf-4010-bd77-0c5820862a28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:52.384512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:52.384512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:52.384512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:52.384512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:52.384512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:52.384512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:52.384512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:52.384512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:52.384512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:52.384512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:52.384512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:52.384512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:52.384512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:52.384512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:52.384512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:52.385391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:52.385391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:52.385391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:52.385391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:52.385391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:52.385391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:52.385391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:52.385391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:52.385391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:52.385391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:52.385391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:52.385391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:52.385391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:52.385391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:52.385391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:52.385391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:52.386161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:52.386161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:52.386161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:52.386161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:52.386161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:52.386161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:52.386161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:52.386161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:52.386161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:52.386161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:52.386161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:52.386161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:52.386161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 197/403] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:52.392582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b0c34-5fcf-4010-bd77-0c5820862a28 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:52.424148 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5d287-aac1-414e-b5c6-cfe35ba67d56 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:52.462848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0893e-7396-44c7-9346-71c4bcb0ac4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:52.463523 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0893e-7396-44c7-9346-71c4bcb0ac4b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:52.463797 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0893e-7396-44c7-9346-71c4bcb0ac4b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:52.464297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf0893e-7396-44c7-9346-71c4bcb0ac4b None admin] PATH_INFO: `/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:52.465713 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0893e-7396-44c7-9346-71c4bcb0ac4b None admin] RBAC: Authorizing `identity:get_group(group_id=56f2cd5979dd4d80ba84d3e8189f7601)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:52.467429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf0893e-7396-44c7-9346-71c4bcb0ac4b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:52.474205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 207/404] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Sep 9 20:42:52 2022] GET /identity/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:52.474205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0893e-7396-44c7-9346-71c4bcb0ac4b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:52.492124 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:52.525720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b0c34-5fcf-4010-bd77-0c5820862a28 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:52.557602 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:52.563597 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa33ca-26cc-4bbe-9b47-3cfb7f24fe35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:52.564641 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa33ca-26cc-4bbe-9b47-3cfb7f24fe35 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:52.564935 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa33ca-26cc-4bbe-9b47-3cfb7f24fe35 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:52.565220 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa33ca-26cc-4bbe-9b47-3cfb7f24fe35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:52.577955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa33ca-26cc-4bbe-9b47-3cfb7f24fe35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:52.583260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-83aa33ca-26cc-4bbe-9b47-3cfb7f24fe35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:42:52.583260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:52.583260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:52.583260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:52.583260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:52.583260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:52.583260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:52.583260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:52.583260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:52.583260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:52.583260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:52.583260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:52.583260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:52.583260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:52.583260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:52.583260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:52.584183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:52.584183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:52.584183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:52.584183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:52.584183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:52.584183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:52.584183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:52.584183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:52.584183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:52.584183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:52.584183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:52.584183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:52.584183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:52.584183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:52.584183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:52.584183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:52.584954 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:52.584954 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:52.584954 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:52.584954 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:52.584954 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:52.584954 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:52.584954 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:52.584954 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:52.584954 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:52.584954 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:52.584954 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:42:52.584954 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:52.584954 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 198/405] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:42:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:52.585607 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa33ca-26cc-4bbe-9b47-3cfb7f24fe35 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:52.592615 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf0893e-7396-44c7-9346-71c4bcb0ac4b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:52.643075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00381793-c03f-49ad-97aa-3fefb278b298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:52.644202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00381793-c03f-49ad-97aa-3fefb278b298 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:52.644486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00381793-c03f-49ad-97aa-3fefb278b298 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:52.644761 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00381793-c03f-49ad-97aa-3fefb278b298 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:52.645762 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00381793-c03f-49ad-97aa-3fefb278b298 None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:52.646076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00381793-c03f-49ad-97aa-3fefb278b298 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:52.647764 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00381793-c03f-49ad-97aa-3fefb278b298 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:52.657842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 208/406] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:52.658756 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00381793-c03f-49ad-97aa-3fefb278b298 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:52.715190 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa33ca-26cc-4bbe-9b47-3cfb7f24fe35 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:52.756742 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b9c5c-ce2d-4729-985b-d7ff7c4f1c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:52.757453 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b9c5c-ce2d-4729-985b-d7ff7c4f1c27 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:52.757824 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b9c5c-ce2d-4729-985b-d7ff7c4f1c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:52.758232 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b9c5c-ce2d-4729-985b-d7ff7c4f1c27 None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:52.759748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b9c5c-ce2d-4729-985b-d7ff7c4f1c27 None admin] RBAC: Authorizing `identity:get_project(project_id=e415362e3ec14b99be6122313166eaaa)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:52.761370 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b9c5c-ce2d-4729-985b-d7ff7c4f1c27 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:52.763513 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 199/407] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:52 2022] GET /identity/v3/projects/e415362e3ec14b99be6122313166eaaa => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:52.764480 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b9c5c-ce2d-4729-985b-d7ff7c4f1c27 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:52.768681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:52.775011 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00381793-c03f-49ad-97aa-3fefb278b298 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:52.807689 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:52.814375 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c1ff1-5d54-465a-b629-b18395e14f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:52.814988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c1ff1-5d54-465a-b629-b18395e14f12 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:52.815268 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c1ff1-5d54-465a-b629-b18395e14f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:52.815541 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c1ff1-5d54-465a-b629-b18395e14f12 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:52.816252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c1ff1-5d54-465a-b629-b18395e14f12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:52.816562 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c1ff1-5d54-465a-b629-b18395e14f12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:52.817938 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c1ff1-5d54-465a-b629-b18395e14f12 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:52.827386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 209/408] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:52.828827 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c1ff1-5d54-465a-b629-b18395e14f12 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:52.883394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b9c5c-ce2d-4729-985b-d7ff7c4f1c27 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:52.919908 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4d5f7-ce24-4750-a136-01f4b92efff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:52.920896 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4d5f7-ce24-4750-a136-01f4b92efff8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:52.921484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4d5f7-ce24-4750-a136-01f4b92efff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:52.921951 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4d5f7-ce24-4750-a136-01f4b92efff8 None admin] PATH_INFO: `/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:52.923362 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4d5f7-ce24-4750-a136-01f4b92efff8 None admin] RBAC: Authorizing `identity:get_group(group_id=56f2cd5979dd4d80ba84d3e8189f7601)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:52.925085 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4d5f7-ce24-4750-a136-01f4b92efff8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:52.931860 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 200/409] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Sep 9 20:42:52 2022] GET /identity/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:52.933305 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4d5f7-ce24-4750-a136-01f4b92efff8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:52.952285 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c1ff1-5d54-465a-b629-b18395e14f12 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:52.998098 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b426b3-53f9-4ee7-ae33-ee1b455cd25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:52.999111 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b426b3-53f9-4ee7-ae33-ee1b455cd25e None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:52.999744 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b426b3-53f9-4ee7-ae33-ee1b455cd25e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:53.000252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b426b3-53f9-4ee7-ae33-ee1b455cd25e None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa/groups/56f2cd5979dd4d80ba84d3e8189f7601/roles/d9c09fde9a114c2fa299455f8298db09` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:53.002611 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b426b3-53f9-4ee7-ae33-ee1b455cd25e None admin] RBAC: Authorizing `identity:create_grant(project_id=e415362e3ec14b99be6122313166eaaa, group_id=56f2cd5979dd4d80ba84d3e8189f7601, role_id=d9c09fde9a114c2fa299455f8298db09)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:53.004562 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b426b3-53f9-4ee7-ae33-ee1b455cd25e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:53.020766 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:53.021305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 210/410] 10.222.0.15 () {58 vars in 1442 bytes} [Fri Sep 9 20:42:52 2022] PUT /identity/v3/projects/e415362e3ec14b99be6122313166eaaa/groups/56f2cd5979dd4d80ba84d3e8189f7601/roles/d9c09fde9a114c2fa299455f8298db09 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:42:53.023613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b426b3-53f9-4ee7-ae33-ee1b455cd25e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:53.071870 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4d5f7-ce24-4750-a136-01f4b92efff8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:53.104579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:53.112981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7a694-7d9e-4537-9256-3a00d85bf6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:53.113665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7a694-7d9e-4537-9256-3a00d85bf6e1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:53.113943 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7a694-7d9e-4537-9256-3a00d85bf6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:53.114215 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7a694-7d9e-4537-9256-3a00d85bf6e1 None admin] PATH_INFO: `/v3/groups/37adaadaaae649529b8eeda3118178c6` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:53.115401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7a694-7d9e-4537-9256-3a00d85bf6e1 None admin] RBAC: Authorizing `identity:get_group(group_id=37adaadaaae649529b8eeda3118178c6)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:53.116897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7a694-7d9e-4537-9256-3a00d85bf6e1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:53.118559 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 201/411] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Sep 9 20:42:52 2022] GET /identity/v3/groups/37adaadaaae649529b8eeda3118178c6 => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:53.119785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919074ee-1bb5-466a-86f3-0af1142efb61 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:53.120106 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919074ee-1bb5-466a-86f3-0af1142efb61 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:53.120380 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919074ee-1bb5-466a-86f3-0af1142efb61 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:53.126811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 202/412] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:53.127776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919074ee-1bb5-466a-86f3-0af1142efb61 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:53.167588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b426b3-53f9-4ee7-ae33-ee1b455cd25e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:53.209331 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374e31b-deab-45b9-81c9-be8f99d856c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:53.210028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e31b-deab-45b9-81c9-be8f99d856c2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:53.210307 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e31b-deab-45b9-81c9-be8f99d856c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:53.210580 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e31b-deab-45b9-81c9-be8f99d856c2 None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:53.211800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374e31b-deab-45b9-81c9-be8f99d856c2 None admin] RBAC: Authorizing `identity:get_project(project_id=e415362e3ec14b99be6122313166eaaa)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:53.213345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374e31b-deab-45b9-81c9-be8f99d856c2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:53.216476 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 211/413] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:53 2022] GET /identity/v3/projects/e415362e3ec14b99be6122313166eaaa => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:53.217790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11964ab2-aa73-4280-8ecc-ae098eeabf28 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:53.218680 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11964ab2-aa73-4280-8ecc-ae098eeabf28 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:53.219095 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11964ab2-aa73-4280-8ecc-ae098eeabf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:53.242675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-11964ab2-aa73-4280-8ecc-ae098eeabf28 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:53.243871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-11964ab2-aa73-4280-8ecc-ae098eeabf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:53.270457 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919074ee-1bb5-466a-86f3-0af1142efb61 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:53.321187 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44125a-74fc-42fd-a453-e84d4b9a588b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:53.321673 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44125a-74fc-42fd-a453-e84d4b9a588b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:53.321964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44125a-74fc-42fd-a453-e84d4b9a588b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:53.322297 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44125a-74fc-42fd-a453-e84d4b9a588b None admin] PATH_INFO: `/v3/projects/36e4c2d50d8d40f5b9937dbb73fb973f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:53.323485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44125a-74fc-42fd-a453-e84d4b9a588b None admin] RBAC: Authorizing `identity:get_project(project_id=36e4c2d50d8d40f5b9937dbb73fb973f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:53.325082 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b44125a-74fc-42fd-a453-e84d4b9a588b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:53.327114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 203/414] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:53 2022] GET /identity/v3/projects/36e4c2d50d8d40f5b9937dbb73fb973f => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:53.328342 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44125a-74fc-42fd-a453-e84d4b9a588b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:53.339915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:53.356710 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 212/415] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:53.363621 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11964ab2-aa73-4280-8ecc-ae098eeabf28 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:53.472605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b44125a-74fc-42fd-a453-e84d4b9a588b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:53.501279 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:53.519897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668e22f-8d83-4219-b6a5-0391ff04ff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:53.520602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668e22f-8d83-4219-b6a5-0391ff04ff67 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:53.521373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668e22f-8d83-4219-b6a5-0391ff04ff67 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:53.521789 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668e22f-8d83-4219-b6a5-0391ff04ff67 None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa/groups/56f2cd5979dd4d80ba84d3e8189f7601/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:53.523742 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668e22f-8d83-4219-b6a5-0391ff04ff67 None admin] RBAC: Authorizing `identity:create_grant(project_id=e415362e3ec14b99be6122313166eaaa, group_id=56f2cd5979dd4d80ba84d3e8189f7601, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:53.525889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6668e22f-8d83-4219-b6a5-0391ff04ff67 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:53.552233 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 204/416] 10.222.0.15 () {58 vars in 1442 bytes} [Fri Sep 9 20:42:53 2022] PUT /identity/v3/projects/e415362e3ec14b99be6122313166eaaa/groups/56f2cd5979dd4d80ba84d3e8189f7601/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:42:53.582969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709abecd-ae15-4717-a8ab-dde9e6426dcd None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:53.583264 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709abecd-ae15-4717-a8ab-dde9e6426dcd None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:53.583530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709abecd-ae15-4717-a8ab-dde9e6426dcd None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:53.585340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 205/417] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:53.592902 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e00e9b-85e4-4ee3-ba4c-04ce408e0fcb None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:53.594196 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e00e9b-85e4-4ee3-ba4c-04ce408e0fcb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:53.594576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e00e9b-85e4-4ee3-ba4c-04ce408e0fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:53.614271 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11964ab2-aa73-4280-8ecc-ae098eeabf28 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:53.620017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-00e00e9b-85e4-4ee3-ba4c-04ce408e0fcb None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:53.620017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-00e00e9b-85e4-4ee3-ba4c-04ce408e0fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:53.658870 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c563ab-aa6e-4484-acef-8a87cc26765c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:53.659967 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c563ab-aa6e-4484-acef-8a87cc26765c None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:53.660416 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c563ab-aa6e-4484-acef-8a87cc26765c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:53.660838 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c563ab-aa6e-4484-acef-8a87cc26765c None admin] PATH_INFO: `/v3/projects/36e4c2d50d8d40f5b9937dbb73fb973f/groups/37adaadaaae649529b8eeda3118178c6/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:53.663133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c563ab-aa6e-4484-acef-8a87cc26765c None admin] RBAC: Authorizing `identity:create_grant(project_id=36e4c2d50d8d40f5b9937dbb73fb973f, group_id=37adaadaaae649529b8eeda3118178c6, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:53.665158 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c563ab-aa6e-4484-acef-8a87cc26765c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:53.680634 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 213/418] 10.222.0.15 () {58 vars in 1442 bytes} [Fri Sep 9 20:42:53 2022] PUT /identity/v3/projects/36e4c2d50d8d40f5b9937dbb73fb973f/groups/37adaadaaae649529b8eeda3118178c6/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:42:53.682062 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c563ab-aa6e-4484-acef-8a87cc26765c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:53.717410 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:53.727083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 206/419] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:53.823622 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c563ab-aa6e-4484-acef-8a87cc26765c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:53.847717 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:53.874754 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954feca6-978c-4a23-94a7-baf4e99ed74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:53.875836 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954feca6-978c-4a23-94a7-baf4e99ed74f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:53.876288 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954feca6-978c-4a23-94a7-baf4e99ed74f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:53.876700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954feca6-978c-4a23-94a7-baf4e99ed74f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:53.889287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954feca6-978c-4a23-94a7-baf4e99ed74f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:53.895299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-954feca6-978c-4a23-94a7-baf4e99ed74f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:53.895299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:53.895299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:53.895299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:53.895299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:53.895299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:53.895299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:53.895299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:53.895299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:53.895299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:53.895299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:53.895299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:53.895299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:53.895299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:53.895299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:53.895299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:53.896498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:53.896498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:53.896498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:53.896498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:53.896498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:53.896498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:53.896498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:53.896498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:53.896498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:53.896498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:53.896498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:53.896498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:53.896498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:53.896498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:53.896498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:53.896498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:53.897442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:53.897442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:53.897442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:53.897442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:53.897442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:53.897442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:53.897442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:53.897442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:53.897442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:53.897442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:53.897442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:53.897442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:53.899898 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 214/420] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:53.907158 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e00e9b-85e4-4ee3-ba4c-04ce408e0fcb None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:54.040935 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e00e9b-85e4-4ee3-ba4c-04ce408e0fcb None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:54.052273 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954feca6-978c-4a23-94a7-baf4e99ed74f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:54.091380 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238a9cd-9172-421e-bd4c-b7957a8d3f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:54.092013 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238a9cd-9172-421e-bd4c-b7957a8d3f45 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:54.092306 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238a9cd-9172-421e-bd4c-b7957a8d3f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:54.092570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238a9cd-9172-421e-bd4c-b7957a8d3f45 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:54.093848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238a9cd-9172-421e-bd4c-b7957a8d3f45 None admin] RBAC: Adding query filter params (name=member) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:54.094143 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238a9cd-9172-421e-bd4c-b7957a8d3f45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:54.095530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238a9cd-9172-421e-bd4c-b7957a8d3f45 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:54.104893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 207/421] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:54.115877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238a9cd-9172-421e-bd4c-b7957a8d3f45 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:54.173195 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954feca6-978c-4a23-94a7-baf4e99ed74f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:54.211159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23087aa5-0190-4200-9b03-1ef802aa4a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:54.211820 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23087aa5-0190-4200-9b03-1ef802aa4a41 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:54.212124 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23087aa5-0190-4200-9b03-1ef802aa4a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:54.212402 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23087aa5-0190-4200-9b03-1ef802aa4a41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:54.225208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23087aa5-0190-4200-9b03-1ef802aa4a41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:54.230737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-23087aa5-0190-4200-9b03-1ef802aa4a41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:54.230737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:54.230737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:54.230737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:54.230737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:54.230737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:54.230737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:54.230737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:54.230737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:54.230737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:54.230737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:54.230737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:54.230737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:54.230737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:54.230737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:54.230737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:54.231658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:54.231658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:54.231658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:54.231658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:54.231658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:54.231658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:54.231658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:54.231658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:54.231658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:54.231658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:54.231658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:54.231658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:54.231658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:54.231658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:54.231658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:54.231658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:54.232503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:54.232503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:54.232503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:54.232503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:54.232503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:54.232503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:54.232503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:54.232503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:54.232503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:54.232503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:54.232503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:54.232503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:54.236296 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 215/422] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:42:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:42:54.240037 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23087aa5-0190-4200-9b03-1ef802aa4a41 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:54.244526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:54.280372 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:54.337197 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238a9cd-9172-421e-bd4c-b7957a8d3f45 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:54.364440 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23087aa5-0190-4200-9b03-1ef802aa4a41 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:54.403081 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77db45-70fd-4d60-ba27-37bfa4cd3adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:54.403695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77db45-70fd-4d60-ba27-37bfa4cd3adc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:54.403977 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77db45-70fd-4d60-ba27-37bfa4cd3adc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:54.404302 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f77db45-70fd-4d60-ba27-37bfa4cd3adc None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:54.404955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77db45-70fd-4d60-ba27-37bfa4cd3adc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:54.405265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77db45-70fd-4d60-ba27-37bfa4cd3adc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:54.407394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f77db45-70fd-4d60-ba27-37bfa4cd3adc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:54.420197 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 216/423] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:42:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:54.423039 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77db45-70fd-4d60-ba27-37bfa4cd3adc None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:54.440699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b24996-1ae3-4aee-b721-ba5dcdbf8b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:54.441327 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b24996-1ae3-4aee-b721-ba5dcdbf8b3a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:54.441607 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b24996-1ae3-4aee-b721-ba5dcdbf8b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:54.441880 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b24996-1ae3-4aee-b721-ba5dcdbf8b3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:54.529132 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f77db45-70fd-4d60-ba27-37bfa4cd3adc None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:54.532381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:54.567497 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443ae66-1c16-423e-9eea-efbe93b966bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:54.568166 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443ae66-1c16-423e-9eea-efbe93b966bf None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:54.568450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443ae66-1c16-423e-9eea-efbe93b966bf None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:54.568724 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443ae66-1c16-423e-9eea-efbe93b966bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:54.602716 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b24996-1ae3-4aee-b721-ba5dcdbf8b3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:54.609778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b24996-1ae3-4aee-b721-ba5dcdbf8b3a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:54.683838 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443ae66-1c16-423e-9eea-efbe93b966bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:54.685355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3443ae66-1c16-423e-9eea-efbe93b966bf None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:54.763383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:54.863821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 208/424] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 748 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:54.868888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b24996-1ae3-4aee-b721-ba5dcdbf8b3a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:54.904363 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:54.919322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 217/425] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 20:42:54.922457 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443ae66-1c16-423e-9eea-efbe93b966bf None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:55.059749 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b24996-1ae3-4aee-b721-ba5dcdbf8b3a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:55.122153 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be3ec0-3a42-4e6f-ab17-41a8498aef66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:55.122794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be3ec0-3a42-4e6f-ab17-41a8498aef66 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:55.123078 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be3ec0-3a42-4e6f-ab17-41a8498aef66 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:55.123351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be3ec0-3a42-4e6f-ab17-41a8498aef66 None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:55.125318 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be3ec0-3a42-4e6f-ab17-41a8498aef66 None admin] RBAC: Authorizing `identity:get_project(project_id=3518388fd55847e99d38040fb3c91ac5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:55.126971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be3ec0-3a42-4e6f-ab17-41a8498aef66 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:55.129183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 209/426] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:54 2022] GET /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:55.134633 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be3ec0-3a42-4e6f-ab17-41a8498aef66 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:55.219604 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443ae66-1c16-423e-9eea-efbe93b966bf None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:55.224543 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:55.335315 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92e4f9-7f94-40dc-8f28-b56c085f8792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:55.335885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92e4f9-7f94-40dc-8f28-b56c085f8792 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:55.337183 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92e4f9-7f94-40dc-8f28-b56c085f8792 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:55.337183 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92e4f9-7f94-40dc-8f28-b56c085f8792 None admin] PATH_INFO: `/v3/projects/3518388fd55847e99d38040fb3c91ac5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:55.341448 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92e4f9-7f94-40dc-8f28-b56c085f8792 None admin] RBAC: Authorizing `identity:get_project(project_id=3518388fd55847e99d38040fb3c91ac5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:55.346016 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92e4f9-7f94-40dc-8f28-b56c085f8792 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:55.353297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 218/427] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:54 2022] GET /identity/v3/projects/3518388fd55847e99d38040fb3c91ac5 => generated 298 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:55.356120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92e4f9-7f94-40dc-8f28-b56c085f8792 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:55.429467 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be3ec0-3a42-4e6f-ab17-41a8498aef66 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:55.487833 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:55.511539 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad04004-0d8a-49ab-b6d6-3dad0c7178e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:55.512230 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad04004-0d8a-49ab-b6d6-3dad0c7178e8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:55.518292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad04004-0d8a-49ab-b6d6-3dad0c7178e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:55.518645 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad04004-0d8a-49ab-b6d6-3dad0c7178e8 None admin] PATH_INFO: `/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:55.519971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad04004-0d8a-49ab-b6d6-3dad0c7178e8 None admin] RBAC: Authorizing `identity:get_group(group_id=56f2cd5979dd4d80ba84d3e8189f7601)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:55.521532 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad04004-0d8a-49ab-b6d6-3dad0c7178e8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:55.528110 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 210/428] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Sep 9 20:42:55 2022] GET /identity/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601 => generated 226 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:55.534405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad04004-0d8a-49ab-b6d6-3dad0c7178e8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:55.588107 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92e4f9-7f94-40dc-8f28-b56c085f8792 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:55.649478 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824dc6ef-1ef6-43f9-856b-d85de34e4d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:55.650118 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dc6ef-1ef6-43f9-856b-d85de34e4d02 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:55.650655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dc6ef-1ef6-43f9-856b-d85de34e4d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:55.650932 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824dc6ef-1ef6-43f9-856b-d85de34e4d02 None admin] PATH_INFO: `/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:55.652137 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824dc6ef-1ef6-43f9-856b-d85de34e4d02 None admin] RBAC: Authorizing `identity:get_group(group_id=56f2cd5979dd4d80ba84d3e8189f7601)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:55.653625 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824dc6ef-1ef6-43f9-856b-d85de34e4d02 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:55.655205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 219/429] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Sep 9 20:42:55 2022] GET /identity/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601 => generated 226 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:55.661057 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:55.661192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb368b1-caf3-4b8b-8688-a82666bb32de None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:55.661464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb368b1-caf3-4b8b-8688-a82666bb32de None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:55.661739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb368b1-caf3-4b8b-8688-a82666bb32de None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:55.663564 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 220/430] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:55.668582 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb368b1-caf3-4b8b-8688-a82666bb32de None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:55.678599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad04004-0d8a-49ab-b6d6-3dad0c7178e8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:55.727460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a2d89-801d-48c7-902f-9e6a4e3fe5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:55.728423 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a2d89-801d-48c7-902f-9e6a4e3fe5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:55.728876 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a2d89-801d-48c7-902f-9e6a4e3fe5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:55.729830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a2d89-801d-48c7-902f-9e6a4e3fe5e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:55.730996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a2d89-801d-48c7-902f-9e6a4e3fe5e4 None admin] RBAC: Adding query filter params (group.id=56f2cd5979dd4d80ba84d3e8189f7601, role.id=c726a7153e6e47a3aa35a96221eb3d78, scope.project.id=3518388fd55847e99d38040fb3c91ac5) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:55.731481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a2d89-801d-48c7-902f-9e6a4e3fe5e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:55.734699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a2d89-801d-48c7-902f-9e6a4e3fe5e4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:55.742784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 211/431] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Sep 9 20:42:55 2022] GET /identity/v3/role_assignments?group.id=56f2cd5979dd4d80ba84d3e8189f7601&scope.project.id=3518388fd55847e99d38040fb3c91ac5&role.id=c726a7153e6e47a3aa35a96221eb3d78 => generated 611 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:55.744971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305c8d2-6a63-4714-9804-23cab3ef3340 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:55.745441 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305c8d2-6a63-4714-9804-23cab3ef3340 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:55.746133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305c8d2-6a63-4714-9804-23cab3ef3340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:55.772240 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b305c8d2-6a63-4714-9804-23cab3ef3340 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:55.775168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b305c8d2-6a63-4714-9804-23cab3ef3340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:55.796899 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb368b1-caf3-4b8b-8688-a82666bb32de None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:55.867945 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:55.879733 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263be2aa-4933-4e31-8a39-a0edaa344f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:55.881758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263be2aa-4933-4e31-8a39-a0edaa344f8a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:55.883581 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263be2aa-4933-4e31-8a39-a0edaa344f8a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:55.884040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263be2aa-4933-4e31-8a39-a0edaa344f8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:55.885707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263be2aa-4933-4e31-8a39-a0edaa344f8a None admin] RBAC: Adding query filter params (group.id=56f2cd5979dd4d80ba84d3e8189f7601, role.id=d9c09fde9a114c2fa299455f8298db09, scope.project.id=3518388fd55847e99d38040fb3c91ac5) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:55.887111 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263be2aa-4933-4e31-8a39-a0edaa344f8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:55.889479 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263be2aa-4933-4e31-8a39-a0edaa344f8a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:55.903641 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 221/432] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Sep 9 20:42:55 2022] GET /identity/v3/role_assignments?group.id=56f2cd5979dd4d80ba84d3e8189f7601&scope.project.id=3518388fd55847e99d38040fb3c91ac5&role.id=d9c09fde9a114c2fa299455f8298db09 => generated 611 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:55.917765 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 212/433] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:42:56.222049 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263be2aa-4933-4e31-8a39-a0edaa344f8a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:56.273584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ac19f-7d2a-404d-91e2-99b2a0c54b8b None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:56.273867 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ac19f-7d2a-404d-91e2-99b2a0c54b8b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:56.274142 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ac19f-7d2a-404d-91e2-99b2a0c54b8b None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:56.276012 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 213/434] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:42:56.281527 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282db78-7d92-4a3b-9c09-741847d8bf20 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:56.282288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282db78-7d92-4a3b-9c09-741847d8bf20 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:56.282288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282db78-7d92-4a3b-9c09-741847d8bf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:56.308966 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a282db78-7d92-4a3b-9c09-741847d8bf20 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:56.311552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a282db78-7d92-4a3b-9c09-741847d8bf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:56.347387 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263be2aa-4933-4e31-8a39-a0edaa344f8a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:56.386722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff9888-a313-4d1f-8a72-f69566cec9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:56.387388 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff9888-a313-4d1f-8a72-f69566cec9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:56.387662 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff9888-a313-4d1f-8a72-f69566cec9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:56.387936 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff9888-a313-4d1f-8a72-f69566cec9c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:56.401043 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 214/435] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:42:56.402927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff9888-a313-4d1f-8a72-f69566cec9c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:56.410265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-b9ff9888-a313-4d1f-8a72-f69566cec9c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:56.410265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:56.410265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:56.410265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:56.410265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:56.410265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:56.410265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:56.410265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:56.410265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:56.410265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:56.410265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:56.410265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:56.410265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:56.410265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:56.410265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:56.410265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:56.411461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:56.411461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:56.411461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:56.411461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:56.411461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:56.411461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:56.411461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:56.411461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:56.411461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:56.411461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:56.411461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:56.411461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:56.411461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:56.411461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:56.411461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:56.411461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:56.412700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:56.412700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:56.412700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:56.412700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:56.412700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:56.412700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:56.412700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:56.412700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:56.412700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:56.412700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:56.412700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:42:56.412700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:56.412700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 222/436] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:42:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:56.416938 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282db78-7d92-4a3b-9c09-741847d8bf20 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:56.441166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:56.511971 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031dff5-76d3-4c6c-9905-325ed1b3626f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:56.512276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031dff5-76d3-4c6c-9905-325ed1b3626f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:56.512462 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031dff5-76d3-4c6c-9905-325ed1b3626f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:56.514474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 223/437] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:42:56.519964 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb68a83-7fa4-430a-9941-c9f9373dc6c7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:56.520273 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb68a83-7fa4-430a-9941-c9f9373dc6c7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:56.520547 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb68a83-7fa4-430a-9941-c9f9373dc6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:56.530006 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282db78-7d92-4a3b-9c09-741847d8bf20 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:56.543444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3cb68a83-7fa4-430a-9941-c9f9373dc6c7 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:42:56.544944 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3cb68a83-7fa4-430a-9941-c9f9373dc6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:42:56.570388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d6aae-5679-4a64-940a-0b3a233e74b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:56.571437 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d6aae-5679-4a64-940a-0b3a233e74b8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:56.571721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d6aae-5679-4a64-940a-0b3a233e74b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:56.572239 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d6aae-5679-4a64-940a-0b3a233e74b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:56.572840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d6aae-5679-4a64-940a-0b3a233e74b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:56.573140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d6aae-5679-4a64-940a-0b3a233e74b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:56.574524 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d6aae-5679-4a64-940a-0b3a233e74b8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:56.583418 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 215/438] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:42:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:56.588799 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d6aae-5679-4a64-940a-0b3a233e74b8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:56.615027 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:56.640109 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 224/439] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:42:56.687401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:56.701292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb68a83-7fa4-430a-9941-c9f9373dc6c7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:56.708663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d6aae-5679-4a64-940a-0b3a233e74b8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:56.744987 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d98191-7d59-4965-9e6e-212c9c2f5ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:56.745590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d98191-7d59-4965-9e6e-212c9c2f5ddb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:56.745924 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d98191-7d59-4965-9e6e-212c9c2f5ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:56.746433 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d98191-7d59-4965-9e6e-212c9c2f5ddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:56.811408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb68a83-7fa4-430a-9941-c9f9373dc6c7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:56.823950 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d98191-7d59-4965-9e6e-212c9c2f5ddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:56.826160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d98191-7d59-4965-9e6e-212c9c2f5ddb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:56.845225 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc25108-097b-4476-96ef-81b86c34a410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:56.845862 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc25108-097b-4476-96ef-81b86c34a410 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:56.846145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc25108-097b-4476-96ef-81b86c34a410 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:56.846419 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc25108-097b-4476-96ef-81b86c34a410 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:56.856961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc25108-097b-4476-96ef-81b86c34a410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:56.861825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-5fc25108-097b-4476-96ef-81b86c34a410 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:56.861825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:56.861825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:56.861825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:56.861825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:56.861825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:56.861825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:56.861825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:56.861825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:56.861825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:56.861825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:56.861825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:56.861825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:56.861825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:56.861825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:56.861825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:56.862672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:56.862672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:56.862672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:56.862672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:56.862672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:56.862672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:56.862672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:56.862672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:56.862672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:56.862672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:56.862672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:56.862672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:56.862672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:56.862672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:56.862672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:56.862672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:56.863453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:56.863453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:56.863453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:56.863453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:56.863453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:56.863453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:56.863453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:56.863453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:56.863453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:56.863453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:56.863453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 09 20:42:56.863453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:42:56.863453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 225/440] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:42:56.868780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc25108-097b-4476-96ef-81b86c34a410 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:56.913868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:56.924448 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:56.935495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 216/441] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:56.936360 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d98191-7d59-4965-9e6e-212c9c2f5ddb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:56.980297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc25108-097b-4476-96ef-81b86c34a410 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:57.015557 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adb2e5-4763-4e7c-90d1-187644e06198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:57.016329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adb2e5-4763-4e7c-90d1-187644e06198 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:57.016603 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adb2e5-4763-4e7c-90d1-187644e06198 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:57.016869 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adb2e5-4763-4e7c-90d1-187644e06198 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:57.017523 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19adb2e5-4763-4e7c-90d1-187644e06198 None admin] RBAC: Adding query filter params (name=member) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:57.017820 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19adb2e5-4763-4e7c-90d1-187644e06198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:57.019195 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19adb2e5-4763-4e7c-90d1-187644e06198 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:57.027533 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 226/442] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:42:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:57.028332 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adb2e5-4763-4e7c-90d1-187644e06198 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:57.037755 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d98191-7d59-4965-9e6e-212c9c2f5ddb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:57.071551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de45de-9758-4e35-adee-b35af9937440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:57.072131 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de45de-9758-4e35-adee-b35af9937440 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:57.072410 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de45de-9758-4e35-adee-b35af9937440 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:57.072681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de45de-9758-4e35-adee-b35af9937440 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:57.083559 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de45de-9758-4e35-adee-b35af9937440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:42:57.088526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b4de45de-9758-4e35-adee-b35af9937440 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:42:57.088526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:42:57.088526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:42:57.088526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:42:57.088526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:42:57.088526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:42:57.088526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:42:57.088526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:42:57.088526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:42:57.088526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:42:57.088526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:42:57.088526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:42:57.088526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:42:57.088526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:42:57.088526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:42:57.088526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:42:57.089409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:42:57.089409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:42:57.089409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:42:57.089409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:42:57.089409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:42:57.089409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:42:57.089409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:42:57.089409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:42:57.089409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:42:57.089409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:42:57.089409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:42:57.089409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:42:57.089409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:42:57.089409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:42:57.089409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:42:57.089409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:42:57.090175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:42:57.090175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:42:57.090175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:42:57.090175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:42:57.090175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:42:57.090175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:42:57.090175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:42:57.090175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:42:57.090175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:42:57.090175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:42:57.090175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:42:57.090175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:42:57.095092 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 217/443] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:42:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:42:57.095819 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de45de-9758-4e35-adee-b35af9937440 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:57.129295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adb2e5-4763-4e7c-90d1-187644e06198 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:57.136003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:57.138400 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:57.165792 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ffb07-2541-43e9-9d56-5eb2957d5812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:57.166422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ffb07-2541-43e9-9d56-5eb2957d5812 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:57.166700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ffb07-2541-43e9-9d56-5eb2957d5812 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:57.166975 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ffb07-2541-43e9-9d56-5eb2957d5812 None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:57.168153 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ffb07-2541-43e9-9d56-5eb2957d5812 None admin] RBAC: Authorizing `identity:get_project(project_id=e415362e3ec14b99be6122313166eaaa)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:57.169574 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ffb07-2541-43e9-9d56-5eb2957d5812 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:57.171216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 227/444] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:57 2022] GET /identity/v3/projects/e415362e3ec14b99be6122313166eaaa => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:57.171979 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ffb07-2541-43e9-9d56-5eb2957d5812 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:57.200839 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de45de-9758-4e35-adee-b35af9937440 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:57.235529 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddd029-418a-433c-b59f-6eefc936aed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:57.236345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddd029-418a-433c-b59f-6eefc936aed2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:57.236743 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddd029-418a-433c-b59f-6eefc936aed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:57.237144 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ddd029-418a-433c-b59f-6eefc936aed2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:57.268229 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ffb07-2541-43e9-9d56-5eb2957d5812 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:57.302872 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e1146-7bbd-40b4-89b7-4ab9175b44cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:57.303491 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e1146-7bbd-40b4-89b7-4ab9175b44cf None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:57.303778 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e1146-7bbd-40b4-89b7-4ab9175b44cf None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:57.304075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e1146-7bbd-40b4-89b7-4ab9175b44cf None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:57.304744 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e1146-7bbd-40b4-89b7-4ab9175b44cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:57.305363 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e1146-7bbd-40b4-89b7-4ab9175b44cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:57.306418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7e1146-7bbd-40b4-89b7-4ab9175b44cf None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:57.307562 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddd029-418a-433c-b59f-6eefc936aed2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:57.309026 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ddd029-418a-433c-b59f-6eefc936aed2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:57.315207 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 228/445] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:42:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:57.316440 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e1146-7bbd-40b4-89b7-4ab9175b44cf None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:57.352583 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:57.358407 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:57.410872 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 218/446] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:57.411795 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddd029-418a-433c-b59f-6eefc936aed2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:57.427835 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7e1146-7bbd-40b4-89b7-4ab9175b44cf None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:57.461843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bded5-1434-4d11-ac48-1c69834dbe3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:57.462479 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bded5-1434-4d11-ac48-1c69834dbe3e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:57.462756 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bded5-1434-4d11-ac48-1c69834dbe3e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:57.463029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bded5-1434-4d11-ac48-1c69834dbe3e None admin] PATH_INFO: `/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:57.464184 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bded5-1434-4d11-ac48-1c69834dbe3e None admin] RBAC: Authorizing `identity:get_group(group_id=56f2cd5979dd4d80ba84d3e8189f7601)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:57.465620 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bded5-1434-4d11-ac48-1c69834dbe3e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:57.467468 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 229/447] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Sep 9 20:42:57 2022] GET /identity/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:57.468809 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bded5-1434-4d11-ac48-1c69834dbe3e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:57.514019 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ddd029-418a-433c-b59f-6eefc936aed2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:57.548381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509dfc4-932f-44e7-85cb-4bd227bab72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:57.548992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509dfc4-932f-44e7-85cb-4bd227bab72e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:57.549268 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509dfc4-932f-44e7-85cb-4bd227bab72e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:57.549541 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c509dfc4-932f-44e7-85cb-4bd227bab72e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:57.561381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:57.567180 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bded5-1434-4d11-ac48-1c69834dbe3e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:57.569459 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:57.600621 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7034bf0-cc91-40a1-859d-c7deff8cb898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:57.601246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7034bf0-cc91-40a1-859d-c7deff8cb898 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:57.601525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7034bf0-cc91-40a1-859d-c7deff8cb898 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:57.601797 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7034bf0-cc91-40a1-859d-c7deff8cb898 None admin] PATH_INFO: `/v3/projects/e415362e3ec14b99be6122313166eaaa` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:57.602968 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7034bf0-cc91-40a1-859d-c7deff8cb898 None admin] RBAC: Authorizing `identity:get_project(project_id=e415362e3ec14b99be6122313166eaaa)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:57.604380 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7034bf0-cc91-40a1-859d-c7deff8cb898 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:57.606081 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 230/448] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:57 2022] GET /identity/v3/projects/e415362e3ec14b99be6122313166eaaa => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:57.606742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7034bf0-cc91-40a1-859d-c7deff8cb898 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:57.621481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509dfc4-932f-44e7-85cb-4bd227bab72e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:57.622969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c509dfc4-932f-44e7-85cb-4bd227bab72e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:57.712386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7034bf0-cc91-40a1-859d-c7deff8cb898 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:57.719923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 219/449] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:42:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:42:57.720776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509dfc4-932f-44e7-85cb-4bd227bab72e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:57.749982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b5bef-4088-4efd-9a90-50d240013d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:57.750574 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b5bef-4088-4efd-9a90-50d240013d24 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:57.750893 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b5bef-4088-4efd-9a90-50d240013d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:57.751175 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b5bef-4088-4efd-9a90-50d240013d24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:57.751891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b5bef-4088-4efd-9a90-50d240013d24 None admin] RBAC: Adding query filter params (group.id=56f2cd5979dd4d80ba84d3e8189f7601, role.id=d9c09fde9a114c2fa299455f8298db09, scope.project.id=e415362e3ec14b99be6122313166eaaa) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:57.752228 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b5bef-4088-4efd-9a90-50d240013d24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:57.753652 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b5bef-4088-4efd-9a90-50d240013d24 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:57.759270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 231/450] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Sep 9 20:42:57 2022] GET /identity/v3/role_assignments?group.id=56f2cd5979dd4d80ba84d3e8189f7601&scope.project.id=e415362e3ec14b99be6122313166eaaa&role.id=d9c09fde9a114c2fa299455f8298db09 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:57.760070 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b5bef-4088-4efd-9a90-50d240013d24 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:57.767541 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:57.805884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:57.836709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c509dfc4-932f-44e7-85cb-4bd227bab72e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:57.875927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb17e22-233d-4080-9bc1-3d20105c8427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:57.876861 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb17e22-233d-4080-9bc1-3d20105c8427 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:57.877428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb17e22-233d-4080-9bc1-3d20105c8427 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:57.877712 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb17e22-233d-4080-9bc1-3d20105c8427 None admin] PATH_INFO: `/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:57.879115 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb17e22-233d-4080-9bc1-3d20105c8427 None admin] RBAC: Authorizing `identity:get_group(group_id=56f2cd5979dd4d80ba84d3e8189f7601)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:57.881135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb17e22-233d-4080-9bc1-3d20105c8427 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:57.882023 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b5bef-4088-4efd-9a90-50d240013d24 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:57.882948 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 220/451] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Sep 9 20:42:57 2022] GET /identity/v3/groups/56f2cd5979dd4d80ba84d3e8189f7601 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:57.889064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb17e22-233d-4080-9bc1-3d20105c8427 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:57.921617 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cc6b1-4780-451c-8406-4b79b1f474c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:57.922270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cc6b1-4780-451c-8406-4b79b1f474c6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:57.922558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cc6b1-4780-451c-8406-4b79b1f474c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:57.922832 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7cc6b1-4780-451c-8406-4b79b1f474c6 None admin] PATH_INFO: `/v3/projects/36e4c2d50d8d40f5b9937dbb73fb973f` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:57.924036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cc6b1-4780-451c-8406-4b79b1f474c6 None admin] RBAC: Authorizing `identity:get_project(project_id=36e4c2d50d8d40f5b9937dbb73fb973f)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:57.925488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7cc6b1-4780-451c-8406-4b79b1f474c6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:57.927172 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 232/452] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:42:57 2022] GET /identity/v3/projects/36e4c2d50d8d40f5b9937dbb73fb973f => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:42:57.932781 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cc6b1-4780-451c-8406-4b79b1f474c6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:58.007289 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb17e22-233d-4080-9bc1-3d20105c8427 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:58.019597 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:58.043165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7cc6b1-4780-451c-8406-4b79b1f474c6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:58.044178 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f77466-b462-4226-a459-ac530e47e6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:58.044781 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f77466-b462-4226-a459-ac530e47e6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:58.045059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f77466-b462-4226-a459-ac530e47e6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:58.045332 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f77466-b462-4226-a459-ac530e47e6a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:58.045500 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:42:58.046152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f77466-b462-4226-a459-ac530e47e6a9 None admin] RBAC: Adding query filter params (group.id=56f2cd5979dd4d80ba84d3e8189f7601, role.id=c726a7153e6e47a3aa35a96221eb3d78, scope.project.id=e415362e3ec14b99be6122313166eaaa) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:58.046452 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f77466-b462-4226-a459-ac530e47e6a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:58.047944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f77466-b462-4226-a459-ac530e47e6a9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:58.053797 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 221/453] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Sep 9 20:42:57 2022] GET /identity/v3/role_assignments?group.id=56f2cd5979dd4d80ba84d3e8189f7601&scope.project.id=e415362e3ec14b99be6122313166eaaa&role.id=c726a7153e6e47a3aa35a96221eb3d78 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:58.079649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a61f3-abb3-4a15-93be-b5e468875459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:58.080338 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a61f3-abb3-4a15-93be-b5e468875459 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:58.080620 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a61f3-abb3-4a15-93be-b5e468875459 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:58.080895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a61f3-abb3-4a15-93be-b5e468875459 None admin] PATH_INFO: `/v3/groups/37adaadaaae649529b8eeda3118178c6` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:58.082103 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a61f3-abb3-4a15-93be-b5e468875459 None admin] RBAC: Authorizing `identity:get_group(group_id=37adaadaaae649529b8eeda3118178c6)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:58.083608 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a61f3-abb3-4a15-93be-b5e468875459 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:58.085308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 233/454] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Sep 9 20:42:57 2022] GET /identity/v3/groups/37adaadaaae649529b8eeda3118178c6 => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:42:58.091578 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f77466-b462-4226-a459-ac530e47e6a9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:42:58.197766 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f77466-b462-4226-a459-ac530e47e6a9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:42:58.232993 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da57a50-50d3-4333-a3f6-be2bcbc92ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:42:58.233792 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da57a50-50d3-4333-a3f6-be2bcbc92ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:42:58.234302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da57a50-50d3-4333-a3f6-be2bcbc92ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:42:58.234622 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da57a50-50d3-4333-a3f6-be2bcbc92ba3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:42:58.235347 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da57a50-50d3-4333-a3f6-be2bcbc92ba3 None admin] RBAC: Adding query filter params (group.id=37adaadaaae649529b8eeda3118178c6, role.id=be620fc7968740269d233c5ace94a563, scope.project.id=36e4c2d50d8d40f5b9937dbb73fb973f) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:42:58.235655 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da57a50-50d3-4333-a3f6-be2bcbc92ba3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:42:58.237152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da57a50-50d3-4333-a3f6-be2bcbc92ba3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:42:58.243066 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 222/455] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Sep 9 20:42:58 2022] GET /identity/v3/role_assignments?group.id=37adaadaaae649529b8eeda3118178c6&scope.project.id=36e4c2d50d8d40f5b9937dbb73fb973f&role.id=be620fc7968740269d233c5ace94a563 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:01.043608 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dff1e-8ac5-48e4-a1f8-1bc0fe80c9f9 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:01.044626 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dff1e-8ac5-48e4-a1f8-1bc0fe80c9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:01.045132 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9dff1e-8ac5-48e4-a1f8-1bc0fe80c9f9 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:01.046944 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 234/456] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:01.052184 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76d798-2efd-4a2e-868e-c372c2aa3db0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:01.053011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76d798-2efd-4a2e-868e-c372c2aa3db0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:01.053482 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76d798-2efd-4a2e-868e-c372c2aa3db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:01.076927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0a76d798-2efd-4a2e-868e-c372c2aa3db0 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:01.079041 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0a76d798-2efd-4a2e-868e-c372c2aa3db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:01.112776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:01.161008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 223/457] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:01.273745 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52800bfc-7a99-4cca-815a-63ab93a1c1e8 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:01.274369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52800bfc-7a99-4cca-815a-63ab93a1c1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:01.274890 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52800bfc-7a99-4cca-815a-63ab93a1c1e8 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:01.277145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 235/458] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:01.282757 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314a9a9-8ac9-4a3f-b802-43921f85fb90 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:01.283303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314a9a9-8ac9-4a3f-b802-43921f85fb90 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:01.283781 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314a9a9-8ac9-4a3f-b802-43921f85fb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:01.310101 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4314a9a9-8ac9-4a3f-b802-43921f85fb90 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:01.311315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4314a9a9-8ac9-4a3f-b802-43921f85fb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:01.346402 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6a7f0-6e43-4479-8383-5240d81ac2e5 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:01.347030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6a7f0-6e43-4479-8383-5240d81ac2e5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:01.347508 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6a7f0-6e43-4479-8383-5240d81ac2e5 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:01.349367 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 236/459] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:01.354038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bf5cb-3381-4777-8084-3a800abb9f2e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:01.354553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bf5cb-3381-4777-8084-3a800abb9f2e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:01.355029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bf5cb-3381-4777-8084-3a800abb9f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:01.389016 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7e1bf5cb-3381-4777-8084-3a800abb9f2e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:01.390753 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7e1bf5cb-3381-4777-8084-3a800abb9f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:01.397581 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 224/460] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:01.482260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 237/461] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:43:01.630955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314a9a9-8ac9-4a3f-b802-43921f85fb90 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:01.749869 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bf5cb-3381-4777-8084-3a800abb9f2e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:01.756783 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:01.764017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314a9a9-8ac9-4a3f-b802-43921f85fb90 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:01.811546 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f93bd-5d98-4d6c-a289-24f4bbd27f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:01.813339 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f93bd-5d98-4d6c-a289-24f4bbd27f4d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:01.813776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f93bd-5d98-4d6c-a289-24f4bbd27f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:01.814053 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f93bd-5d98-4d6c-a289-24f4bbd27f4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:01.825716 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f93bd-5d98-4d6c-a289-24f4bbd27f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:01.827921 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f93bd-5d98-4d6c-a289-24f4bbd27f4d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:01.845868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-cf7f93bd-5d98-4d6c-a289-24f4bbd27f4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:01.845868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:01.845868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:01.845868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:01.845868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:01.845868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:01.845868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:01.845868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:01.845868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:01.845868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:01.845868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:01.845868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:01.845868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:01.845868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:01.845868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:01.845868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:01.846996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:01.846996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:01.846996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:01.846996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:01.846996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:01.846996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:01.846996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:01.846996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:01.846996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:01.846996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:01.846996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:01.846996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:01.846996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:01.846996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:01.846996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:01.846996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:01.846996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:01.848039 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:01.848039 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:01.848039 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:01.848039 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 225/462] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:01.848318 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f93bd-5d98-4d6c-a289-24f4bbd27f4d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:01.899730 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1bf5cb-3381-4777-8084-3a800abb9f2e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:01.901960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:01.943072 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103a517-d27f-41f7-8265-abfcfcf3bc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:01.943447 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103a517-d27f-41f7-8265-abfcfcf3bc58 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:01.943708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103a517-d27f-41f7-8265-abfcfcf3bc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:01.944000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103a517-d27f-41f7-8265-abfcfcf3bc58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:01.954885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103a517-d27f-41f7-8265-abfcfcf3bc58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:01.956594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103a517-d27f-41f7-8265-abfcfcf3bc58 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:01.963615 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f93bd-5d98-4d6c-a289-24f4bbd27f4d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:01.971318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-1103a517-d27f-41f7-8265-abfcfcf3bc58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:01.971318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:01.971318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:01.971318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:01.971318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:01.971318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:01.971318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:01.971318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:01.971318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:01.971318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:01.971318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:01.971318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:01.971318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:01.971318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:01.971318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:01.971318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:01.972345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:01.972345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:01.972345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:01.972345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:01.972345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:01.972345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:01.972345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:01.972345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:01.972345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:01.972345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:01.972345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:01.972345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:01.972345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:01.972345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:01.972345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:01.972345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:01.972345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:01.973169 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:01.973169 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:01.973169 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:01.973169 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 238/463] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:01.974132 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103a517-d27f-41f7-8265-abfcfcf3bc58 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:02.005738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e8470-740d-4c66-a69e-15bc8ecdd3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:02.006715 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e8470-740d-4c66-a69e-15bc8ecdd3ff None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:02.007198 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e8470-740d-4c66-a69e-15bc8ecdd3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:02.007699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e8470-740d-4c66-a69e-15bc8ecdd3ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:02.020064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e8470-740d-4c66-a69e-15bc8ecdd3ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:02.021744 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e8470-740d-4c66-a69e-15bc8ecdd3ff None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:02.039575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-013e8470-740d-4c66-a69e-15bc8ecdd3ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:02.039575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:02.039575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:02.039575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:02.039575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:02.039575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:02.039575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:02.039575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:02.039575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:02.039575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:02.039575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:02.039575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:02.039575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:02.039575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:02.039575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:02.039575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:02.040718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:02.040718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:02.040718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:02.040718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:02.040718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:02.040718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:02.040718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:02.040718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:02.040718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:02.040718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:02.040718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:02.040718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:02.040718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:02.040718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:02.040718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:02.040718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:02.040718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:02.047882 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:02.047882 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:02.047882 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:02.047882 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 226/464] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:02.047882 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe60163-3d93-4d36-a0a4-859b46560eb7 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:02.047882 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe60163-3d93-4d36-a0a4-859b46560eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:02.047882 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe60163-3d93-4d36-a0a4-859b46560eb7 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:02.048911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 227/465] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:02.048911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe60163-3d93-4d36-a0a4-859b46560eb7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:02.051831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:02.082405 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103a517-d27f-41f7-8265-abfcfcf3bc58 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:02.120884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e1175-525f-442b-bbba-5ae860ca28f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:02.121746 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e1175-525f-442b-bbba-5ae860ca28f7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:02.122019 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e1175-525f-442b-bbba-5ae860ca28f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:02.122296 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e1175-525f-442b-bbba-5ae860ca28f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:02.122923 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e1175-525f-442b-bbba-5ae860ca28f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:02.123220 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e1175-525f-442b-bbba-5ae860ca28f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:02.126718 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e1175-525f-442b-bbba-5ae860ca28f7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:02.144365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 239/466] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:02.145542 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e1175-525f-442b-bbba-5ae860ca28f7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:02.162029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:02.163832 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe60163-3d93-4d36-a0a4-859b46560eb7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:02.205459 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed23742-a8e7-474e-8bb5-73df4d9f4f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:02.206305 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed23742-a8e7-474e-8bb5-73df4d9f4f94 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:02.206768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed23742-a8e7-474e-8bb5-73df4d9f4f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:02.207049 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed23742-a8e7-474e-8bb5-73df4d9f4f94 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:02.207694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed23742-a8e7-474e-8bb5-73df4d9f4f94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:02.208017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed23742-a8e7-474e-8bb5-73df4d9f4f94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:02.209422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed23742-a8e7-474e-8bb5-73df4d9f4f94 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:02.226705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 228/467] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:02.227925 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd53db-6a1e-410b-b864-a936fdb36f8e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:02.228241 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd53db-6a1e-410b-b864-a936fdb36f8e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:02.228517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd53db-6a1e-410b-b864-a936fdb36f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:02.247032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7bcd53db-6a1e-410b-b864-a936fdb36f8e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:02.248351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7bcd53db-6a1e-410b-b864-a936fdb36f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:02.255950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e1175-525f-442b-bbba-5ae860ca28f7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:02.299235 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa4b0c-9de8-452a-bdf2-4d6e11111836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:02.299859 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa4b0c-9de8-452a-bdf2-4d6e11111836 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:02.300165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa4b0c-9de8-452a-bdf2-4d6e11111836 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:02.300412 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa4b0c-9de8-452a-bdf2-4d6e11111836 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:02.301053 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa4b0c-9de8-452a-bdf2-4d6e11111836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:02.301352 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa4b0c-9de8-452a-bdf2-4d6e11111836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:02.305814 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa4b0c-9de8-452a-bdf2-4d6e11111836 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:02.317609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 240/468] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:02.318361 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:02.322820 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa4b0c-9de8-452a-bdf2-4d6e11111836 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:02.340016 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 229/469] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:02.340016 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd53db-6a1e-410b-b864-a936fdb36f8e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:02.433998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:02.460852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa4b0c-9de8-452a-bdf2-4d6e11111836 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:02.467537 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd53db-6a1e-410b-b864-a936fdb36f8e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:02.496446 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e83f46-0280-4a40-9480-a1e67667fb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:02.497170 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e83f46-0280-4a40-9480-a1e67667fb0d None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:02.497417 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e83f46-0280-4a40-9480-a1e67667fb0d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:02.497613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e83f46-0280-4a40-9480-a1e67667fb0d None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:02.498320 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e83f46-0280-4a40-9480-a1e67667fb0d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:02.499899 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e83f46-0280-4a40-9480-a1e67667fb0d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:02.512471 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8867a1-50c3-493e-aa80-c254204593a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:02.513195 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8867a1-50c3-493e-aa80-c254204593a9 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:02.513499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8867a1-50c3-493e-aa80-c254204593a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:02.514298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8867a1-50c3-493e-aa80-c254204593a9 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:02.515179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8867a1-50c3-493e-aa80-c254204593a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:02.516907 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8867a1-50c3-493e-aa80-c254204593a9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:02.524105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 241/470] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Sep 9 20:43:02 2022] POST /identity/v3/users => generated 246 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:43:02.524105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e83f46-0280-4a40-9480-a1e67667fb0d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:02.548876 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 230/471] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Sep 9 20:43:02 2022] POST /identity/v3/users => generated 248 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:43:02.550425 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d39816-f7b4-43f6-b283-1f92303acc65 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:02.550769 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d39816-f7b4-43f6-b283-1f92303acc65 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:02.551094 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d39816-f7b4-43f6-b283-1f92303acc65 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:02.552888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 231/472] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:02.566051 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9219b-6883-4108-9f35-a7104f4ca1d1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:02.566384 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9219b-6883-4108-9f35-a7104f4ca1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:02.566603 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9219b-6883-4108-9f35-a7104f4ca1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:02.600203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-12f9219b-6883-4108-9f35-a7104f4ca1d1 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:02.601625 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-12f9219b-6883-4108-9f35-a7104f4ca1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:02.661853 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:02.663100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e83f46-0280-4a40-9480-a1e67667fb0d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:02.701040 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 232/473] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:02.701923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9219b-6883-4108-9f35-a7104f4ca1d1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:02.708620 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a2fac-c6eb-4072-ab66-23b17c381be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:02.709695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a2fac-c6eb-4072-ab66-23b17c381be3 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:02.710177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a2fac-c6eb-4072-ab66-23b17c381be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:02.710675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a2fac-c6eb-4072-ab66-23b17c381be3 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:02.711545 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a2fac-c6eb-4072-ab66-23b17c381be3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:02.713395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a2fac-c6eb-4072-ab66-23b17c381be3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:02.716765 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:02.765678 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 242/474] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Sep 9 20:43:02 2022] POST /identity/v3/users => generated 248 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:43:02.852367 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9219b-6883-4108-9f35-a7104f4ca1d1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:02.898647 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76a75f-120e-4f47-b468-4e4b109d80ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:02.899354 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76a75f-120e-4f47-b468-4e4b109d80ec None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:02.899639 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76a75f-120e-4f47-b468-4e4b109d80ec None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:02.900012 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76a75f-120e-4f47-b468-4e4b109d80ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:02.912668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76a75f-120e-4f47-b468-4e4b109d80ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:02.914173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76a75f-120e-4f47-b468-4e4b109d80ec None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:02.931430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-1f76a75f-120e-4f47-b468-4e4b109d80ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:02.931430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:02.931430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:02.931430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:02.931430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:02.931430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:02.931430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:02.931430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:02.931430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:02.931430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:02.931430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:02.931430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:02.931430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:02.931430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:02.931430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:02.931430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:02.932634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:02.932634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:02.932634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:02.932634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:02.932634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:02.932634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:02.932634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:02.932634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:02.932634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:02.932634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:02.932634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:02.932634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:02.932634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:02.932634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:02.932634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:02.932634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:02.932634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:02.933763 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:02.933763 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:02.933763 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:02.933763 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 233/475] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:02.941126 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a2fac-c6eb-4072-ab66-23b17c381be3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:03.024506 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76a75f-120e-4f47-b468-4e4b109d80ec None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:03.057744 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a2fac-c6eb-4072-ab66-23b17c381be3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:03.072571 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:03.097196 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d4b6b-b44f-4d83-8085-51deaf39d2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:03.097721 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d4b6b-b44f-4d83-8085-51deaf39d2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:03.097945 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d4b6b-b44f-4d83-8085-51deaf39d2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:03.098235 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d4b6b-b44f-4d83-8085-51deaf39d2d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:03.098883 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d4b6b-b44f-4d83-8085-51deaf39d2d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:03.099191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d4b6b-b44f-4d83-8085-51deaf39d2d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:03.100609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d4b6b-b44f-4d83-8085-51deaf39d2d3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:03.114831 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 243/476] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:03.120236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d4b6b-b44f-4d83-8085-51deaf39d2d3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:03.167328 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76a75f-120e-4f47-b468-4e4b109d80ec None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:03.180377 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:03.225245 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ab486-6833-43bf-aae8-3b8949ad02ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:03.226190 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ab486-6833-43bf-aae8-3b8949ad02ad None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:03.226653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ab486-6833-43bf-aae8-3b8949ad02ad None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:03.227109 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ab486-6833-43bf-aae8-3b8949ad02ad None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:03.228094 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ab486-6833-43bf-aae8-3b8949ad02ad None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:03.229713 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ab486-6833-43bf-aae8-3b8949ad02ad None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:03.237772 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.sql.core [None req-1f3ab486-6833-43bf-aae8-3b8949ad02ad None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 20:43:03.237772 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 09 20:43:03.237772 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [parameters: {'id': '8cce718a7eb84e44b53c257cb7d83d2b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 09 20:43:03.237772 dv-cinder-831247-28-smb devstack@keystone.service[81398]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81398) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 20:43:03.250551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d4b6b-b44f-4d83-8085-51deaf39d2d3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:03.259280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-1f3ab486-6833-43bf-aae8-3b8949ad02ad None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 09 20:43:03.259280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:03.259280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 20:43:03.259280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 20:43:03.259280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 20:43:03.259280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 20:43:03.259280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 20:43:03.259280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 20:43:03.259280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 20:43:03.259280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application conn.query(q) Sep 09 20:43:03.259280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 20:43:03.259280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 20:43:03.259280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 20:43:03.259280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result.read() Sep 09 20:43:03.259280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 20:43:03.260845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 20:43:03.260845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 20:43:03.260845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 20:43:03.260845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 20:43:03.260845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 20:43:03.260845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 20:43:03.260845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 20:43:03.260845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 20:43:03.260845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:03.260845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 20:43:03.260845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:03.260845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:03.260845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 20:43:03.260845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 20:43:03.260845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 09 20:43:03.260845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return ref.to_dict() Sep 09 20:43:03.260845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 20:43:03.260845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application next(self.gen) Sep 09 20:43:03.261756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 20:43:03.261756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application yield resource Sep 09 20:43:03.261756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 20:43:03.261756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application next(self.gen) Sep 09 20:43:03.261756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 20:43:03.261756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 20:43:03.261756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 20:43:03.261756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 20:43:03.261756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 20:43:03.261756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise self.value Sep 09 20:43:03.261756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 20:43:03.261756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 20:43:03.261756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 20:43:03.261756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application session.commit() Sep 09 20:43:03.261756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 20:43:03.261756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 20:43:03.261756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 20:43:03.262584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 20:43:03.262584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 20:43:03.262584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.session.flush() Sep 09 20:43:03.262584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 20:43:03.262584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 20:43:03.262584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 20:43:03.262584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 20:43:03.262584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 20:43:03.262584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application compat.raise_( Sep 09 20:43:03.262584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 20:43:03.262584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception Sep 09 20:43:03.262584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 20:43:03.262584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 20:43:03.262584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 20:43:03.262584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 20:43:03.262584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 20:43:03.262584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 20:43:03.263394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 20:43:03.263394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 20:43:03.263394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 09 20:43:03.263394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 09 20:43:03.263394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 20:43:03.263394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 20:43:03.263394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 20:43:03.263394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 20:43:03.263394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 20:43:03.263394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 20:43:03.263394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 20:43:03.263394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 20:43:03.263394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 20:43:03.263394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 20:43:03.263394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 20:43:03.263394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception Sep 09 20:43:03.264249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 20:43:03.264249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 20:43:03.264249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 20:43:03.264249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 20:43:03.264249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 20:43:03.264249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 20:43:03.264249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 20:43:03.264249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application conn.query(q) Sep 09 20:43:03.264249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 20:43:03.264249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 20:43:03.264249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 20:43:03.264249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result.read() Sep 09 20:43:03.264249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 20:43:03.264249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 20:43:03.264249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 20:43:03.264249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 20:43:03.270351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 20:43:03.270351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 20:43:03.270351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 20:43:03.270351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 20:43:03.270351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 09 20:43:03.270351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 09 20:43:03.270351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [parameters: {'id': '8cce718a7eb84e44b53c257cb7d83d2b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 09 20:43:03.270351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 20:43:03.270351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:03.270351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:43:03.270351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:03.270351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:03.270351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:03.270351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:03.270351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:03.270351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:03.272552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:03.272552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:03.272552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:03.272552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:03.272552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:03.272552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:03.272552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 09 20:43:03.272552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 09 20:43:03.272552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:03.272552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:03.272552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 09 20:43:03.272552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 09 20:43:03.272552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 20:43:03.272552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 20:43:03.272552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 09 20:43:03.272552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:03.274916 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 234/477] 10.222.0.15 () {60 vars in 1131 bytes} [Fri Sep 9 20:43:03 2022] POST /identity/v3/roles => generated 144 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:03.274916 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ab486-6833-43bf-aae8-3b8949ad02ad None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:03.323185 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac00773-13d8-467f-8fc2-82782bd2061b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:03.323810 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac00773-13d8-467f-8fc2-82782bd2061b None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:03.324116 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac00773-13d8-467f-8fc2-82782bd2061b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:03.324392 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac00773-13d8-467f-8fc2-82782bd2061b None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:03.325046 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac00773-13d8-467f-8fc2-82782bd2061b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:03.331194 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac00773-13d8-467f-8fc2-82782bd2061b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:03.371351 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 244/478] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Sep 9 20:43:03 2022] POST /identity/v3/users => generated 249 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:43:03.431512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:03.441764 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ab486-6833-43bf-aae8-3b8949ad02ad None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:03.491145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51999177-5c3e-4a4f-b165-1463c7f87857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:03.491877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51999177-5c3e-4a4f-b165-1463c7f87857 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:03.492185 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51999177-5c3e-4a4f-b165-1463c7f87857 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:03.492460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51999177-5c3e-4a4f-b165-1463c7f87857 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:03.511513 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51999177-5c3e-4a4f-b165-1463c7f87857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:03.517957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-51999177-5c3e-4a4f-b165-1463c7f87857 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:43:03.517957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:03.517957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:03.517957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:03.517957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:03.517957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:03.517957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:03.517957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:03.517957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:03.517957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:03.517957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:03.517957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:03.517957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:03.517957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:03.517957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:03.517957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:03.518892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:03.518892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:03.518892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:03.518892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:03.518892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:03.518892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:03.518892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:03.518892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:03.518892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:03.518892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:03.518892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:03.518892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:03.518892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:03.518892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:03.518892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:03.518892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:03.519709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:03.519709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:03.519709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:03.519709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:03.519709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:03.519709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:03.519709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:03.519709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:03.519709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:03.519709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:03.519709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 09 20:43:03.519709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:03.519709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 235/479] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:43:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:03.525100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac00773-13d8-467f-8fc2-82782bd2061b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:03.663386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac00773-13d8-467f-8fc2-82782bd2061b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:03.665275 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:03.704398 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0f20d-f39e-48c5-8645-f4e24c137425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:03.705374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0f20d-f39e-48c5-8645-f4e24c137425 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:03.705847 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0f20d-f39e-48c5-8645-f4e24c137425 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:03.706312 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0f20d-f39e-48c5-8645-f4e24c137425 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:03.707175 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0f20d-f39e-48c5-8645-f4e24c137425 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:03.707697 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0f20d-f39e-48c5-8645-f4e24c137425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:03.709266 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0f20d-f39e-48c5-8645-f4e24c137425 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:03.718641 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 245/480] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:05.380022 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f40b1-8c77-4f79-9c39-a66ae39bd8da None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:05.380555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f40b1-8c77-4f79-9c39-a66ae39bd8da None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:05.380555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f40b1-8c77-4f79-9c39-a66ae39bd8da None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:05.382176 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 236/481] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:05.387247 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331a8c6-43a8-4f2c-8fae-0052f98d0da5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:05.388034 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331a8c6-43a8-4f2c-8fae-0052f98d0da5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:05.388518 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331a8c6-43a8-4f2c-8fae-0052f98d0da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:05.413170 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b331a8c6-43a8-4f2c-8fae-0052f98d0da5 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:05.414784 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b331a8c6-43a8-4f2c-8fae-0052f98d0da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:05.445824 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89942d3-d5d4-4c41-9443-90e621b7e731 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:05.446144 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89942d3-d5d4-4c41-9443-90e621b7e731 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:05.446406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89942d3-d5d4-4c41-9443-90e621b7e731 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:05.448018 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 237/482] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:05.454182 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab0030-63d2-4efc-b28a-be97d5413344 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:05.454468 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab0030-63d2-4efc-b28a-be97d5413344 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:05.454752 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab0030-63d2-4efc-b28a-be97d5413344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:05.476075 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-40ab0030-63d2-4efc-b28a-be97d5413344 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:05.477422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-40ab0030-63d2-4efc-b28a-be97d5413344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:05.540730 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 246/483] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:05.581643 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 238/484] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:05.585579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c320ba-0e7e-4d8b-96bb-72e552daf25d None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:05.585861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c320ba-0e7e-4d8b-96bb-72e552daf25d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:05.586132 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c320ba-0e7e-4d8b-96bb-72e552daf25d None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:05.587563 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 247/485] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:05.593426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7f661-4b5c-40d8-8985-65ad4518a0f1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:05.593715 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7f661-4b5c-40d8-8985-65ad4518a0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:05.593988 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7f661-4b5c-40d8-8985-65ad4518a0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:05.614724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-28f7f661-4b5c-40d8-8985-65ad4518a0f1 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:05.615925 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-28f7f661-4b5c-40d8-8985-65ad4518a0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:05.693635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 239/486] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:05.909937 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c320ba-0e7e-4d8b-96bb-72e552daf25d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:06.030018 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:06.040155 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c320ba-0e7e-4d8b-96bb-72e552daf25d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:06.072121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7f661-4b5c-40d8-8985-65ad4518a0f1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:06.087087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a6c66-ae70-4faf-b39d-1c31bac51ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:06.087787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a6c66-ae70-4faf-b39d-1c31bac51ded None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:06.088088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a6c66-ae70-4faf-b39d-1c31bac51ded None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:06.088361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a6c66-ae70-4faf-b39d-1c31bac51ded None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:06.100470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a6c66-ae70-4faf-b39d-1c31bac51ded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:06.105208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-136a6c66-ae70-4faf-b39d-1c31bac51ded None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:06.105208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:06.105208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:06.105208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:06.105208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:06.105208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:06.105208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:06.105208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:06.105208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:06.105208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:06.105208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:06.105208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:06.105208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:06.105208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:06.105208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:06.105208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:06.106127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:06.106127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:06.106127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:06.106127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:06.106127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:06.106127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:06.106127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:06.106127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:06.106127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:06.106127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:06.106127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:06.106127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:06.106127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:06.106127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:06.106127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:06.106127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:06.106912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:06.106912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:06.106912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:06.106912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:06.106912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:06.106912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:06.106912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:06.106912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:06.106912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:06.106912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:06.106912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:06.106912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:06.106912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 248/487] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:43:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:06.108552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:06.111650 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a6c66-ae70-4faf-b39d-1c31bac51ded None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:06.219937 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7f661-4b5c-40d8-8985-65ad4518a0f1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:06.224836 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a6c66-ae70-4faf-b39d-1c31bac51ded None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:06.256532 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827e2d-d52f-4e95-8ffd-38477ecfc23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:06.257165 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827e2d-d52f-4e95-8ffd-38477ecfc23c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:06.257446 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827e2d-d52f-4e95-8ffd-38477ecfc23c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:06.257806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827e2d-d52f-4e95-8ffd-38477ecfc23c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:06.267713 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b147cfe-e463-4868-96ee-a03e3ed2924f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:06.268384 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b147cfe-e463-4868-96ee-a03e3ed2924f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:06.268677 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b147cfe-e463-4868-96ee-a03e3ed2924f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:06.268932 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b147cfe-e463-4868-96ee-a03e3ed2924f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:06.269151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21827e2d-d52f-4e95-8ffd-38477ecfc23c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:06.273873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-21827e2d-d52f-4e95-8ffd-38477ecfc23c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:06.273873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:06.273873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:06.273873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:06.273873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:06.273873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:06.273873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:06.273873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:06.273873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:06.273873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:06.273873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:06.273873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:06.273873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:06.273873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:06.273873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:06.273873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:06.274737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:06.274737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:06.274737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:06.274737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:06.274737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:06.274737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:06.274737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:06.274737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:06.274737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:06.274737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:06.274737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:06.274737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:06.274737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:06.274737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:06.274737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:06.274737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:06.275785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:06.275785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:06.275785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:06.275785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:06.275785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:06.275785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:06.275785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:06.275785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:06.275785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:06.275785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:06.275785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:06.275785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:06.275785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 240/488] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:43:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:06.276497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827e2d-d52f-4e95-8ffd-38477ecfc23c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:06.290626 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b147cfe-e463-4868-96ee-a03e3ed2924f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:06.295408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-4b147cfe-e463-4868-96ee-a03e3ed2924f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:06.295408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:06.295408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:06.295408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:06.295408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:06.295408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:06.295408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:06.295408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:06.295408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:06.295408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:06.295408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:06.295408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:06.295408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:06.295408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:06.295408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:06.295408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:06.296484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:06.296484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:06.296484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:06.296484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:06.296484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:06.296484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:06.296484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:06.296484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:06.296484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:06.296484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:06.296484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:06.296484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:06.296484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:06.296484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:06.296484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:06.296484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:06.297281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:06.297281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:06.297281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:06.297281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:06.297281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:06.297281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:06.297281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:06.297281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:06.297281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:06.297281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:06.297281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:06.297281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:06.297281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 249/489] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:43:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:06.297931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd106119-0a55-4477-8f09-5027c6251f99 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:06.300072 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd106119-0a55-4477-8f09-5027c6251f99 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:06.300072 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd106119-0a55-4477-8f09-5027c6251f99 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:06.300513 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 250/490] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:06.301247 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd106119-0a55-4477-8f09-5027c6251f99 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:06.321313 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:06.370692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:06.399263 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827e2d-d52f-4e95-8ffd-38477ecfc23c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:06.416827 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd106119-0a55-4477-8f09-5027c6251f99 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:06.437099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199e8db-7176-4af0-80b7-410079446711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:06.437800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199e8db-7176-4af0-80b7-410079446711 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:06.438086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199e8db-7176-4af0-80b7-410079446711 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:06.438369 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199e8db-7176-4af0-80b7-410079446711 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:06.439029 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199e8db-7176-4af0-80b7-410079446711 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:06.439336 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199e8db-7176-4af0-80b7-410079446711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:06.441023 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199e8db-7176-4af0-80b7-410079446711 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:06.454623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 241/491] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Sep 9 20:43:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:06.454623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199e8db-7176-4af0-80b7-410079446711 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:06.455977 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d6c95-d2dd-4898-9058-89e17cb75ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:06.456620 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d6c95-d2dd-4898-9058-89e17cb75ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:06.456900 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d6c95-d2dd-4898-9058-89e17cb75ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:06.457177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d6c95-d2dd-4898-9058-89e17cb75ee3 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:06.457846 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d6c95-d2dd-4898-9058-89e17cb75ee3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:06.458147 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d6c95-d2dd-4898-9058-89e17cb75ee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:06.459513 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d6c95-d2dd-4898-9058-89e17cb75ee3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:06.468971 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 251/492] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Sep 9 20:43:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:06.470219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f6a4e-c09b-4015-bea3-a6b35b56f7dd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:06.470454 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f6a4e-c09b-4015-bea3-a6b35b56f7dd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:06.470730 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f6a4e-c09b-4015-bea3-a6b35b56f7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:06.488844 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b47f6a4e-c09b-4015-bea3-a6b35b56f7dd None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:06.490051 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b47f6a4e-c09b-4015-bea3-a6b35b56f7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:06.565088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 252/493] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:06.566219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f6a4e-c09b-4015-bea3-a6b35b56f7dd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:06.574231 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:06.580413 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199e8db-7176-4af0-80b7-410079446711 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:06.618619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56950beb-c4d4-4f38-8ffd-fa83ade165a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:06.619568 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56950beb-c4d4-4f38-8ffd-fa83ade165a5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:06.620120 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56950beb-c4d4-4f38-8ffd-fa83ade165a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:06.620612 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56950beb-c4d4-4f38-8ffd-fa83ade165a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:06.621456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56950beb-c4d4-4f38-8ffd-fa83ade165a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:06.621950 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56950beb-c4d4-4f38-8ffd-fa83ade165a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:06.623818 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56950beb-c4d4-4f38-8ffd-fa83ade165a5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:06.626792 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:06.635767 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 242/494] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Sep 9 20:43:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:06.636920 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56950beb-c4d4-4f38-8ffd-fa83ade165a5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:06.684909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f6a4e-c09b-4015-bea3-a6b35b56f7dd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:06.721685 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56581c8-1a23-439e-8bca-c22a0b954941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:06.722246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56581c8-1a23-439e-8bca-c22a0b954941 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:06.722527 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56581c8-1a23-439e-8bca-c22a0b954941 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:06.722799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56581c8-1a23-439e-8bca-c22a0b954941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:06.733989 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56581c8-1a23-439e-8bca-c22a0b954941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:06.735544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56581c8-1a23-439e-8bca-c22a0b954941 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:06.745266 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56950beb-c4d4-4f38-8ffd-fa83ade165a5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:06.750788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a56581c8-1a23-439e-8bca-c22a0b954941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:06.750788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:06.750788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:06.750788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:06.750788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:06.750788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:06.750788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:06.750788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:06.750788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:06.750788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:06.750788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:06.750788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:06.750788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:06.750788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:06.750788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:06.750788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:06.751695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:06.751695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:06.751695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:06.751695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:06.751695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:06.751695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:06.751695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:06.751695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:06.751695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:06.751695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:06.751695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:06.751695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:06.751695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:06.751695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:06.751695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:06.751695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:06.751695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:06.752568 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:06.752568 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:06.752568 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:06.752568 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 253/495] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:06.753271 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdb9f6-7f7f-4390-ad7b-b6ecbc25ba7f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:06.753367 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdb9f6-7f7f-4390-ad7b-b6ecbc25ba7f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:06.753593 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdb9f6-7f7f-4390-ad7b-b6ecbc25ba7f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:06.754994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 254/496] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:06.755513 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdb9f6-7f7f-4390-ad7b-b6ecbc25ba7f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:06.786834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36b98a-05d9-4167-aa74-14c041e2b79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:06.787473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36b98a-05d9-4167-aa74-14c041e2b79c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:06.787755 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36b98a-05d9-4167-aa74-14c041e2b79c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:06.788119 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36b98a-05d9-4167-aa74-14c041e2b79c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:06.798744 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36b98a-05d9-4167-aa74-14c041e2b79c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:06.800243 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e36b98a-05d9-4167-aa74-14c041e2b79c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:06.815554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-3e36b98a-05d9-4167-aa74-14c041e2b79c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:06.815554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:06.815554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:06.815554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:06.815554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:06.815554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:06.815554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:06.815554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:06.815554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:06.815554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:06.815554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:06.815554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:06.815554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:06.815554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:06.815554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:06.815554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:06.816517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:06.816517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:06.816517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:06.816517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:06.816517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:06.816517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:06.816517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:06.816517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:06.816517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:06.816517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:06.816517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:06.816517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:06.816517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:06.816517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:06.816517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:06.816517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:06.816517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:06.818025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:06.818025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:06.818025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:06.818025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 243/497] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:06.818025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36b98a-05d9-4167-aa74-14c041e2b79c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:06.821575 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:06.869288 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdb9f6-7f7f-4390-ad7b-b6ecbc25ba7f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:06.870586 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:06.903871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c6018-7dea-4e56-b36d-d219e57bee7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:06.904529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c6018-7dea-4e56-b36d-d219e57bee7f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:06.904809 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c6018-7dea-4e56-b36d-d219e57bee7f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:06.905108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c6018-7dea-4e56-b36d-d219e57bee7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:06.915388 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c6018-7dea-4e56-b36d-d219e57bee7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:06.916881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c6018-7dea-4e56-b36d-d219e57bee7f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:06.919773 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36b98a-05d9-4167-aa74-14c041e2b79c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:06.931088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c74c6018-7dea-4e56-b36d-d219e57bee7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:06.931088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:06.931088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:06.931088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:06.931088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:06.931088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:06.931088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:06.931088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:06.931088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:06.931088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:06.931088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:06.931088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:06.931088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:06.931088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:06.931088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:06.931088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:06.932028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:06.932028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:06.932028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:06.932028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:06.932028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:06.932028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:06.932028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:06.932028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:06.932028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:06.932028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:06.932028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:06.932028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:06.932028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:06.932028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:06.932028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:06.932028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:06.932028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:06.932873 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:06.932873 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:06.932873 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:06.932873 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 255/498] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:06.933356 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea8b35-8552-4ab0-94aa-c643c0e6165c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:06.933580 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea8b35-8552-4ab0-94aa-c643c0e6165c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:06.933857 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea8b35-8552-4ab0-94aa-c643c0e6165c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:06.952488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-bcea8b35-8552-4ab0-94aa-c643c0e6165c None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:06.953828 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bcea8b35-8552-4ab0-94aa-c643c0e6165c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:06.955164 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f81f98-510a-457a-92ca-9af7bd8e56e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:06.955773 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f81f98-510a-457a-92ca-9af7bd8e56e4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:06.956089 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f81f98-510a-457a-92ca-9af7bd8e56e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:06.956367 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f81f98-510a-457a-92ca-9af7bd8e56e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:06.956995 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f81f98-510a-457a-92ca-9af7bd8e56e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:06.957300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f81f98-510a-457a-92ca-9af7bd8e56e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:06.958808 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f81f98-510a-457a-92ca-9af7bd8e56e4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:06.970794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 244/499] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:06.971896 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f81f98-510a-457a-92ca-9af7bd8e56e4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:07.021369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 256/500] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:07.022204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea8b35-8552-4ab0-94aa-c643c0e6165c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:07.065397 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:07.089694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f81f98-510a-457a-92ca-9af7bd8e56e4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:07.100424 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:07.126098 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea8b35-8552-4ab0-94aa-c643c0e6165c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:07.126355 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7b89e-46ee-4e55-8dbc-31a2a9a58ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:07.126937 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7b89e-46ee-4e55-8dbc-31a2a9a58ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:07.127217 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7b89e-46ee-4e55-8dbc-31a2a9a58ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:07.127492 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e7b89e-46ee-4e55-8dbc-31a2a9a58ea4 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:07.128162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7b89e-46ee-4e55-8dbc-31a2a9a58ea4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:07.128472 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7b89e-46ee-4e55-8dbc-31a2a9a58ea4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:07.129935 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e7b89e-46ee-4e55-8dbc-31a2a9a58ea4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:07.141575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 245/501] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:07.146540 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7b89e-46ee-4e55-8dbc-31a2a9a58ea4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:07.162441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302de63-4325-428c-a6eb-455ba17384f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:07.163060 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302de63-4325-428c-a6eb-455ba17384f3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:07.163341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302de63-4325-428c-a6eb-455ba17384f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:07.163609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302de63-4325-428c-a6eb-455ba17384f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:07.174646 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302de63-4325-428c-a6eb-455ba17384f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:07.179886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a302de63-4325-428c-a6eb-455ba17384f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:07.179886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:07.179886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:07.179886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:07.179886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:07.179886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:07.179886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:07.179886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:07.179886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:07.179886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:07.179886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:07.179886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:07.179886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:07.179886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:07.179886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:07.179886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:07.180771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:07.180771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:07.180771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:07.180771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:07.180771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:07.180771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:07.180771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:07.180771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:07.180771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:07.180771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:07.180771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:07.180771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:07.180771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:07.180771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:07.180771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:07.180771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:07.181599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:07.181599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:07.181599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:07.181599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:07.181599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:07.181599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:07.181599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:07.181599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:07.181599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:07.181599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:07.181599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:07.181599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:07.181599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 257/502] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:43:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:07.182240 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302de63-4325-428c-a6eb-455ba17384f3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:07.256405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e7b89e-46ee-4e55-8dbc-31a2a9a58ea4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:07.288365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:07.291406 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302de63-4325-428c-a6eb-455ba17384f3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:07.296354 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21ddb7-a8da-450d-b7c7-9c1085483114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:07.296997 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21ddb7-a8da-450d-b7c7-9c1085483114 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:07.297268 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21ddb7-a8da-450d-b7c7-9c1085483114 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:07.297543 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21ddb7-a8da-450d-b7c7-9c1085483114 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:07.298189 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21ddb7-a8da-450d-b7c7-9c1085483114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:07.298516 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21ddb7-a8da-450d-b7c7-9c1085483114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:07.299899 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21ddb7-a8da-450d-b7c7-9c1085483114 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:07.312308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 246/503] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:07.313130 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21ddb7-a8da-450d-b7c7-9c1085483114 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:07.332571 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a1f5a-2a16-4623-a954-888c480a47b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:07.333203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a1f5a-2a16-4623-a954-888c480a47b2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:07.333483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a1f5a-2a16-4623-a954-888c480a47b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:07.334095 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a1f5a-2a16-4623-a954-888c480a47b2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:07.340857 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a1f5a-2a16-4623-a954-888c480a47b2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:07.342076 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:07.342293 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a1f5a-2a16-4623-a954-888c480a47b2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:07.355712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d50a1f5a-2a16-4623-a954-888c480a47b2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 20:43:07.355712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:07.355712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:07.355712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:07.355712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:07.355712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:07.355712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:07.355712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:07.355712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:07.355712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:07.355712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:07.355712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:07.355712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:07.355712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:07.355712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:07.355712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:07.356905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:07.356905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:07.356905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:07.356905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:07.356905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:07.356905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:07.356905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:07.356905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:07.356905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:07.356905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:07.356905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:07.356905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:07.356905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:07.356905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:07.356905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:07.356905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:07.356905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:07.356905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:07.357805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:07.357805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:07.357805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:07.357805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:07.357805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:07.357805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:07.357805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:07.357805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:07.357805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 20:43:07.357805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:07.357805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 258/504] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:43:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:07.357805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a1f5a-2a16-4623-a954-888c480a47b2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:07.415793 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21ddb7-a8da-450d-b7c7-9c1085483114 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:07.449772 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab7486-e9ef-4a93-bf8f-88fb76f2e2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:07.450396 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab7486-e9ef-4a93-bf8f-88fb76f2e2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:07.450677 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab7486-e9ef-4a93-bf8f-88fb76f2e2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:07.450951 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab7486-e9ef-4a93-bf8f-88fb76f2e2d2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:07.458170 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab7486-e9ef-4a93-bf8f-88fb76f2e2d2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:07.458624 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a1f5a-2a16-4623-a954-888c480a47b2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:07.459640 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab7486-e9ef-4a93-bf8f-88fb76f2e2d2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:07.473287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6dab7486-e9ef-4a93-bf8f-88fb76f2e2d2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 20:43:07.473287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:07.473287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:07.473287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:07.473287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:07.473287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:07.473287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:07.473287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:07.473287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:07.473287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:07.473287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:07.473287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:07.473287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:07.473287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:07.473287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:07.473287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:07.474398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:07.474398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:07.474398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:07.474398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:07.474398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:07.474398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:07.474398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:07.474398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:07.474398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:07.474398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:07.474398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:07.474398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:07.474398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:07.474398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:07.474398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:07.474398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:07.474398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:07.474398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:07.475276 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:07.475276 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:07.475276 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:07.475276 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:07.475276 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:07.475276 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:07.475276 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:07.475276 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:07.475276 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 20:43:07.475276 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:07.475276 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 247/505] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Sep 9 20:43:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:07.475856 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab7486-e9ef-4a93-bf8f-88fb76f2e2d2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:07.498110 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956eda6-bd25-4a1a-9be7-64e1ac94a126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:07.498719 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956eda6-bd25-4a1a-9be7-64e1ac94a126 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:07.499022 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956eda6-bd25-4a1a-9be7-64e1ac94a126 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:07.499297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956eda6-bd25-4a1a-9be7-64e1ac94a126 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:07.499955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956eda6-bd25-4a1a-9be7-64e1ac94a126 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:07.500297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956eda6-bd25-4a1a-9be7-64e1ac94a126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:07.502178 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956eda6-bd25-4a1a-9be7-64e1ac94a126 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:07.510501 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 259/506] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Sep 9 20:43:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:07.512281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956eda6-bd25-4a1a-9be7-64e1ac94a126 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:07.538129 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:07.567243 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:07.578420 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab7486-e9ef-4a93-bf8f-88fb76f2e2d2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:07.612443 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bb25e-0e15-4e8c-b650-8276e43c544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:07.613063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bb25e-0e15-4e8c-b650-8276e43c544a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:07.613342 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bb25e-0e15-4e8c-b650-8276e43c544a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:07.613543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956eda6-bd25-4a1a-9be7-64e1ac94a126 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:07.613637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bb25e-0e15-4e8c-b650-8276e43c544a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:07.624542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bb25e-0e15-4e8c-b650-8276e43c544a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:07.626113 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bb25e-0e15-4e8c-b650-8276e43c544a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:07.639911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-da6bb25e-0e15-4e8c-b650-8276e43c544a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:07.639911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:07.639911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:07.639911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:07.639911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:07.639911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:07.639911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:07.639911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:07.639911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:07.639911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:07.639911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:07.639911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:07.639911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:07.639911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:07.639911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:07.639911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:07.641003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:07.641003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:07.641003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:07.641003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:07.641003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:07.641003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:07.641003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:07.641003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:07.641003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:07.641003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:07.641003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:07.641003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:07.641003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:07.641003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:07.641003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:07.641003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:07.641003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:07.642035 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:07.642035 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:07.642035 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:07.642035 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 248/507] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:07.642289 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bb25e-0e15-4e8c-b650-8276e43c544a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:07.650905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce1d41-eb7b-4c7b-ba95-a31b8a589f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:07.651533 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce1d41-eb7b-4c7b-ba95-a31b8a589f1c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:07.651812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce1d41-eb7b-4c7b-ba95-a31b8a589f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:07.652115 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce1d41-eb7b-4c7b-ba95-a31b8a589f1c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:07.659497 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce1d41-eb7b-4c7b-ba95-a31b8a589f1c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:07.660979 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce1d41-eb7b-4c7b-ba95-a31b8a589f1c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:07.672437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-84ce1d41-eb7b-4c7b-ba95-a31b8a589f1c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 20:43:07.672437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:07.672437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:07.672437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:07.672437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:07.672437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:07.672437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:07.672437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:07.672437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:07.672437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:07.672437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:07.672437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:07.672437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:07.672437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:07.672437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:07.672437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:07.673552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:07.673552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:07.673552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:07.673552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:07.673552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:07.673552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:07.673552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:07.673552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:07.673552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:07.673552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:07.673552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:07.673552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:07.673552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:07.673552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:07.673552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:07.673552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:07.673552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:07.673552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:07.674456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:07.674456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:07.674456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:07.674456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:07.674456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:07.674456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:07.674456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:07.674456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:07.674456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 20:43:07.674456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:07.674456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 260/508] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:43:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:07.674456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce1d41-eb7b-4c7b-ba95-a31b8a589f1c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:07.746776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bb25e-0e15-4e8c-b650-8276e43c544a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:07.757245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:07.776160 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce1d41-eb7b-4c7b-ba95-a31b8a589f1c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:07.780968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06521b-e614-4092-b911-4101fada1966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:07.781575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06521b-e614-4092-b911-4101fada1966 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:07.781855 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06521b-e614-4092-b911-4101fada1966 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:07.782130 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06521b-e614-4092-b911-4101fada1966 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:07.782849 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06521b-e614-4092-b911-4101fada1966 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:07.783149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06521b-e614-4092-b911-4101fada1966 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:07.784631 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06521b-e614-4092-b911-4101fada1966 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:07.808417 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95fa7c8-8769-4466-b67e-8e5e5ba60751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:07.809018 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fa7c8-8769-4466-b67e-8e5e5ba60751 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:07.809302 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fa7c8-8769-4466-b67e-8e5e5ba60751 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:07.809571 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fa7c8-8769-4466-b67e-8e5e5ba60751 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:07.810295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fa7c8-8769-4466-b67e-8e5e5ba60751 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:07.810594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fa7c8-8769-4466-b67e-8e5e5ba60751 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:07.812739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fa7c8-8769-4466-b67e-8e5e5ba60751 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:07.818554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:07.822720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 249/509] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Sep 9 20:43:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:07.823565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06521b-e614-4092-b911-4101fada1966 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:07.848983 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 261/510] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Sep 9 20:43:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:07.849811 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95fa7c8-8769-4466-b67e-8e5e5ba60751 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:07.928945 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06521b-e614-4092-b911-4101fada1966 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:07.948016 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95fa7c8-8769-4466-b67e-8e5e5ba60751 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:07.962120 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9bf7f-eece-48f9-84c9-ce8b986dd576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:07.962760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9bf7f-eece-48f9-84c9-ce8b986dd576 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:07.963041 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9bf7f-eece-48f9-84c9-ce8b986dd576 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:07.963313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9bf7f-eece-48f9-84c9-ce8b986dd576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:07.974071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9bf7f-eece-48f9-84c9-ce8b986dd576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:07.975537 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9bf7f-eece-48f9-84c9-ce8b986dd576 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:07.981873 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec995d-5d98-4613-8d08-44d128b2e64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:07.982479 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec995d-5d98-4613-8d08-44d128b2e64c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:07.982753 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec995d-5d98-4613-8d08-44d128b2e64c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:07.983023 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec995d-5d98-4613-8d08-44d128b2e64c None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:07.984308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec995d-5d98-4613-8d08-44d128b2e64c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:07.984618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec995d-5d98-4613-8d08-44d128b2e64c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:07.985975 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec995d-5d98-4613-8d08-44d128b2e64c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:07.990735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-d1e9bf7f-eece-48f9-84c9-ce8b986dd576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:07.990735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:07.990735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:07.990735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:07.990735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:07.990735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:07.990735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:07.990735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:07.990735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:07.990735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:07.990735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:07.990735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:07.990735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:07.990735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:07.990735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:07.990735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:07.991790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:07.991790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:07.991790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:07.991790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:07.991790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:07.991790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:07.991790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:07.991790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:07.991790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:07.991790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:07.991790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:07.991790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:07.991790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:07.991790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:07.991790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:07.991790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:07.991790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:07.992721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:07.992721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:07.992721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:07.995016 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:07.995288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 250/511] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:07.996522 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9bf7f-eece-48f9-84c9-ce8b986dd576 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:07.998986 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 262/512] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:08.000252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec995d-5d98-4613-8d08-44d128b2e64c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:08.050616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:08.097670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec995d-5d98-4613-8d08-44d128b2e64c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:08.098754 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9bf7f-eece-48f9-84c9-ce8b986dd576 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:08.130711 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8a1ab-687b-448d-8a86-a8d9f2a9b3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:08.131368 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8a1ab-687b-448d-8a86-a8d9f2a9b3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:08.131601 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8a1ab-687b-448d-8a86-a8d9f2a9b3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:08.131857 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8a1ab-687b-448d-8a86-a8d9f2a9b3f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:08.131959 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13924c0a-6e7b-4e1c-a1dd-0d36c10e3748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:08.132559 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13924c0a-6e7b-4e1c-a1dd-0d36c10e3748 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:08.132839 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13924c0a-6e7b-4e1c-a1dd-0d36c10e3748 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:08.133110 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13924c0a-6e7b-4e1c-a1dd-0d36c10e3748 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:08.133821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13924c0a-6e7b-4e1c-a1dd-0d36c10e3748 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:08.134124 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13924c0a-6e7b-4e1c-a1dd-0d36c10e3748 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:08.135574 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13924c0a-6e7b-4e1c-a1dd-0d36c10e3748 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:08.154571 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 251/513] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Sep 9 20:43:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:08.155509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13924c0a-6e7b-4e1c-a1dd-0d36c10e3748 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:08.201033 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:08.204411 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8a1ab-687b-448d-8a86-a8d9f2a9b3f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:08.206521 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8a1ab-687b-448d-8a86-a8d9f2a9b3f0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:08.250882 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13924c0a-6e7b-4e1c-a1dd-0d36c10e3748 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:08.261154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:08.285791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b245db-664f-4c61-b4cf-f081e1502f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:08.286406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b245db-664f-4c61-b4cf-f081e1502f8d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:08.286690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b245db-664f-4c61-b4cf-f081e1502f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:08.286964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b245db-664f-4c61-b4cf-f081e1502f8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:08.306898 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 263/514] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:43:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:43:08.307672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8a1ab-687b-448d-8a86-a8d9f2a9b3f0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:08.355479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b245db-664f-4c61-b4cf-f081e1502f8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:08.357172 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b245db-664f-4c61-b4cf-f081e1502f8d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:08.404790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:08.408817 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8a1ab-687b-448d-8a86-a8d9f2a9b3f0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:08.443005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff5ccc-d034-4e80-ac20-4912fdad25a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:08.443600 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff5ccc-d034-4e80-ac20-4912fdad25a3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:08.443876 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff5ccc-d034-4e80-ac20-4912fdad25a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:08.444177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff5ccc-d034-4e80-ac20-4912fdad25a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:08.444809 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff5ccc-d034-4e80-ac20-4912fdad25a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:08.445202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff5ccc-d034-4e80-ac20-4912fdad25a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:08.446564 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff5ccc-d034-4e80-ac20-4912fdad25a3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:08.458220 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 264/515] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:08.458724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 252/516] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:43:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:43:08.459453 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b245db-664f-4c61-b4cf-f081e1502f8d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:08.460690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff5ccc-d034-4e80-ac20-4912fdad25a3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:08.472022 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:08.558653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b245db-664f-4c61-b4cf-f081e1502f8d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:08.559861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff5ccc-d034-4e80-ac20-4912fdad25a3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:08.592202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc0cf5-9fa0-4022-a08a-40117de01ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:08.592670 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923f929-fe2a-4973-8d74-c8f103d90c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:08.592794 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc0cf5-9fa0-4022-a08a-40117de01ea5 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:08.593116 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc0cf5-9fa0-4022-a08a-40117de01ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:08.593231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923f929-fe2a-4973-8d74-c8f103d90c3a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:08.593324 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc0cf5-9fa0-4022-a08a-40117de01ea5 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:08.593430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923f929-fe2a-4973-8d74-c8f103d90c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:08.593704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923f929-fe2a-4973-8d74-c8f103d90c3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:08.593957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc0cf5-9fa0-4022-a08a-40117de01ea5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:08.595373 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc0cf5-9fa0-4022-a08a-40117de01ea5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:08.616267 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 265/517] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Sep 9 20:43:08 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:43:08.617078 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc0cf5-9fa0-4022-a08a-40117de01ea5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:08.637075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:08.673480 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923f929-fe2a-4973-8d74-c8f103d90c3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:08.675017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923f929-fe2a-4973-8d74-c8f103d90c3a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:08.689133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:08.736296 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc0cf5-9fa0-4022-a08a-40117de01ea5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:08.777248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2c017-39de-4524-aa92-822568233b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:08.778187 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2c017-39de-4524-aa92-822568233b23 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:08.778498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2c017-39de-4524-aa92-822568233b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:08.779213 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2c017-39de-4524-aa92-822568233b23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:08.789197 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 253/518] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:43:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:43:08.790053 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923f929-fe2a-4973-8d74-c8f103d90c3a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:08.794867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2c017-39de-4524-aa92-822568233b23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:08.797005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2c017-39de-4524-aa92-822568233b23 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:08.813855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c9a2c017-39de-4524-aa92-822568233b23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:08.813855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:08.813855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:08.813855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:08.813855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:08.813855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:08.813855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:08.813855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:08.813855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:08.813855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:08.813855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:08.813855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:08.813855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:08.813855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:08.813855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:08.813855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:08.814799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:08.814799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:08.814799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:08.814799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:08.814799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:08.814799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:08.814799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:08.814799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:08.814799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:08.814799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:08.814799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:08.814799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:08.814799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:08.814799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:08.814799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:08.814799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:08.814799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:08.816721 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:08.816721 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:08.816721 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:08.816721 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 266/519] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:08.816721 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2c017-39de-4524-aa92-822568233b23 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:08.892096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:08.904251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923f929-fe2a-4973-8d74-c8f103d90c3a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:08.917043 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:08.930523 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2c017-39de-4524-aa92-822568233b23 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:08.942340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea3f4b-f0f9-4930-b0ba-103014132d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:08.942974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea3f4b-f0f9-4930-b0ba-103014132d6b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:08.943250 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea3f4b-f0f9-4930-b0ba-103014132d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:08.943524 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea3f4b-f0f9-4930-b0ba-103014132d6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:08.955074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea3f4b-f0f9-4930-b0ba-103014132d6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:08.956740 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea3f4b-f0f9-4930-b0ba-103014132d6b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:08.967689 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e98b9-78e5-4f08-b210-61770941bc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:08.968370 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e98b9-78e5-4f08-b210-61770941bc18 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:08.968647 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e98b9-78e5-4f08-b210-61770941bc18 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:08.968921 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894e98b9-78e5-4f08-b210-61770941bc18 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:08.971958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-84ea3f4b-f0f9-4930-b0ba-103014132d6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:08.971958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:08.971958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:08.971958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:08.971958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:08.971958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:08.971958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:08.971958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:08.971958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:08.971958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:08.971958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:08.971958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:08.971958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:08.971958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:08.971958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:08.971958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:08.972886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:08.972886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:08.972886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:08.972886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:08.972886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:08.972886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:08.972886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:08.972886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:08.972886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:08.972886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:08.972886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:08.972886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:08.972886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:08.972886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:08.972886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:08.972886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:08.972886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:08.973721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:08.973721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:08.973721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:08.973721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 254/520] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:08.974194 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea3f4b-f0f9-4930-b0ba-103014132d6b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:08.979128 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e98b9-78e5-4f08-b210-61770941bc18 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:08.980838 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894e98b9-78e5-4f08-b210-61770941bc18 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:08.993245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-894e98b9-78e5-4f08-b210-61770941bc18 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 20:43:08.993245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:08.993245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:08.993245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:08.993245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:08.993245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:08.993245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:08.993245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:08.993245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:08.993245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:08.993245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:08.993245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:08.993245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:08.993245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:08.993245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:08.993245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:08.994139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:08.994139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:08.994139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:08.994139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:08.994139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:08.994139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:08.994139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:08.994139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:08.994139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:08.994139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:08.994139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:08.994139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:08.994139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:08.994139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:08.994139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:08.994139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:08.994139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:08.994139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:08.995024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:08.995024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:08.995024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:08.995024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:08.995024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:08.995024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:08.995024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:08.995024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:08.995024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 20:43:08.995024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:08.997265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 267/521] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:43:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:08.998182 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e98b9-78e5-4f08-b210-61770941bc18 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:09.087708 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea3f4b-f0f9-4930-b0ba-103014132d6b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:09.103203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894e98b9-78e5-4f08-b210-61770941bc18 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:09.123123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b6bea-e489-48cb-a58f-fd2586bad50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:09.124505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b6bea-e489-48cb-a58f-fd2586bad50b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:09.124760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b6bea-e489-48cb-a58f-fd2586bad50b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:09.125029 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b6bea-e489-48cb-a58f-fd2586bad50b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:09.132181 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:09.136377 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b6bea-e489-48cb-a58f-fd2586bad50b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:09.138006 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851b6bea-e489-48cb-a58f-fd2586bad50b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:09.142999 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170b771-965b-44a3-8756-80dfe5362787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:09.143612 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170b771-965b-44a3-8756-80dfe5362787 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:09.143890 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170b771-965b-44a3-8756-80dfe5362787 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:09.144193 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170b771-965b-44a3-8756-80dfe5362787 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:09.144859 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170b771-965b-44a3-8756-80dfe5362787 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:09.145133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170b771-965b-44a3-8756-80dfe5362787 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:09.146682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170b771-965b-44a3-8756-80dfe5362787 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:09.153292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-851b6bea-e489-48cb-a58f-fd2586bad50b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:09.153292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:09.153292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:09.153292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:09.153292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:09.153292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:09.153292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:09.153292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:09.153292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:09.153292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:09.153292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:09.153292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:09.153292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:09.153292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:09.153292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:09.153292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:09.154166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:09.154166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:09.154166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:09.154166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:09.154166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:09.154166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:09.154166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:09.154166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:09.154166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:09.154166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:09.154166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:09.154166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:09.154166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:09.154166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:09.154166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:09.154166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:09.154166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:09.155294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:09.155294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:09.155294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:09.159010 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 255/522] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:09.159737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b6bea-e489-48cb-a58f-fd2586bad50b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:09.161186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 268/523] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:09.164924 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170b771-965b-44a3-8756-80dfe5362787 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:09.176214 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:09.271322 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b6bea-e489-48cb-a58f-fd2586bad50b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:09.272639 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170b771-965b-44a3-8756-80dfe5362787 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:09.309522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ede7b-a94b-4a39-a9b8-1452ecf4ff73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:09.310140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ede7b-a94b-4a39-a9b8-1452ecf4ff73 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:09.310421 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ede7b-a94b-4a39-a9b8-1452ecf4ff73 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:09.310698 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ede7b-a94b-4a39-a9b8-1452ecf4ff73 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:09.311982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ede7b-a94b-4a39-a9b8-1452ecf4ff73 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:09.312321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ede7b-a94b-4a39-a9b8-1452ecf4ff73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:09.313783 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ede7b-a94b-4a39-a9b8-1452ecf4ff73 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:09.315132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb88e8d-3429-433f-a353-50353ab9a64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:09.315917 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb88e8d-3429-433f-a353-50353ab9a64b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:09.316229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb88e8d-3429-433f-a353-50353ab9a64b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:09.317299 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb88e8d-3429-433f-a353-50353ab9a64b None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:09.317957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb88e8d-3429-433f-a353-50353ab9a64b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:09.318264 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb88e8d-3429-433f-a353-50353ab9a64b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:09.319691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb88e8d-3429-433f-a353-50353ab9a64b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:09.332174 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 269/524] 10.222.0.15 () {56 vars in 1139 bytes} [Fri Sep 9 20:43:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:09.333084 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ede7b-a94b-4a39-a9b8-1452ecf4ff73 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:09.343561 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 256/525] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:09.343561 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb88e8d-3429-433f-a353-50353ab9a64b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:09.390192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:09.423307 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:09.450061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb88e8d-3429-433f-a353-50353ab9a64b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:09.456667 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ede7b-a94b-4a39-a9b8-1452ecf4ff73 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:09.485845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3abb96-1df5-4eb4-b6f0-7f27102d4a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:09.486476 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3abb96-1df5-4eb4-b6f0-7f27102d4a7f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:09.486754 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3abb96-1df5-4eb4-b6f0-7f27102d4a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:09.487023 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3abb96-1df5-4eb4-b6f0-7f27102d4a7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:09.493623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3abb96-1df5-4eb4-b6f0-7f27102d4a7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:09.495067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3abb96-1df5-4eb4-b6f0-7f27102d4a7f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:09.501405 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6228418-440e-4d6e-884c-898c565bdafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:09.502658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6228418-440e-4d6e-884c-898c565bdafb None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:09.502946 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6228418-440e-4d6e-884c-898c565bdafb None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:09.503221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6228418-440e-4d6e-884c-898c565bdafb None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:09.503864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6228418-440e-4d6e-884c-898c565bdafb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:09.504214 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6228418-440e-4d6e-884c-898c565bdafb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:09.505581 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6228418-440e-4d6e-884c-898c565bdafb None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:09.507637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-1a3abb96-1df5-4eb4-b6f0-7f27102d4a7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:09.507637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:09.507637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:09.507637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:09.507637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:09.507637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:09.507637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:09.507637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:09.507637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:09.507637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:09.507637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:09.507637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:09.507637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:09.507637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:09.507637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:09.508470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:09.508470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:09.508470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:09.508470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:09.508470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:09.508470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:09.508470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:09.508470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:09.508470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:09.508470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:09.508470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:09.508470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:09.508470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:09.508470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:09.508470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:09.508470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:09.508470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:09.509294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:09.509294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:09.509294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:09.509294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:09.509294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:09.509294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:09.509294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:09.509294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:09.509294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 257/526] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:09.509860 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3abb96-1df5-4eb4-b6f0-7f27102d4a7f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:09.524620 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 270/527] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:09.524620 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6228418-440e-4d6e-884c-898c565bdafb None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:09.622601 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3abb96-1df5-4eb4-b6f0-7f27102d4a7f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:09.631496 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6228418-440e-4d6e-884c-898c565bdafb None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:09.638417 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:09.660484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b8856-d5e5-4b21-87f4-38f5a2da3be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:09.661088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b8856-d5e5-4b21-87f4-38f5a2da3be7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:09.661373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b8856-d5e5-4b21-87f4-38f5a2da3be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:09.661639 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b8856-d5e5-4b21-87f4-38f5a2da3be7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:09.664351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:09.666735 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd856f3-bd62-4411-a139-5d11958869c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:09.667396 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd856f3-bd62-4411-a139-5d11958869c4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:09.667679 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd856f3-bd62-4411-a139-5d11958869c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:09.667975 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd856f3-bd62-4411-a139-5d11958869c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:09.675958 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd856f3-bd62-4411-a139-5d11958869c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:09.677421 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd856f3-bd62-4411-a139-5d11958869c4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:09.689597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-9dd856f3-bd62-4411-a139-5d11958869c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:09.689597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:09.689597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:09.689597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:09.689597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:09.689597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:09.689597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:09.689597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:09.689597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:09.689597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:09.689597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:09.689597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:09.689597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:09.689597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:09.689597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:09.690619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:09.690619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:09.690619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:09.690619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:09.690619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:09.690619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:09.690619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:09.690619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:09.690619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:09.690619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:09.690619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:09.690619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:09.690619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:09.690619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:09.690619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:09.690619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:09.690619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:09.691464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:09.691464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:09.691464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:09.691464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:09.691464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:09.691464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:09.691464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:09.691464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:09.691464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 271/528] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:09.691464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd856f3-bd62-4411-a139-5d11958869c4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:09.740158 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b8856-d5e5-4b21-87f4-38f5a2da3be7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:09.741625 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b8856-d5e5-4b21-87f4-38f5a2da3be7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:09.802084 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd856f3-bd62-4411-a139-5d11958869c4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:09.838309 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f49611-1fcf-4fd2-a36d-8e69d42b367a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:09.839054 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f49611-1fcf-4fd2-a36d-8e69d42b367a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:09.839340 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f49611-1fcf-4fd2-a36d-8e69d42b367a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:09.839607 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f49611-1fcf-4fd2-a36d-8e69d42b367a None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:09.840673 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f49611-1fcf-4fd2-a36d-8e69d42b367a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:09.840913 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f49611-1fcf-4fd2-a36d-8e69d42b367a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:09.842344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f49611-1fcf-4fd2-a36d-8e69d42b367a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:09.847863 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 258/529] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:43:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:43:09.847863 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b8856-d5e5-4b21-87f4-38f5a2da3be7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:09.865125 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 272/530] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:09.865125 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f49611-1fcf-4fd2-a36d-8e69d42b367a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:09.887122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:09.892939 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:09.966906 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b8856-d5e5-4b21-87f4-38f5a2da3be7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:09.967141 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f49611-1fcf-4fd2-a36d-8e69d42b367a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:10.002561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8357265-ebea-47af-b8c9-d2631b7b5374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:10.003172 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8357265-ebea-47af-b8c9-d2631b7b5374 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:10.003449 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8357265-ebea-47af-b8c9-d2631b7b5374 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:10.003720 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8357265-ebea-47af-b8c9-d2631b7b5374 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:10.004472 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8357265-ebea-47af-b8c9-d2631b7b5374 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:10.004781 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8357265-ebea-47af-b8c9-d2631b7b5374 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:10.006205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8357265-ebea-47af-b8c9-d2631b7b5374 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:10.009435 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439a016-258f-4d44-84c2-169d9f053f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:10.010258 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439a016-258f-4d44-84c2-169d9f053f51 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:10.010743 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439a016-258f-4d44-84c2-169d9f053f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:10.011191 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439a016-258f-4d44-84c2-169d9f053f51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:10.017985 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439a016-258f-4d44-84c2-169d9f053f51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:10.018362 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 273/531] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:10.019169 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8357265-ebea-47af-b8c9-d2631b7b5374 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:10.020069 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7439a016-258f-4d44-84c2-169d9f053f51 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:10.035193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7439a016-258f-4d44-84c2-169d9f053f51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:10.035193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:10.035193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:10.035193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:10.035193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:10.035193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:10.035193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:10.035193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:10.035193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:10.035193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:10.035193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:10.035193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:10.035193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:10.035193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:10.035193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:10.036247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:10.036247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:10.036247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:10.036247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:10.036247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:10.036247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:10.036247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:10.036247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:10.036247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:10.036247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:10.036247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:10.036247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:10.036247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:10.036247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:10.036247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:10.036247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:10.036247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:10.037122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:10.037122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:10.037122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:10.037122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:10.037122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:10.037122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:10.037122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:10.037122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:10.037122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 259/532] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:10.037572 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439a016-258f-4d44-84c2-169d9f053f51 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:10.115178 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:10.132447 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8357265-ebea-47af-b8c9-d2631b7b5374 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:10.137094 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:10.145239 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7439a016-258f-4d44-84c2-169d9f053f51 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:10.173687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796f038-dbe4-462c-9049-ee52f2f14231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:10.174758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796f038-dbe4-462c-9049-ee52f2f14231 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:10.175197 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796f038-dbe4-462c-9049-ee52f2f14231 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:10.175655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796f038-dbe4-462c-9049-ee52f2f14231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:10.180447 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc483c-541a-427f-9041-17ea450ce720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:10.181054 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc483c-541a-427f-9041-17ea450ce720 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:10.181333 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc483c-541a-427f-9041-17ea450ce720 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:10.181604 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc483c-541a-427f-9041-17ea450ce720 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:10.182322 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc483c-541a-427f-9041-17ea450ce720 None admin] RBAC: Adding query filter params (role.id=e3de94d5ee924ea4b638d196d282af55, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=cf65c58c74fc49e4ba7605f3c6c27f8b) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:10.182628 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc483c-541a-427f-9041-17ea450ce720 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:10.184526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc483c-541a-427f-9041-17ea450ce720 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:10.187526 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796f038-dbe4-462c-9049-ee52f2f14231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:10.188993 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796f038-dbe4-462c-9049-ee52f2f14231 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:10.191296 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 260/533] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:43:10 2022] GET /identity/v3/role_assignments?user.id=cf65c58c74fc49e4ba7605f3c6c27f8b&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=e3de94d5ee924ea4b638d196d282af55 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:10.191923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc483c-541a-427f-9041-17ea450ce720 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:10.211799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-3796f038-dbe4-462c-9049-ee52f2f14231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:10.211799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:10.211799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:10.211799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:10.211799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:10.211799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:10.211799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:10.211799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:10.211799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:10.211799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:10.211799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:10.211799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:10.211799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:10.211799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:10.211799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:10.211799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:10.212780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:10.212780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:10.212780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:10.212780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:10.212780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:10.212780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:10.212780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:10.212780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:10.212780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:10.212780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:10.212780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:10.212780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:10.212780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:10.212780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:10.212780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:10.212780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:10.212780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:10.213596 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:10.213596 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:10.213596 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:10.215894 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 274/534] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:10.217179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796f038-dbe4-462c-9049-ee52f2f14231 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:10.326707 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc483c-541a-427f-9041-17ea450ce720 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:10.351528 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796f038-dbe4-462c-9049-ee52f2f14231 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:10.375570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bfa71-38ac-4780-a3d1-5c18a5af5350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:10.376966 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bfa71-38ac-4780-a3d1-5c18a5af5350 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:10.377251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bfa71-38ac-4780-a3d1-5c18a5af5350 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:10.377526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bfa71-38ac-4780-a3d1-5c18a5af5350 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:10.378258 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bfa71-38ac-4780-a3d1-5c18a5af5350 None admin] RBAC: Adding query filter params (role.id=e3de94d5ee924ea4b638d196d282af55, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=dc210376e57a41e6b3812110db249099) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:10.378671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bfa71-38ac-4780-a3d1-5c18a5af5350 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:10.380193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bfa71-38ac-4780-a3d1-5c18a5af5350 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:10.386400 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 261/535] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:43:10 2022] GET /identity/v3/role_assignments?user.id=dc210376e57a41e6b3812110db249099&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=e3de94d5ee924ea4b638d196d282af55 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:10.386739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bfa71-38ac-4780-a3d1-5c18a5af5350 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:10.407208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9c1e2-611b-47e4-a768-db801ce88841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:10.408005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9c1e2-611b-47e4-a768-db801ce88841 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:10.408376 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9c1e2-611b-47e4-a768-db801ce88841 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:10.408746 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9c1e2-611b-47e4-a768-db801ce88841 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:10.409547 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9c1e2-611b-47e4-a768-db801ce88841 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:10.409950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9c1e2-611b-47e4-a768-db801ce88841 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:10.411518 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9c1e2-611b-47e4-a768-db801ce88841 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:10.417825 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:10.430811 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:10.442787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 275/536] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:10.448812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9c1e2-611b-47e4-a768-db801ce88841 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:10.577920 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bfa71-38ac-4780-a3d1-5c18a5af5350 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:10.635337 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9c1e2-611b-47e4-a768-db801ce88841 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:10.637557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c464a1-b1ac-445a-8b73-085c347998e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:10.638272 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c464a1-b1ac-445a-8b73-085c347998e4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:10.640017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c464a1-b1ac-445a-8b73-085c347998e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:10.640417 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c464a1-b1ac-445a-8b73-085c347998e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:10.641165 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c464a1-b1ac-445a-8b73-085c347998e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:10.641565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c464a1-b1ac-445a-8b73-085c347998e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:10.643038 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c464a1-b1ac-445a-8b73-085c347998e4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:10.657664 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 262/537] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:10.662961 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c464a1-b1ac-445a-8b73-085c347998e4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:10.729590 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a14a0e-227a-40b5-aa51-9e848c1c3391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:10.730236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a14a0e-227a-40b5-aa51-9e848c1c3391 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:10.730570 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a14a0e-227a-40b5-aa51-9e848c1c3391 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:10.730850 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a14a0e-227a-40b5-aa51-9e848c1c3391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:10.731610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a14a0e-227a-40b5-aa51-9e848c1c3391 None admin] RBAC: Adding query filter params (role.id=e3de94d5ee924ea4b638d196d282af55, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=8d298efe48464956b7a03cba1001060b) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:10.731922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a14a0e-227a-40b5-aa51-9e848c1c3391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:10.734097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a14a0e-227a-40b5-aa51-9e848c1c3391 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:10.746169 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 276/538] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:43:10 2022] GET /identity/v3/role_assignments?user.id=8d298efe48464956b7a03cba1001060b&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=e3de94d5ee924ea4b638d196d282af55 => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:10.771573 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:10.802780 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c464a1-b1ac-445a-8b73-085c347998e4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:10.860025 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57066fc-6ace-467e-b1fc-46319222e55b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:10.860361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57066fc-6ace-467e-b1fc-46319222e55b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:10.860584 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57066fc-6ace-467e-b1fc-46319222e55b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:10.862169 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 277/539] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:43:10.864347 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642c791-8a3c-425b-8709-c02cef9d70d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:10.865006 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642c791-8a3c-425b-8709-c02cef9d70d1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:10.865287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642c791-8a3c-425b-8709-c02cef9d70d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:10.865559 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642c791-8a3c-425b-8709-c02cef9d70d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:10.869148 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17087c4c-3822-456d-84be-7e57b04a4cfe None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:10.869698 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17087c4c-3822-456d-84be-7e57b04a4cfe None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:10.870203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17087c4c-3822-456d-84be-7e57b04a4cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:10.881322 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642c791-8a3c-425b-8709-c02cef9d70d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:10.882880 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642c791-8a3c-425b-8709-c02cef9d70d1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:10.891883 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-17087c4c-3822-456d-84be-7e57b04a4cfe None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:10.893617 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-17087c4c-3822-456d-84be-7e57b04a4cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:10.901221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b642c791-8a3c-425b-8709-c02cef9d70d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:10.901221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:10.901221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:10.901221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:10.901221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:10.901221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:10.901221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:10.901221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:10.901221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:10.901221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:10.901221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:10.901221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:10.901221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:10.901221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:10.901221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:10.902121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:10.902121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:10.902121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:10.902121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:10.902121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:10.902121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:10.902121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:10.902121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:10.902121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:10.902121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:10.902121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:10.902121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:10.902121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:10.902121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:10.902121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:10.902121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:10.902121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:10.902948 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:10.902948 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:10.902948 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:10.902948 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:10.902948 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:10.902948 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:10.902948 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:10.902948 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:10.902948 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 263/540] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:10.912123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642c791-8a3c-425b-8709-c02cef9d70d1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:10.996734 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:11.009941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 278/541] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:43:11.042830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642c791-8a3c-425b-8709-c02cef9d70d1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:11.092242 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8aee43-46bb-48b0-9268-35c30763c592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:11.093396 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aee43-46bb-48b0-9268-35c30763c592 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:11.093671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aee43-46bb-48b0-9268-35c30763c592 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:11.093940 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8aee43-46bb-48b0-9268-35c30763c592 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:11.094624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8aee43-46bb-48b0-9268-35c30763c592 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:11.094924 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8aee43-46bb-48b0-9268-35c30763c592 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:11.096388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8aee43-46bb-48b0-9268-35c30763c592 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:11.115932 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 264/542] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:11.125410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17087c4c-3822-456d-84be-7e57b04a4cfe None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:11.254399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17087c4c-3822-456d-84be-7e57b04a4cfe None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:11.301190 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa7404-7831-4974-a168-909a3f7439e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:11.301802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa7404-7831-4974-a168-909a3f7439e2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:11.302078 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa7404-7831-4974-a168-909a3f7439e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:11.302790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fa7404-7831-4974-a168-909a3f7439e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:11.303516 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa7404-7831-4974-a168-909a3f7439e2 None admin] RBAC: Adding query filter params (role.id=e3de94d5ee924ea4b638d196d282af55, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=27e2be33ebdc4c5a97befcbd4d09ee4c) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:11.303824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa7404-7831-4974-a168-909a3f7439e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:11.305292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fa7404-7831-4974-a168-909a3f7439e2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:11.316489 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 279/543] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:43:11 2022] GET /identity/v3/role_assignments?user.id=27e2be33ebdc4c5a97befcbd4d09ee4c&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=e3de94d5ee924ea4b638d196d282af55 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:11.357419 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8aee43-46bb-48b0-9268-35c30763c592 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:11.361370 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:11.522646 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8aee43-46bb-48b0-9268-35c30763c592 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:11.582043 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256200ce-692c-4b13-a995-e5dee41505d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:11.582787 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256200ce-692c-4b13-a995-e5dee41505d9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:11.582947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256200ce-692c-4b13-a995-e5dee41505d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:11.583211 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256200ce-692c-4b13-a995-e5dee41505d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:11.604841 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256200ce-692c-4b13-a995-e5dee41505d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:11.610127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-256200ce-692c-4b13-a995-e5dee41505d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:11.610127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:11.610127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:11.610127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:11.610127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:11.610127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:11.610127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:11.610127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:11.610127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:11.610127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:11.610127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:11.610127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:11.610127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:11.610127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:11.610127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:11.610127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:11.612316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:11.612316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:11.612316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:11.612316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:11.612316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:11.612316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:11.612316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:11.612316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:11.612316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:11.612316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:11.612316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:11.612316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:11.612316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:11.612316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:11.612316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:11.612316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:11.614251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:11.614251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:11.614251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:11.614251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:11.614251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:11.614251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:11.614251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:11.614251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:11.614251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:11.614251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:11.614251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:11.614251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:11.614251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 265/544] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:43:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:11.617470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa7404-7831-4974-a168-909a3f7439e2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:11.687789 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:11.746669 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fa7404-7831-4974-a168-909a3f7439e2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:11.796135 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02db0b-d428-44fb-ad0b-42afebea2835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:11.796829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02db0b-d428-44fb-ad0b-42afebea2835 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:11.797105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02db0b-d428-44fb-ad0b-42afebea2835 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:11.797370 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02db0b-d428-44fb-ad0b-42afebea2835 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:11.798031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02db0b-d428-44fb-ad0b-42afebea2835 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:11.798328 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02db0b-d428-44fb-ad0b-42afebea2835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:11.799675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02db0b-d428-44fb-ad0b-42afebea2835 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:11.808224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 280/545] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Sep 9 20:43:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:11.813934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256200ce-692c-4b13-a995-e5dee41505d9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:11.922931 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:11.980456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256200ce-692c-4b13-a995-e5dee41505d9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:12.028487 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ca9ec-94e3-4404-8e05-d70062968265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:12.029128 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ca9ec-94e3-4404-8e05-d70062968265 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:12.029405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ca9ec-94e3-4404-8e05-d70062968265 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:12.029678 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ca9ec-94e3-4404-8e05-d70062968265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:12.045288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ca9ec-94e3-4404-8e05-d70062968265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:12.046907 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ca9ec-94e3-4404-8e05-d70062968265 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:12.061485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-693ca9ec-94e3-4404-8e05-d70062968265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:12.061485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:12.061485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:12.061485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:12.061485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:12.061485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:12.061485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:12.061485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:12.061485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:12.061485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:12.061485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:12.061485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:12.061485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:12.061485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:12.061485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:12.061485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:12.063723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:12.063723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:12.063723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:12.063723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:12.063723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:12.063723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:12.063723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:12.063723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:12.063723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:12.063723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:12.063723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:12.063723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:12.063723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:12.063723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:12.063723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:12.063723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:12.063723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:12.065794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:12.065794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:12.065794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:12.065794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 266/546] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:12.068671 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02db0b-d428-44fb-ad0b-42afebea2835 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:12.196883 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02db0b-d428-44fb-ad0b-42afebea2835 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:12.214695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:12.243972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975f5bf-f0a2-4894-87be-59959b5d02d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:12.244610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975f5bf-f0a2-4894-87be-59959b5d02d8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:12.244889 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975f5bf-f0a2-4894-87be-59959b5d02d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:12.245165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975f5bf-f0a2-4894-87be-59959b5d02d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:12.245809 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975f5bf-f0a2-4894-87be-59959b5d02d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:12.246106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975f5bf-f0a2-4894-87be-59959b5d02d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:12.247468 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975f5bf-f0a2-4894-87be-59959b5d02d8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:12.263107 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 281/547] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:12.266288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ca9ec-94e3-4404-8e05-d70062968265 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:12.400915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ca9ec-94e3-4404-8e05-d70062968265 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:12.416160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:12.439691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a51b55-7ac7-4dbc-9988-ce34a50aeb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:12.440703 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a51b55-7ac7-4dbc-9988-ce34a50aeb1c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:12.441184 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a51b55-7ac7-4dbc-9988-ce34a50aeb1c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:12.441655 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a51b55-7ac7-4dbc-9988-ce34a50aeb1c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:12.449859 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a51b55-7ac7-4dbc-9988-ce34a50aeb1c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:12.451531 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a51b55-7ac7-4dbc-9988-ce34a50aeb1c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:12.463616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-a4a51b55-7ac7-4dbc-9988-ce34a50aeb1c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 20:43:12.463616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:12.463616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:12.463616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:12.463616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:12.463616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:12.463616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:12.463616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:12.463616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:12.463616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:12.463616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:12.463616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:12.463616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:12.463616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:12.463616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:12.463616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:12.465058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:12.465058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:12.465058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:12.465058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:12.465058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:12.465058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:12.465058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:12.465058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:12.465058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:12.465058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:12.465058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:12.465058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:12.465058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:12.465058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:12.465058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:12.465058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:12.465058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:12.465058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:12.466096 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:12.466096 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:12.466096 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:12.466096 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:12.466096 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:12.466096 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:12.466096 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:12.466096 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:12.466096 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 20:43:12.466096 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:12.469103 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 267/548] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:43:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:12.474861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975f5bf-f0a2-4894-87be-59959b5d02d8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:12.671611 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975f5bf-f0a2-4894-87be-59959b5d02d8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:12.706707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542a69e-ec99-48eb-8e18-c35706f58858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:12.708181 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542a69e-ec99-48eb-8e18-c35706f58858 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:12.708662 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542a69e-ec99-48eb-8e18-c35706f58858 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:12.709133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542a69e-ec99-48eb-8e18-c35706f58858 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:12.710090 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542a69e-ec99-48eb-8e18-c35706f58858 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:12.710594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542a69e-ec99-48eb-8e18-c35706f58858 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:12.712252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542a69e-ec99-48eb-8e18-c35706f58858 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:12.730918 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 282/549] 10.222.0.15 () {56 vars in 1135 bytes} [Fri Sep 9 20:43:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:12.737466 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a51b55-7ac7-4dbc-9988-ce34a50aeb1c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:12.856959 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a51b55-7ac7-4dbc-9988-ce34a50aeb1c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:12.895042 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7420f-49c9-4d4b-981a-35d4c967f641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:12.896057 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7420f-49c9-4d4b-981a-35d4c967f641 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:12.896558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7420f-49c9-4d4b-981a-35d4c967f641 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:12.897030 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7420f-49c9-4d4b-981a-35d4c967f641 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:12.948467 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:12.978673 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7420f-49c9-4d4b-981a-35d4c967f641 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:12.980634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7420f-49c9-4d4b-981a-35d4c967f641 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:13.103500 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 268/550] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:43:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:43:13.110027 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542a69e-ec99-48eb-8e18-c35706f58858 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:13.124591 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad94682-9756-43d1-9253-3badecc19c6c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:13.126853 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad94682-9756-43d1-9253-3badecc19c6c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:13.127366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad94682-9756-43d1-9253-3badecc19c6c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:13.130361 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 269/551] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:13.135503 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb619b5-4445-4415-be00-8a75dd5e5bf2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:13.136059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb619b5-4445-4415-be00-8a75dd5e5bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:13.136540 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb619b5-4445-4415-be00-8a75dd5e5bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:13.161128 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:13.169473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8fb619b5-4445-4415-be00-8a75dd5e5bf2 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:13.171283 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8fb619b5-4445-4415-be00-8a75dd5e5bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:13.275868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 270/552] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:13.277125 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec809eeb-dfdb-49b6-b403-a6f444405cbc None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:13.277427 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec809eeb-dfdb-49b6-b403-a6f444405cbc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:13.277761 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec809eeb-dfdb-49b6-b403-a6f444405cbc None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:13.279141 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 271/553] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:13.283628 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542a69e-ec99-48eb-8e18-c35706f58858 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:13.286992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38d42d-b380-48f9-bbf2-2d11ef86056c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:13.286992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38d42d-b380-48f9-bbf2-2d11ef86056c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:13.286992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38d42d-b380-48f9-bbf2-2d11ef86056c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:13.310019 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:13.332242 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fe38d42d-b380-48f9-bbf2-2d11ef86056c None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:13.333455 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fe38d42d-b380-48f9-bbf2-2d11ef86056c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:13.346617 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ec9ed-e883-4f83-9cb0-39b8a883d40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:13.347641 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ec9ed-e883-4f83-9cb0-39b8a883d40a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:13.348207 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ec9ed-e883-4f83-9cb0-39b8a883d40a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:13.348691 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ec9ed-e883-4f83-9cb0-39b8a883d40a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:13.366950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ec9ed-e883-4f83-9cb0-39b8a883d40a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:13.369620 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ec9ed-e883-4f83-9cb0-39b8a883d40a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:13.402369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-e68ec9ed-e883-4f83-9cb0-39b8a883d40a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:13.402369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:13.402369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:13.402369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:13.402369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:13.402369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:13.402369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:13.402369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:13.402369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:13.402369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:13.402369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:13.402369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:13.402369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:13.402369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:13.402369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:13.402369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:13.403341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:13.403341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:13.403341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:13.403341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:13.403341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:13.403341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:13.403341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:13.403341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:13.403341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:13.403341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:13.403341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:13.403341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:13.403341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:13.403341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:13.403341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:13.403341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:13.403341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:13.404244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:13.404244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:13.404244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:13.411035 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 283/554] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:13.416640 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ec9ed-e883-4f83-9cb0-39b8a883d40a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:13.481199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 272/555] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 09 20:43:13.495051 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b3e12-118a-4d4a-90aa-29d23a3d534f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:13.495342 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b3e12-118a-4d4a-90aa-29d23a3d534f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:13.495621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b3e12-118a-4d4a-90aa-29d23a3d534f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:13.501412 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 273/556] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:43:13.502859 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a7f8d-8581-492e-bc3e-f36ff3537a96 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:13.503146 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a7f8d-8581-492e-bc3e-f36ff3537a96 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:13.503424 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a7f8d-8581-492e-bc3e-f36ff3537a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:13.521884 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-055a7f8d-8581-492e-bc3e-f36ff3537a96 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:13.523088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-055a7f8d-8581-492e-bc3e-f36ff3537a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:13.568552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:13.575521 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ec9ed-e883-4f83-9cb0-39b8a883d40a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:13.624277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c4e6b-4add-4409-a4ee-06cc1c0415ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:13.625011 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c4e6b-4add-4409-a4ee-06cc1c0415ea None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:13.625297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c4e6b-4add-4409-a4ee-06cc1c0415ea None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:13.625568 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c4e6b-4add-4409-a4ee-06cc1c0415ea None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:13.626318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c4e6b-4add-4409-a4ee-06cc1c0415ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:13.626626 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c4e6b-4add-4409-a4ee-06cc1c0415ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:13.628010 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c4e6b-4add-4409-a4ee-06cc1c0415ea None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:13.630641 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 274/557] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:43:13.631628 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a7f8d-8581-492e-bc3e-f36ff3537a96 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:13.656014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 284/558] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:13.660403 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c4e6b-4add-4409-a4ee-06cc1c0415ea None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:13.738929 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:13.785626 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a7f8d-8581-492e-bc3e-f36ff3537a96 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:13.825581 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d50eb-8a2c-4d97-b7c3-904fc4eccef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:13.826617 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d50eb-8a2c-4d97-b7c3-904fc4eccef1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:13.827606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d50eb-8a2c-4d97-b7c3-904fc4eccef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:13.827889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d50eb-8a2c-4d97-b7c3-904fc4eccef1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:13.841360 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d50eb-8a2c-4d97-b7c3-904fc4eccef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:13.848842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-1e9d50eb-8a2c-4d97-b7c3-904fc4eccef1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:13.848842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:13.848842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:13.848842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:13.848842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:13.848842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:13.848842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:13.848842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:13.848842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:13.848842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:13.848842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:13.848842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:13.848842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:13.848842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:13.848842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:13.848842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:13.849736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:13.849736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:13.849736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:13.849736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:13.849736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:13.849736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:13.849736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:13.849736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:13.849736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:13.849736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:13.849736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:13.849736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:13.849736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:13.849736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:13.849736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:13.849736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:13.850536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:13.850536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:13.850536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:13.850536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:13.850536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:13.850536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:13.850536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:13.850536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:13.850536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:13.850536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:13.850536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:13.850536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:13.850536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 275/559] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:43:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:13.851782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d50eb-8a2c-4d97-b7c3-904fc4eccef1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:13.859387 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c4e6b-4add-4409-a4ee-06cc1c0415ea None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:13.905006 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210d250-c766-4495-a321-b0f0c0b56fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:13.905780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210d250-c766-4495-a321-b0f0c0b56fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:13.906064 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210d250-c766-4495-a321-b0f0c0b56fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:13.906872 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210d250-c766-4495-a321-b0f0c0b56fb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:13.915589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210d250-c766-4495-a321-b0f0c0b56fb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:13.917641 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210d250-c766-4495-a321-b0f0c0b56fb4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:13.932829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a210d250-c766-4495-a321-b0f0c0b56fb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:13.932829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:13.932829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:13.932829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:13.932829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:13.932829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:13.932829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:13.932829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:13.932829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:13.932829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:13.932829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:13.932829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:13.932829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:13.932829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:13.932829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:13.934864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:13.934864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:13.934864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:13.934864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:13.934864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:13.934864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:13.934864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:13.934864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:13.934864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:13.934864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:13.934864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:13.934864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:13.934864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:13.934864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:13.934864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:13.934864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:13.934864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:13.937439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:13.937439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:13.937439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:13.937439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:13.937439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:13.937439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:13.937439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:13.937439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:13.937439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 285/560] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:13.937439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210d250-c766-4495-a321-b0f0c0b56fb4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:13.949730 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:13.981631 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d50eb-8a2c-4d97-b7c3-904fc4eccef1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:14.007305 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:14.022571 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5606e-4684-4d32-8c81-b75ac81dc2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:14.023439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5606e-4684-4d32-8c81-b75ac81dc2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:14.023553 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5606e-4684-4d32-8c81-b75ac81dc2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:14.023751 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5606e-4684-4d32-8c81-b75ac81dc2d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:14.036029 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5606e-4684-4d32-8c81-b75ac81dc2d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:14.040698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-5ef5606e-4684-4d32-8c81-b75ac81dc2d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:14.040698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:14.040698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:14.040698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:14.040698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:14.040698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:14.040698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:14.040698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:14.040698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:14.040698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:14.040698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:14.040698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:14.040698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:14.040698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:14.040698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:14.040698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:14.041704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:14.041704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:14.041704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:14.041704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:14.041704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:14.041704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:14.041704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:14.041704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:14.041704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:14.041704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:14.041704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:14.041704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:14.041704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:14.041704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:14.041704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:14.041704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:14.042555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:14.042555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:14.042555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:14.042555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:14.042555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:14.042555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:14.042555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:14.042555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:14.042555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:14.042555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:14.042555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:14.042555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:14.042555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 276/561] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:43:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:14.042555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5606e-4684-4d32-8c81-b75ac81dc2d3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:14.051173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210d250-c766-4495-a321-b0f0c0b56fb4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:14.085165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bc831-6f6f-438e-b301-4cfbb37f65d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:14.085704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bc831-6f6f-438e-b301-4cfbb37f65d9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:14.085990 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bc831-6f6f-438e-b301-4cfbb37f65d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:14.086262 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001bc831-6f6f-438e-b301-4cfbb37f65d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:14.086920 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bc831-6f6f-438e-b301-4cfbb37f65d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:14.087225 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bc831-6f6f-438e-b301-4cfbb37f65d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:14.088650 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001bc831-6f6f-438e-b301-4cfbb37f65d9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:14.097049 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 286/562] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Sep 9 20:43:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:14.097903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bc831-6f6f-438e-b301-4cfbb37f65d9 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:14.148132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5606e-4684-4d32-8c81-b75ac81dc2d3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:14.166389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:14.183180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f236b7f-749e-445d-95b3-75e5fe77aeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:14.183786 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f236b7f-749e-445d-95b3-75e5fe77aeb4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:14.184094 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f236b7f-749e-445d-95b3-75e5fe77aeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:14.184362 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f236b7f-749e-445d-95b3-75e5fe77aeb4 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:14.185053 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f236b7f-749e-445d-95b3-75e5fe77aeb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:14.185359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f236b7f-749e-445d-95b3-75e5fe77aeb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:14.187063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f236b7f-749e-445d-95b3-75e5fe77aeb4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:14.198314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 277/563] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:14.199235 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001bc831-6f6f-438e-b301-4cfbb37f65d9 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:14.199499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdde89-7ec6-4206-bdfa-54e3fff0417d None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:14.199785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdde89-7ec6-4206-bdfa-54e3fff0417d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:14.200090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdde89-7ec6-4206-bdfa-54e3fff0417d None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:14.201280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 278/564] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:14.202149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdde89-7ec6-4206-bdfa-54e3fff0417d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:14.237594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f26b0-a3bb-46d3-94e9-3f7bd7892218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:14.238224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f26b0-a3bb-46d3-94e9-3f7bd7892218 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:14.238500 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f26b0-a3bb-46d3-94e9-3f7bd7892218 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:14.238776 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f26b0-a3bb-46d3-94e9-3f7bd7892218 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:14.248618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f26b0-a3bb-46d3-94e9-3f7bd7892218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:14.249309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:14.253954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-5e9f26b0-a3bb-46d3-94e9-3f7bd7892218 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:14.253954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:14.253954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:14.253954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:14.253954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:14.253954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:14.253954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:14.253954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:14.253954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:14.253954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:14.253954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:14.253954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:14.253954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:14.253954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:14.253954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:14.253954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:14.254914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:14.254914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:14.254914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:14.254914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:14.254914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:14.254914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:14.254914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:14.254914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:14.254914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:14.254914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:14.254914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:14.254914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:14.254914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:14.254914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:14.254914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:14.254914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:14.255747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:14.255747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:14.255747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:14.255747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:14.255747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:14.255747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:14.255747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:14.255747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:14.255747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:14.255747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:14.255747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:14.255747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:14.255747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 287/565] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:43:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:14.257089 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f26b0-a3bb-46d3-94e9-3f7bd7892218 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:14.310753 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdde89-7ec6-4206-bdfa-54e3fff0417d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:14.344817 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc97dbf-dadf-4aa2-9e3a-0d17f6dca367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:14.345359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc97dbf-dadf-4aa2-9e3a-0d17f6dca367 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:14.345641 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc97dbf-dadf-4aa2-9e3a-0d17f6dca367 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:14.345912 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc97dbf-dadf-4aa2-9e3a-0d17f6dca367 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:14.346570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc97dbf-dadf-4aa2-9e3a-0d17f6dca367 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:14.346874 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc97dbf-dadf-4aa2-9e3a-0d17f6dca367 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:14.348286 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc97dbf-dadf-4aa2-9e3a-0d17f6dca367 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:14.355413 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f26b0-a3bb-46d3-94e9-3f7bd7892218 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:14.355938 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 279/566] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Sep 9 20:43:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:14.356741 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc97dbf-dadf-4aa2-9e3a-0d17f6dca367 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:14.386398 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:14.392989 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f982b6e-219b-461b-92e9-dd07958b18f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:14.393621 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f982b6e-219b-461b-92e9-dd07958b18f1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:14.393899 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f982b6e-219b-461b-92e9-dd07958b18f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:14.394178 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f982b6e-219b-461b-92e9-dd07958b18f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:14.404862 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f982b6e-219b-461b-92e9-dd07958b18f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:14.406430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f982b6e-219b-461b-92e9-dd07958b18f1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:14.420173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-6f982b6e-219b-461b-92e9-dd07958b18f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:14.420173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:14.420173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:14.420173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:14.420173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:14.420173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:14.420173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:14.420173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:14.420173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:14.420173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:14.420173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:14.420173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:14.420173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:14.420173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:14.420173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:14.420173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:14.421767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:14.421767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:14.421767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:14.421767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:14.421767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:14.421767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:14.421767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:14.421767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:14.421767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:14.421767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:14.421767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:14.421767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:14.421767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:14.421767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:14.421767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:14.421767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:14.421767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:14.422690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:14.422690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:14.422690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:14.422690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 288/567] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:14.422929 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45bc5a-a3e4-4fdc-a403-492a992b88a5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:14.423234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45bc5a-a3e4-4fdc-a403-492a992b88a5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:14.423447 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45bc5a-a3e4-4fdc-a403-492a992b88a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:14.441738 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-dd45bc5a-a3e4-4fdc-a403-492a992b88a5 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:14.442935 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dd45bc5a-a3e4-4fdc-a403-492a992b88a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:14.466246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc97dbf-dadf-4aa2-9e3a-0d17f6dca367 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:14.473995 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:14.501477 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15035115-e0ba-4868-92d8-30e75b624be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:14.502078 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15035115-e0ba-4868-92d8-30e75b624be4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:14.502355 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15035115-e0ba-4868-92d8-30e75b624be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:14.502625 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15035115-e0ba-4868-92d8-30e75b624be4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:14.503334 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15035115-e0ba-4868-92d8-30e75b624be4 None admin] RBAC: Adding query filter params (role.id=e3de94d5ee924ea4b638d196d282af55, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=9570eaa112de460cb9e371278bfb300b) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:14.503640 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15035115-e0ba-4868-92d8-30e75b624be4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:14.505169 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15035115-e0ba-4868-92d8-30e75b624be4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:14.508084 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 289/568] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:14.510474 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 280/569] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:43:14 2022] GET /identity/v3/role_assignments?user.id=9570eaa112de460cb9e371278bfb300b&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=e3de94d5ee924ea4b638d196d282af55 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:14.511258 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15035115-e0ba-4868-92d8-30e75b624be4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:14.512943 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45bc5a-a3e4-4fdc-a403-492a992b88a5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:14.636532 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45bc5a-a3e4-4fdc-a403-492a992b88a5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:14.654452 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:14.663171 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15035115-e0ba-4868-92d8-30e75b624be4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:14.680066 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230c8ae-cf04-4902-99c2-92bd252bdeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:14.680691 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230c8ae-cf04-4902-99c2-92bd252bdeba None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:14.681013 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230c8ae-cf04-4902-99c2-92bd252bdeba None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:14.681299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230c8ae-cf04-4902-99c2-92bd252bdeba None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:14.681963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230c8ae-cf04-4902-99c2-92bd252bdeba None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:14.682265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230c8ae-cf04-4902-99c2-92bd252bdeba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:14.683658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230c8ae-cf04-4902-99c2-92bd252bdeba None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:14.699530 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 290/570] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Sep 9 20:43:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:14.699530 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230c8ae-cf04-4902-99c2-92bd252bdeba None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:14.723221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6711a-acc0-498d-834e-1cfd952cd99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:14.724219 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6711a-acc0-498d-834e-1cfd952cd99e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:14.724516 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6711a-acc0-498d-834e-1cfd952cd99e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:14.725175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6711a-acc0-498d-834e-1cfd952cd99e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:14.740151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6711a-acc0-498d-834e-1cfd952cd99e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:14.741905 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6711a-acc0-498d-834e-1cfd952cd99e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:14.767133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-aad6711a-acc0-498d-834e-1cfd952cd99e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:14.767133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:14.767133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:14.767133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:14.767133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:14.767133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:14.767133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:14.767133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:14.767133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:14.767133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:14.767133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:14.767133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:14.767133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:14.767133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:14.767133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:14.767133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:14.768151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:14.768151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:14.768151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:14.768151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:14.768151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:14.768151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:14.768151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:14.768151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:14.768151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:14.768151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:14.768151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:14.768151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:14.768151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:14.768151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:14.768151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:14.768151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:14.768151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:14.769029 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:14.769029 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:14.769029 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:14.769638 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 281/571] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:14.774160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6711a-acc0-498d-834e-1cfd952cd99e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:14.801238 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:14.823621 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230c8ae-cf04-4902-99c2-92bd252bdeba None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:14.860197 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd834a2-1f51-428a-9fec-59776040bf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:14.860822 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd834a2-1f51-428a-9fec-59776040bf40 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:14.861487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd834a2-1f51-428a-9fec-59776040bf40 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:14.861487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd834a2-1f51-428a-9fec-59776040bf40 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:14.862073 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd834a2-1f51-428a-9fec-59776040bf40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:14.862376 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd834a2-1f51-428a-9fec-59776040bf40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:14.863750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd834a2-1f51-428a-9fec-59776040bf40 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:14.876068 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 291/572] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:14.876735 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd834a2-1f51-428a-9fec-59776040bf40 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:14.895313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6711a-acc0-498d-834e-1cfd952cd99e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:14.911901 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:14.940326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404a007-6f5e-4997-bb94-45e19163a64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:14.940963 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404a007-6f5e-4997-bb94-45e19163a64f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:14.941243 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404a007-6f5e-4997-bb94-45e19163a64f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:14.941516 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404a007-6f5e-4997-bb94-45e19163a64f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:14.953257 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404a007-6f5e-4997-bb94-45e19163a64f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:14.954746 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404a007-6f5e-4997-bb94-45e19163a64f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:14.969770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-1404a007-6f5e-4997-bb94-45e19163a64f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:14.969770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:14.969770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:14.969770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:14.969770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:14.969770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:14.969770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:14.969770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:14.969770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:14.969770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:14.969770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:14.969770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:14.969770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:14.969770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:14.969770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:14.969770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:14.970726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:14.970726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:14.970726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:14.970726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:14.970726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:14.970726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:14.970726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:14.970726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:14.970726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:14.970726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:14.970726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:14.970726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:14.970726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:14.970726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:14.970726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:14.970726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:14.970726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:14.971711 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:14.971711 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:14.971711 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:14.977634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 282/573] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:14.977634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404a007-6f5e-4997-bb94-45e19163a64f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:14.989223 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd834a2-1f51-428a-9fec-59776040bf40 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:15.033469 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad87dd3-374c-49c6-ab8a-323dd2162210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:15.034619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad87dd3-374c-49c6-ab8a-323dd2162210 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:15.035230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad87dd3-374c-49c6-ab8a-323dd2162210 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:15.035719 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad87dd3-374c-49c6-ab8a-323dd2162210 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:15.037209 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad87dd3-374c-49c6-ab8a-323dd2162210 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:15.037721 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad87dd3-374c-49c6-ab8a-323dd2162210 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:15.040011 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad87dd3-374c-49c6-ab8a-323dd2162210 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:15.057632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 292/574] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:15.057632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad87dd3-374c-49c6-ab8a-323dd2162210 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:15.058122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:15.085654 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404a007-6f5e-4997-bb94-45e19163a64f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:15.120627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69684093-90dd-4c61-8f2c-a9b213335c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:15.121341 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69684093-90dd-4c61-8f2c-a9b213335c0b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:15.121621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69684093-90dd-4c61-8f2c-a9b213335c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:15.121889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69684093-90dd-4c61-8f2c-a9b213335c0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:15.132728 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69684093-90dd-4c61-8f2c-a9b213335c0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:15.137928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-69684093-90dd-4c61-8f2c-a9b213335c0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:15.137928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:15.137928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:15.137928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:15.137928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:15.137928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:15.137928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:15.137928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:15.137928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:15.137928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:15.137928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:15.137928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:15.137928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:15.137928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:15.137928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:15.137928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:15.138845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:15.138845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:15.138845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:15.138845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:15.138845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:15.138845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:15.138845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:15.138845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:15.138845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:15.138845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:15.138845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:15.138845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:15.138845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:15.138845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:15.138845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:15.138845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:15.140290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:15.140290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:15.140290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:15.140290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:15.140290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:15.140290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:15.140290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:15.140290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:15.140290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:15.140290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:15.140290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:15.140290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:15.140290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 283/575] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:43:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:15.140972 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69684093-90dd-4c61-8f2c-a9b213335c0b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:15.161058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:15.168636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad87dd3-374c-49c6-ab8a-323dd2162210 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:15.204200 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026588d-c62f-43b6-a765-aa1c7e10b7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:15.204971 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026588d-c62f-43b6-a765-aa1c7e10b7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:15.205256 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026588d-c62f-43b6-a765-aa1c7e10b7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:15.205519 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026588d-c62f-43b6-a765-aa1c7e10b7b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:15.213423 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026588d-c62f-43b6-a765-aa1c7e10b7b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:15.214862 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026588d-c62f-43b6-a765-aa1c7e10b7b8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:15.227722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-2026588d-c62f-43b6-a765-aa1c7e10b7b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 20:43:15.227722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:15.227722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:15.227722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:15.227722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:15.227722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:15.227722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:15.227722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:15.227722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:15.227722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:15.227722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:15.227722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:15.227722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:15.227722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:15.227722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:15.227722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:15.228922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:15.228922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:15.228922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:15.228922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:15.228922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:15.228922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:15.228922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:15.228922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:15.228922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:15.228922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:15.228922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:15.228922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:15.228922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:15.228922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:15.228922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:15.228922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:15.228922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:15.228922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:15.229845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:15.229845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:15.229845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:15.229845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:15.229845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:15.229845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:15.229845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:15.229845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:15.229845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 20:43:15.229845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:15.229845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 293/576] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Sep 9 20:43:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:15.229845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026588d-c62f-43b6-a765-aa1c7e10b7b8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:15.255814 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69684093-90dd-4c61-8f2c-a9b213335c0b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:15.293863 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec1f9c-c62d-4f35-8cfd-b8d1e987d3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:15.294483 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec1f9c-c62d-4f35-8cfd-b8d1e987d3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:15.294762 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec1f9c-c62d-4f35-8cfd-b8d1e987d3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:15.295033 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec1f9c-c62d-4f35-8cfd-b8d1e987d3a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:15.296413 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec1f9c-c62d-4f35-8cfd-b8d1e987d3a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:15.296803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec1f9c-c62d-4f35-8cfd-b8d1e987d3a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:15.298343 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec1f9c-c62d-4f35-8cfd-b8d1e987d3a3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:15.299857 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:15.318534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 284/577] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:15.318534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec1f9c-c62d-4f35-8cfd-b8d1e987d3a3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:15.347104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026588d-c62f-43b6-a765-aa1c7e10b7b8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:15.384699 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee4be7-0936-4b54-a16a-45c10a596e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:15.385324 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee4be7-0936-4b54-a16a-45c10a596e7f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:15.385600 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee4be7-0936-4b54-a16a-45c10a596e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:15.385884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee4be7-0936-4b54-a16a-45c10a596e7f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:15.394270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee4be7-0936-4b54-a16a-45c10a596e7f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:15.395498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee4be7-0936-4b54-a16a-45c10a596e7f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:15.407739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-27ee4be7-0936-4b54-a16a-45c10a596e7f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 20:43:15.407739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:15.407739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:15.407739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:15.407739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:15.407739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:15.407739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:15.407739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:15.407739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:15.407739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:15.407739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:15.407739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:15.407739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:15.407739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:15.407739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:15.407739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:15.408715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:15.408715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:15.408715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:15.408715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:15.408715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:15.408715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:15.408715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:15.408715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:15.408715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:15.408715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:15.408715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:15.408715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:15.408715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:15.408715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:15.408715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:15.408715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:15.408715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:15.408715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:15.409637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:15.409637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:15.409637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:15.409637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:15.409637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:15.409637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:15.409637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:15.409637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:15.409637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 20:43:15.409637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:15.409637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 294/578] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:43:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:15.409637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee4be7-0936-4b54-a16a-45c10a596e7f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:15.424157 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec1f9c-c62d-4f35-8cfd-b8d1e987d3a3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:15.428990 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:15.466380 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34c8a0-bbed-4aec-a178-c44fa093683c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:15.466983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34c8a0-bbed-4aec-a178-c44fa093683c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:15.467260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34c8a0-bbed-4aec-a178-c44fa093683c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:15.467558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34c8a0-bbed-4aec-a178-c44fa093683c None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:15.468231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34c8a0-bbed-4aec-a178-c44fa093683c None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:15.468529 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34c8a0-bbed-4aec-a178-c44fa093683c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:15.469891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34c8a0-bbed-4aec-a178-c44fa093683c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:15.482539 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 285/579] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Sep 9 20:43:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:15.482539 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34c8a0-bbed-4aec-a178-c44fa093683c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:15.524842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee4be7-0936-4b54-a16a-45c10a596e7f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:15.543129 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:15.559391 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d73001-4b04-4a42-859f-507de964cec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:15.560016 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d73001-4b04-4a42-859f-507de964cec2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:15.560371 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d73001-4b04-4a42-859f-507de964cec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:15.560647 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d73001-4b04-4a42-859f-507de964cec2 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:15.561901 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d73001-4b04-4a42-859f-507de964cec2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:15.562196 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d73001-4b04-4a42-859f-507de964cec2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:15.563737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d73001-4b04-4a42-859f-507de964cec2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:15.581738 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 295/580] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Sep 9 20:43:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:15.582532 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d73001-4b04-4a42-859f-507de964cec2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:15.595326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34c8a0-bbed-4aec-a178-c44fa093683c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:15.629991 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd162dfe-5a2d-4ff5-8131-63e6e79d8fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:15.630623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162dfe-5a2d-4ff5-8131-63e6e79d8fea None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:15.630944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162dfe-5a2d-4ff5-8131-63e6e79d8fea None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:15.631219 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162dfe-5a2d-4ff5-8131-63e6e79d8fea None admin] PATH_INFO: `/v3/users/glance` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:15.639025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd162dfe-5a2d-4ff5-8131-63e6e79d8fea None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:15.640741 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd162dfe-5a2d-4ff5-8131-63e6e79d8fea None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:15.652152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-cd162dfe-5a2d-4ff5-8131-63e6e79d8fea None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 20:43:15.652152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:15.652152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:15.652152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:15.652152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:15.652152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:15.652152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:15.652152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:15.652152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:15.652152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:15.652152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:15.652152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:15.652152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:15.652152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:15.652152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:15.652152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:15.653160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:15.653160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:15.653160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:15.653160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:15.653160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:15.653160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:15.653160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:15.653160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:15.653160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:15.653160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:15.653160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:15.653160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:15.653160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:15.653160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:15.653160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:15.653160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:15.653160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:15.653160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:15.654083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:15.654083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:15.654083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:15.654083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:15.654083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:15.654083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:15.654083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:15.654083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:15.654083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 20:43:15.654083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:15.654083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 286/581] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:43:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:15.654686 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd162dfe-5a2d-4ff5-8131-63e6e79d8fea None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:15.663047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:15.694253 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d73001-4b04-4a42-859f-507de964cec2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:15.731335 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309444f-8d0c-4a4d-a238-378a8b366d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:15.731941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309444f-8d0c-4a4d-a238-378a8b366d0c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:15.732247 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309444f-8d0c-4a4d-a238-378a8b366d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:15.732519 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309444f-8d0c-4a4d-a238-378a8b366d0c None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:15.733860 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309444f-8d0c-4a4d-a238-378a8b366d0c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:15.734309 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309444f-8d0c-4a4d-a238-378a8b366d0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:15.735757 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309444f-8d0c-4a4d-a238-378a8b366d0c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:15.754956 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 296/582] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Sep 9 20:43:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:15.755851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309444f-8d0c-4a4d-a238-378a8b366d0c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:15.766416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd162dfe-5a2d-4ff5-8131-63e6e79d8fea None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:15.783381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:15.801786 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a243f53-767f-49d8-bbfe-9a2032204577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:15.802416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a243f53-767f-49d8-bbfe-9a2032204577 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:15.802692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a243f53-767f-49d8-bbfe-9a2032204577 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:15.802960 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a243f53-767f-49d8-bbfe-9a2032204577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:15.814644 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a243f53-767f-49d8-bbfe-9a2032204577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:15.816127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a243f53-767f-49d8-bbfe-9a2032204577 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:15.830566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-4a243f53-767f-49d8-bbfe-9a2032204577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:15.830566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:15.830566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:15.830566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:15.830566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:15.830566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:15.830566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:15.830566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:15.830566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:15.830566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:15.830566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:15.830566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:15.830566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:15.830566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:15.830566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:15.830566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:15.831495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:15.831495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:15.831495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:15.831495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:15.831495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:15.831495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:15.831495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:15.831495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:15.831495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:15.831495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:15.831495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:15.831495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:15.831495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:15.831495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:15.831495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:15.831495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:15.831495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:15.832407 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:15.832407 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:15.832407 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:15.832407 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 287/583] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:15.832407 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a243f53-767f-49d8-bbfe-9a2032204577 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:15.869530 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309444f-8d0c-4a4d-a238-378a8b366d0c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:15.899918 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:15.907245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f954d6-7fd8-4b24-8968-0e6b1fe453c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:15.907954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f954d6-7fd8-4b24-8968-0e6b1fe453c4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:15.908276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f954d6-7fd8-4b24-8968-0e6b1fe453c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:15.908549 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f954d6-7fd8-4b24-8968-0e6b1fe453c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:15.918747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f954d6-7fd8-4b24-8968-0e6b1fe453c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:15.920215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f954d6-7fd8-4b24-8968-0e6b1fe453c4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:15.935076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-43f954d6-7fd8-4b24-8968-0e6b1fe453c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:15.935076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:15.935076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:15.935076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:15.935076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:15.935076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:15.935076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:15.935076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:15.935076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:15.935076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:15.935076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:15.935076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:15.935076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:15.935076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:15.935076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:15.935076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:15.936120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:15.936120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:15.936120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:15.936120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:15.936120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:15.936120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:15.936120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:15.936120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:15.936120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:15.936120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:15.936120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:15.936120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:15.936120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:15.936120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:15.936120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:15.936120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:15.936120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:15.937112 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:15.937112 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:15.937112 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:15.937112 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 297/584] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:15.937332 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f954d6-7fd8-4b24-8968-0e6b1fe453c4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:15.944386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a243f53-767f-49d8-bbfe-9a2032204577 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:15.985108 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a230c9-b06a-43be-a46b-e7d171fbee67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:15.985749 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a230c9-b06a-43be-a46b-e7d171fbee67 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:15.986029 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a230c9-b06a-43be-a46b-e7d171fbee67 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:15.986300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a230c9-b06a-43be-a46b-e7d171fbee67 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:15.987019 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a230c9-b06a-43be-a46b-e7d171fbee67 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:15.987330 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a230c9-b06a-43be-a46b-e7d171fbee67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:15.988787 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a230c9-b06a-43be-a46b-e7d171fbee67 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:16.006759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 288/585] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Sep 9 20:43:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:16.011850 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a230c9-b06a-43be-a46b-e7d171fbee67 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:16.040677 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:16.048262 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f954d6-7fd8-4b24-8968-0e6b1fe453c4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:16.083147 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8d628-5273-4ea4-b670-36a5090ba873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:16.083774 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8d628-5273-4ea4-b670-36a5090ba873 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:16.084083 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8d628-5273-4ea4-b670-36a5090ba873 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:16.084358 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8d628-5273-4ea4-b670-36a5090ba873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:16.095706 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8d628-5273-4ea4-b670-36a5090ba873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:16.097215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8d628-5273-4ea4-b670-36a5090ba873 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:16.112470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c4f8d628-5273-4ea4-b670-36a5090ba873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:16.112470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:16.112470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:16.112470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:16.112470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:16.112470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:16.112470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:16.112470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:16.112470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:16.112470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:16.112470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:16.112470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:16.112470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:16.112470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:16.112470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:16.112470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:16.113437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:16.113437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:16.113437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:16.113437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:16.113437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:16.113437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:16.113437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:16.113437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:16.113437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:16.113437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:16.113437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:16.113437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:16.113437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:16.113437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:16.113437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:16.113437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:16.113437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:16.114297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:16.114297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:16.114297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:16.114297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 298/586] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:16.115322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8d628-5273-4ea4-b670-36a5090ba873 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:16.123128 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a230c9-b06a-43be-a46b-e7d171fbee67 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:16.156300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:16.162720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c76023-a2be-499b-9257-2b25244344f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:16.163458 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c76023-a2be-499b-9257-2b25244344f9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:16.163594 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c76023-a2be-499b-9257-2b25244344f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:16.163860 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c76023-a2be-499b-9257-2b25244344f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:16.164566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c76023-a2be-499b-9257-2b25244344f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:16.164860 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c76023-a2be-499b-9257-2b25244344f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:16.166212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c76023-a2be-499b-9257-2b25244344f9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:16.178777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 289/587] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:16.179395 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c76023-a2be-499b-9257-2b25244344f9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:16.233685 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8d628-5273-4ea4-b670-36a5090ba873 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:16.267862 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:16.269594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82d74a-1e24-4846-bf17-ccc1ace6bae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:16.270302 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82d74a-1e24-4846-bf17-ccc1ace6bae3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:16.270546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82d74a-1e24-4846-bf17-ccc1ace6bae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:16.270822 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82d74a-1e24-4846-bf17-ccc1ace6bae3 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:16.271458 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82d74a-1e24-4846-bf17-ccc1ace6bae3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:16.271757 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82d74a-1e24-4846-bf17-ccc1ace6bae3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:16.273155 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82d74a-1e24-4846-bf17-ccc1ace6bae3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:16.285410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 299/588] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:16.286267 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82d74a-1e24-4846-bf17-ccc1ace6bae3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:16.289526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c76023-a2be-499b-9257-2b25244344f9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:16.337675 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cbc1c-ada0-4bfd-8436-1e5ec8f1751a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:16.339351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cbc1c-ada0-4bfd-8436-1e5ec8f1751a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:16.339820 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cbc1c-ada0-4bfd-8436-1e5ec8f1751a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:16.340298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0cbc1c-ada0-4bfd-8436-1e5ec8f1751a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:16.356589 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cbc1c-ada0-4bfd-8436-1e5ec8f1751a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:16.359546 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0cbc1c-ada0-4bfd-8436-1e5ec8f1751a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:16.375406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-5d0cbc1c-ada0-4bfd-8436-1e5ec8f1751a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:16.375406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:16.375406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:16.375406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:16.375406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:16.375406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:16.375406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:16.375406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:16.375406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:16.375406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:16.375406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:16.375406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:16.375406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:16.375406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:16.375406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:16.375406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:16.376382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:16.376382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:16.376382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:16.376382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:16.376382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:16.376382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:16.376382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:16.376382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:16.376382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:16.376382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:16.376382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:16.376382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:16.376382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:16.376382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:16.376382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:16.376382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:16.376382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:16.377345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:16.377345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:16.377345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:16.377345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 290/589] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:16.377345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cbc1c-ada0-4bfd-8436-1e5ec8f1751a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:16.396996 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:16.405509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82d74a-1e24-4846-bf17-ccc1ace6bae3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:16.442116 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d1e2b-34fd-4d22-bce9-edb618ff07ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:16.442729 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d1e2b-34fd-4d22-bce9-edb618ff07ce None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:16.443039 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d1e2b-34fd-4d22-bce9-edb618ff07ce None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:16.443277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d1e2b-34fd-4d22-bce9-edb618ff07ce None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:16.443923 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d1e2b-34fd-4d22-bce9-edb618ff07ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:16.444259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d1e2b-34fd-4d22-bce9-edb618ff07ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:16.445635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0d1e2b-34fd-4d22-bce9-edb618ff07ce None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:16.458238 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 300/590] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:16.463429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d1e2b-34fd-4d22-bce9-edb618ff07ce None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:16.485381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0cbc1c-ada0-4bfd-8436-1e5ec8f1751a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:16.522062 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585799f-776e-4274-a7a3-018c93fd638d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:16.522703 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585799f-776e-4274-a7a3-018c93fd638d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:16.522985 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585799f-776e-4274-a7a3-018c93fd638d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:16.523259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585799f-776e-4274-a7a3-018c93fd638d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:16.531861 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585799f-776e-4274-a7a3-018c93fd638d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:16.533541 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585799f-776e-4274-a7a3-018c93fd638d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:16.536114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:16.546691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-d585799f-776e-4274-a7a3-018c93fd638d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 20:43:16.546691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:16.546691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:16.546691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:16.546691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:16.546691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:16.546691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:16.546691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:16.546691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:16.546691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:16.546691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:16.546691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:16.546691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:16.546691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:16.546691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:16.546691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:16.547737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:16.547737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:16.547737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:16.547737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:16.547737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:16.547737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:16.547737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:16.547737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:16.547737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:16.547737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:16.547737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:16.547737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:16.547737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:16.547737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:16.547737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:16.547737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:16.547737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:16.547737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:16.548696 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:16.548696 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:16.548696 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:16.548696 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:16.548696 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:16.548696 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:16.548696 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:16.548696 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:16.548696 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 20:43:16.548696 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:16.548696 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 291/591] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:43:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:16.549287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585799f-776e-4274-a7a3-018c93fd638d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:16.577576 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d1e2b-34fd-4d22-bce9-edb618ff07ce None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:16.616619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ae161-79b9-42c7-9017-af4a6861d8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:16.617296 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ae161-79b9-42c7-9017-af4a6861d8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:16.617570 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ae161-79b9-42c7-9017-af4a6861d8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:16.618026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ae161-79b9-42c7-9017-af4a6861d8e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:16.626911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ae161-79b9-42c7-9017-af4a6861d8e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:16.628407 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425ae161-79b9-42c7-9017-af4a6861d8e5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:16.640130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-425ae161-79b9-42c7-9017-af4a6861d8e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:16.640130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:16.640130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:16.640130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:16.640130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:16.640130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:16.640130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:16.640130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:16.640130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:16.640130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:16.640130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:16.640130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:16.640130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:16.640130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:16.640130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:16.641265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:16.641265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:16.641265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:16.641265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:16.641265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:16.641265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:16.641265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:16.641265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:16.641265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:16.641265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:16.641265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:16.641265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:16.641265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:16.641265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:16.641265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:16.641265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:16.641265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:16.642325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:16.642325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:16.642325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:16.642325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:16.642325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:16.642325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:16.642325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:16.642325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:16.645959 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 301/592] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:16.646785 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ae161-79b9-42c7-9017-af4a6861d8e5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:16.663739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:16.664739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585799f-776e-4274-a7a3-018c93fd638d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:16.700862 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f68ab-fe75-4ab0-9467-9d6c01c7f83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:16.701479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f68ab-fe75-4ab0-9467-9d6c01c7f83b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:16.701797 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f68ab-fe75-4ab0-9467-9d6c01c7f83b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:16.702067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f68ab-fe75-4ab0-9467-9d6c01c7f83b None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:16.702795 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f68ab-fe75-4ab0-9467-9d6c01c7f83b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:16.703103 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f68ab-fe75-4ab0-9467-9d6c01c7f83b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:16.704531 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f68ab-fe75-4ab0-9467-9d6c01c7f83b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:16.716226 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 292/593] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:16.717048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f68ab-fe75-4ab0-9467-9d6c01c7f83b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:16.755653 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425ae161-79b9-42c7-9017-af4a6861d8e5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:16.774463 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:16.790448 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb48e7a-129e-49e4-a917-e365d6971a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:16.791071 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb48e7a-129e-49e4-a917-e365d6971a14 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:16.791349 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb48e7a-129e-49e4-a917-e365d6971a14 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:16.791633 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb48e7a-129e-49e4-a917-e365d6971a14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:16.798788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb48e7a-129e-49e4-a917-e365d6971a14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:16.800275 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb48e7a-129e-49e4-a917-e365d6971a14 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:16.811422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-7eb48e7a-129e-49e4-a917-e365d6971a14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:16.811422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:16.811422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:16.811422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:16.811422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:16.811422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:16.811422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:16.811422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:16.811422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:16.811422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:16.811422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:16.811422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:16.811422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:16.811422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:16.811422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:16.812636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:16.812636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:16.812636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:16.812636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:16.812636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:16.812636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:16.812636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:16.812636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:16.812636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:16.812636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:16.812636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:16.812636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:16.812636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:16.812636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:16.812636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:16.812636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:16.812636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:16.813525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:16.813525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:16.813525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:16.813525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:16.813525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:16.813525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:16.813525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:16.813525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:16.813525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 302/594] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:16.813525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb48e7a-129e-49e4-a917-e365d6971a14 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:16.821082 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f68ab-fe75-4ab0-9467-9d6c01c7f83b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:16.855855 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a02d9-45fc-414d-88bc-664d2dcfb87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:16.856496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a02d9-45fc-414d-88bc-664d2dcfb87e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:16.856775 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a02d9-45fc-414d-88bc-664d2dcfb87e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:16.857049 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a02d9-45fc-414d-88bc-664d2dcfb87e None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:16.857884 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a02d9-45fc-414d-88bc-664d2dcfb87e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:16.858169 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a02d9-45fc-414d-88bc-664d2dcfb87e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:16.859679 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a02d9-45fc-414d-88bc-664d2dcfb87e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:16.877263 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 293/595] 10.222.0.15 () {56 vars in 1139 bytes} [Fri Sep 9 20:43:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:16.878662 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82708b-f2df-4c2c-b37a-86c1aa83f91a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:16.878952 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82708b-f2df-4c2c-b37a-86c1aa83f91a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:16.879228 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82708b-f2df-4c2c-b37a-86c1aa83f91a None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:16.880700 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 294/596] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:16.881482 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82708b-f2df-4c2c-b37a-86c1aa83f91a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:16.893738 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:16.918191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb48e7a-129e-49e4-a917-e365d6971a14 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:16.952352 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12201e-e60d-4199-abe4-b247e435eced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:16.953189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12201e-e60d-4199-abe4-b247e435eced None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:16.953472 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12201e-e60d-4199-abe4-b247e435eced None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:16.953748 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12201e-e60d-4199-abe4-b247e435eced None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:16.954439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12201e-e60d-4199-abe4-b247e435eced None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:16.954748 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12201e-e60d-4199-abe4-b247e435eced None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:16.956206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d12201e-e60d-4199-abe4-b247e435eced None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:16.968072 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 303/597] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:16.968962 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12201e-e60d-4199-abe4-b247e435eced None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:16.991035 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82708b-f2df-4c2c-b37a-86c1aa83f91a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:17.008118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:17.027793 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf6154-4e3b-461c-a807-d23ff4c751a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:17.028447 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf6154-4e3b-461c-a807-d23ff4c751a5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:17.028723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf6154-4e3b-461c-a807-d23ff4c751a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:17.028992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf6154-4e3b-461c-a807-d23ff4c751a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:17.035425 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf6154-4e3b-461c-a807-d23ff4c751a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:17.036889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf6154-4e3b-461c-a807-d23ff4c751a5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:17.047840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-acdf6154-4e3b-461c-a807-d23ff4c751a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:17.047840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:17.047840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:17.047840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:17.047840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:17.047840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:17.047840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:17.047840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:17.047840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:17.047840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:17.047840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:17.047840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:17.047840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:17.047840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:17.047840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:17.049003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:17.049003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:17.049003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:17.049003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:17.049003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:17.049003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:17.049003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:17.049003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:17.049003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:17.049003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:17.049003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:17.049003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:17.049003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:17.049003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:17.049003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:17.049003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:17.049003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:17.049887 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:17.049887 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:17.049887 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:17.049887 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:17.049887 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:17.049887 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:17.049887 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:17.049887 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:17.049887 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 295/598] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:17.049887 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf6154-4e3b-461c-a807-d23ff4c751a5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:17.070181 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12201e-e60d-4199-abe4-b247e435eced None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:17.105011 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cceb7c-b576-4ff4-82d6-bebd68b4a5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:17.105604 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cceb7c-b576-4ff4-82d6-bebd68b4a5be None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:17.105886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cceb7c-b576-4ff4-82d6-bebd68b4a5be None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:17.106161 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cceb7c-b576-4ff4-82d6-bebd68b4a5be None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:17.106851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cceb7c-b576-4ff4-82d6-bebd68b4a5be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:17.107153 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cceb7c-b576-4ff4-82d6-bebd68b4a5be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:17.109565 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cceb7c-b576-4ff4-82d6-bebd68b4a5be None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:17.111097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:17.122474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 304/599] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:17.123804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dada8b5-9ded-45c1-85e0-81b45f8c8b63 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:17.124119 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dada8b5-9ded-45c1-85e0-81b45f8c8b63 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:17.124407 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dada8b5-9ded-45c1-85e0-81b45f8c8b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:17.141787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5dada8b5-9ded-45c1-85e0-81b45f8c8b63 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:17.142989 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5dada8b5-9ded-45c1-85e0-81b45f8c8b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:17.155280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf6154-4e3b-461c-a807-d23ff4c751a5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:17.189650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7db54-df7c-4fd6-a1ec-c77b0d062f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:17.190402 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7db54-df7c-4fd6-a1ec-c77b0d062f03 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:17.190746 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7db54-df7c-4fd6-a1ec-c77b0d062f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:17.191025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7db54-df7c-4fd6-a1ec-c77b0d062f03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:17.201505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7db54-df7c-4fd6-a1ec-c77b0d062f03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:17.202956 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f7db54-df7c-4fd6-a1ec-c77b0d062f03 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:17.208900 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 305/600] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:17.209704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dada8b5-9ded-45c1-85e0-81b45f8c8b63 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:17.228450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c7f7db54-df7c-4fd6-a1ec-c77b0d062f03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:17.228450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:17.228450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:17.228450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:17.228450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:17.228450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:17.228450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:17.228450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:17.228450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:17.228450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:17.228450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:17.228450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:17.228450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:17.228450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:17.228450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:17.228450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:17.229415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:17.229415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:17.229415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:17.229415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:17.229415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:17.229415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:17.229415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:17.229415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:17.229415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:17.229415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:17.229415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:17.229415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:17.229415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:17.229415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:17.229415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:17.229415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:17.229415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:17.230300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:17.230300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:17.230300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:17.230300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 296/601] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:17.230300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7db54-df7c-4fd6-a1ec-c77b0d062f03 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:17.263127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:17.318587 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dada8b5-9ded-45c1-85e0-81b45f8c8b63 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:17.345878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:17.354137 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7db54-df7c-4fd6-a1ec-c77b0d062f03 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:17.356956 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a458e-9854-461c-a5db-b16380d5e863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:17.357758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a458e-9854-461c-a5db-b16380d5e863 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:17.358065 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a458e-9854-461c-a5db-b16380d5e863 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:17.358340 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a458e-9854-461c-a5db-b16380d5e863 None admin] PATH_INFO: `/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/dc210376e57a41e6b3812110db249099/roles/e3de94d5ee924ea4b638d196d282af55` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:17.377212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a458e-9854-461c-a5db-b16380d5e863 None admin] RBAC: Authorizing `identity:create_grant(project_id=a57df41195d240fe8f28ac49bfd37921, user_id=dc210376e57a41e6b3812110db249099, role_id=e3de94d5ee924ea4b638d196d282af55)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:17.378712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a458e-9854-461c-a5db-b16380d5e863 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:17.393694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 306/602] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:43:17 2022] PUT /identity/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/dc210376e57a41e6b3812110db249099/roles/e3de94d5ee924ea4b638d196d282af55 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:43:17.394208 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84960-ee3c-422e-af21-ea5bb58cd7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:17.394466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a458e-9854-461c-a5db-b16380d5e863 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:17.395353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84960-ee3c-422e-af21-ea5bb58cd7aa None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:17.395816 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84960-ee3c-422e-af21-ea5bb58cd7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:17.396312 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84960-ee3c-422e-af21-ea5bb58cd7aa None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:17.397326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e84960-ee3c-422e-af21-ea5bb58cd7aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:17.397834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e84960-ee3c-422e-af21-ea5bb58cd7aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:17.399322 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e84960-ee3c-422e-af21-ea5bb58cd7aa None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:17.421025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 297/603] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:17.423005 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84960-ee3c-422e-af21-ea5bb58cd7aa None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:17.526019 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:17.532223 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a458e-9854-461c-a5db-b16380d5e863 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:17.543127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84960-ee3c-422e-af21-ea5bb58cd7aa None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:17.572022 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05081df3-813b-49ba-a2ee-601e5bda6331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:17.572693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05081df3-813b-49ba-a2ee-601e5bda6331 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:17.573811 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05081df3-813b-49ba-a2ee-601e5bda6331 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:17.573811 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05081df3-813b-49ba-a2ee-601e5bda6331 None admin] PATH_INFO: `/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/cf65c58c74fc49e4ba7605f3c6c27f8b/roles/e3de94d5ee924ea4b638d196d282af55` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:17.586562 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5706a4c-ee1d-4ed3-aa5f-39be91cfbb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:17.587265 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5706a4c-ee1d-4ed3-aa5f-39be91cfbb4b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:17.587547 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5706a4c-ee1d-4ed3-aa5f-39be91cfbb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:17.587820 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5706a4c-ee1d-4ed3-aa5f-39be91cfbb4b None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:17.588597 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5706a4c-ee1d-4ed3-aa5f-39be91cfbb4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:17.588967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5706a4c-ee1d-4ed3-aa5f-39be91cfbb4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:17.590347 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5706a4c-ee1d-4ed3-aa5f-39be91cfbb4b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:17.592960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05081df3-813b-49ba-a2ee-601e5bda6331 None admin] RBAC: Authorizing `identity:create_grant(project_id=a57df41195d240fe8f28ac49bfd37921, user_id=cf65c58c74fc49e4ba7605f3c6c27f8b, role_id=e3de94d5ee924ea4b638d196d282af55)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:17.594466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05081df3-813b-49ba-a2ee-601e5bda6331 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:17.603142 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 298/604] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:17.603929 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5706a4c-ee1d-4ed3-aa5f-39be91cfbb4b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:17.616017 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 307/605] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:43:17 2022] PUT /identity/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/cf65c58c74fc49e4ba7605f3c6c27f8b/roles/e3de94d5ee924ea4b638d196d282af55 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:43:17.617275 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05081df3-813b-49ba-a2ee-601e5bda6331 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:17.646511 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:17.740822 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5706a4c-ee1d-4ed3-aa5f-39be91cfbb4b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:17.745102 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05081df3-813b-49ba-a2ee-601e5bda6331 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:17.790813 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f635d-5dee-4735-b53c-e1f9494ba08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:17.791690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f635d-5dee-4735-b53c-e1f9494ba08b None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:17.791978 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f635d-5dee-4735-b53c-e1f9494ba08b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:17.792287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f635d-5dee-4735-b53c-e1f9494ba08b None admin] PATH_INFO: `/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/8d298efe48464956b7a03cba1001060b/roles/e3de94d5ee924ea4b638d196d282af55` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:17.792730 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d450e-ec54-4fab-a885-13edf4f80721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:17.793571 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d450e-ec54-4fab-a885-13edf4f80721 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:17.793934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d450e-ec54-4fab-a885-13edf4f80721 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:17.794215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d450e-ec54-4fab-a885-13edf4f80721 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:17.810043 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d450e-ec54-4fab-a885-13edf4f80721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:17.810270 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f635d-5dee-4735-b53c-e1f9494ba08b None admin] RBAC: Authorizing `identity:create_grant(project_id=a57df41195d240fe8f28ac49bfd37921, user_id=8d298efe48464956b7a03cba1001060b, role_id=e3de94d5ee924ea4b638d196d282af55)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:17.811811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f635d-5dee-4735-b53c-e1f9494ba08b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:17.816258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d64d450e-ec54-4fab-a885-13edf4f80721 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:17.816258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:17.816258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:17.816258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:17.816258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:17.816258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:17.816258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:17.816258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:17.816258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:17.816258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:17.816258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:17.816258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:17.816258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:17.816258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:17.816258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:17.816258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:17.818431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:17.818431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:17.818431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:17.818431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:17.818431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:17.818431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:17.818431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:17.818431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:17.818431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:17.818431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:17.818431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:17.818431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:17.818431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:17.818431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:17.818431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:17.818431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:17.820204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:17.820204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:17.820204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:17.820204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:17.820204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:17.820204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:17.820204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:17.820204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:17.820204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:17.820204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:17.820204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:17.820204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:17.823070 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 308/606] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:43:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:17.824053 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d450e-ec54-4fab-a885-13edf4f80721 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:17.828315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:17.840290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 299/607] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:43:17 2022] PUT /identity/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/8d298efe48464956b7a03cba1001060b/roles/e3de94d5ee924ea4b638d196d282af55 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:43:17.841515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f635d-5dee-4735-b53c-e1f9494ba08b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:17.971478 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:17.996264 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f635d-5dee-4735-b53c-e1f9494ba08b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:18.011548 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d450e-ec54-4fab-a885-13edf4f80721 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:18.066400 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557fa57-b0e5-4341-a0bc-0a90b3b50d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:18.067678 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557fa57-b0e5-4341-a0bc-0a90b3b50d88 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:18.068635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557fa57-b0e5-4341-a0bc-0a90b3b50d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:18.069133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557fa57-b0e5-4341-a0bc-0a90b3b50d88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:18.078227 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557fa57-b0e5-4341-a0bc-0a90b3b50d88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:18.079212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba24ac2-76fe-48c1-9113-2e04c7689df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:18.079833 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba24ac2-76fe-48c1-9113-2e04c7689df0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:18.080156 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba24ac2-76fe-48c1-9113-2e04c7689df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:18.080425 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba24ac2-76fe-48c1-9113-2e04c7689df0 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:18.080884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557fa57-b0e5-4341-a0bc-0a90b3b50d88 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:18.081089 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba24ac2-76fe-48c1-9113-2e04c7689df0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:18.081392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba24ac2-76fe-48c1-9113-2e04c7689df0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:18.082750 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba24ac2-76fe-48c1-9113-2e04c7689df0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:18.091711 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 300/608] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Sep 9 20:43:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:18.096303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d557fa57-b0e5-4341-a0bc-0a90b3b50d88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:18.096303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:18.096303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:18.096303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:18.096303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:18.096303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:18.096303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:18.096303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:18.096303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:18.096303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:18.096303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:18.096303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:18.096303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:18.096303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:18.096303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:18.097260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:18.097260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:18.097260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:18.097260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:18.097260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:18.097260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:18.097260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:18.097260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:18.097260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:18.097260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:18.097260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:18.097260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:18.097260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:18.097260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:18.097260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:18.097260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:18.097260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:18.098127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:18.098127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:18.098127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:18.098127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:18.098127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:18.098127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:18.098127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:18.098127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:18.099732 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 309/609] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:18.109367 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557fa57-b0e5-4341-a0bc-0a90b3b50d88 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:18.109618 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba24ac2-76fe-48c1-9113-2e04c7689df0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:18.216332 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:18.227266 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557fa57-b0e5-4341-a0bc-0a90b3b50d88 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:18.268804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fac65-bb4e-49d7-9098-5ae8316277f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:18.269810 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fac65-bb4e-49d7-9098-5ae8316277f3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:18.270302 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fac65-bb4e-49d7-9098-5ae8316277f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:18.270775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fac65-bb4e-49d7-9098-5ae8316277f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:18.271685 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fac65-bb4e-49d7-9098-5ae8316277f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:18.272276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fac65-bb4e-49d7-9098-5ae8316277f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:18.274420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fac65-bb4e-49d7-9098-5ae8316277f3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:18.293523 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 310/610] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:18.301127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba24ac2-76fe-48c1-9113-2e04c7689df0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:18.303492 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fac65-bb4e-49d7-9098-5ae8316277f3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:18.310115 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:18.348869 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262967a-8935-43dd-9e58-7571ccc8a91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:18.349429 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262967a-8935-43dd-9e58-7571ccc8a91b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:18.349706 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262967a-8935-43dd-9e58-7571ccc8a91b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:18.349975 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262967a-8935-43dd-9e58-7571ccc8a91b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:18.376236 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262967a-8935-43dd-9e58-7571ccc8a91b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:18.379073 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262967a-8935-43dd-9e58-7571ccc8a91b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:18.411359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b262967a-8935-43dd-9e58-7571ccc8a91b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:18.411359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:18.411359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:18.411359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:18.411359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:18.411359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:18.411359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:18.411359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:18.411359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:18.411359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:18.411359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:18.411359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:18.411359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:18.411359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:18.411359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:18.411359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:18.412381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:18.412381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:18.412381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:18.412381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:18.412381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:18.412381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:18.412381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:18.412381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:18.412381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:18.412381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:18.412381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:18.412381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:18.412381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:18.412381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:18.412381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:18.412381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:18.412381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:18.413272 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:18.413272 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:18.413272 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:18.417201 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 301/611] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:18.418027 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262967a-8935-43dd-9e58-7571ccc8a91b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:18.479051 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fac65-bb4e-49d7-9098-5ae8316277f3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:18.518621 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad12450-193d-482f-8bbc-b36f9b500ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:18.519291 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad12450-193d-482f-8bbc-b36f9b500ac3 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:18.519566 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad12450-193d-482f-8bbc-b36f9b500ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:18.519836 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad12450-193d-482f-8bbc-b36f9b500ac3 None admin] PATH_INFO: `/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/27e2be33ebdc4c5a97befcbd4d09ee4c/roles/e3de94d5ee924ea4b638d196d282af55` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:18.537344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad12450-193d-482f-8bbc-b36f9b500ac3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a57df41195d240fe8f28ac49bfd37921, user_id=27e2be33ebdc4c5a97befcbd4d09ee4c, role_id=e3de94d5ee924ea4b638d196d282af55)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:18.539014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad12450-193d-482f-8bbc-b36f9b500ac3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:18.554536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 311/612] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:43:18 2022] PUT /identity/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/27e2be33ebdc4c5a97befcbd4d09ee4c/roles/e3de94d5ee924ea4b638d196d282af55 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:43:18.632552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262967a-8935-43dd-9e58-7571ccc8a91b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:18.656610 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:18.689837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2088a-f8d2-4cb6-8b12-de1651ae56d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:18.690564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2088a-f8d2-4cb6-8b12-de1651ae56d1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:18.690843 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2088a-f8d2-4cb6-8b12-de1651ae56d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:18.691115 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2088a-f8d2-4cb6-8b12-de1651ae56d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:18.691822 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2088a-f8d2-4cb6-8b12-de1651ae56d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:18.692157 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2088a-f8d2-4cb6-8b12-de1651ae56d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:18.693565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2088a-f8d2-4cb6-8b12-de1651ae56d1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:18.712767 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 302/613] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:18.718143 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad12450-193d-482f-8bbc-b36f9b500ac3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:18.781147 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:18.830042 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad12450-193d-482f-8bbc-b36f9b500ac3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:18.870581 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c14d8-44d0-498c-a0fb-b85b0e3ee6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:18.871216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c14d8-44d0-498c-a0fb-b85b0e3ee6ec None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:18.871490 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c14d8-44d0-498c-a0fb-b85b0e3ee6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:18.871757 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c14d8-44d0-498c-a0fb-b85b0e3ee6ec None admin] PATH_INFO: `/v3/users/swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:18.880340 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c14d8-44d0-498c-a0fb-b85b0e3ee6ec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:18.885219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c14d8-44d0-498c-a0fb-b85b0e3ee6ec None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:18.897394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-5a5c14d8-44d0-498c-a0fb-b85b0e3ee6ec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 20:43:18.897394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:18.897394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:18.897394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:18.897394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:18.897394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:18.897394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:18.897394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:18.897394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:18.897394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:18.897394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:18.897394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:18.897394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:18.897394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:18.897394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:18.897394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:18.898369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:18.898369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:18.898369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:18.898369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:18.898369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:18.898369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:18.898369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:18.898369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:18.898369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:18.898369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:18.898369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:18.898369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:18.898369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:18.898369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:18.898369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:18.898369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:18.898369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:18.898369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:18.899321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:18.899321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:18.899321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:18.899321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:18.899321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:18.899321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:18.899321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:18.899321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:18.899321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 20:43:18.899321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:18.899321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 312/614] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:43:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:18.904641 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2088a-f8d2-4cb6-8b12-de1651ae56d1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:19.015514 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2088a-f8d2-4cb6-8b12-de1651ae56d1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:19.052237 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b06e5e-e56f-4039-8875-8792da93e90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:19.052850 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b06e5e-e56f-4039-8875-8792da93e90c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:19.053127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b06e5e-e56f-4039-8875-8792da93e90c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:19.053397 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b06e5e-e56f-4039-8875-8792da93e90c None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:19.054122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b06e5e-e56f-4039-8875-8792da93e90c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:19.054429 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b06e5e-e56f-4039-8875-8792da93e90c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:19.055902 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b06e5e-e56f-4039-8875-8792da93e90c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:19.076264 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 303/615] 10.222.0.15 () {56 vars in 1135 bytes} [Fri Sep 9 20:43:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:19.084591 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c14d8-44d0-498c-a0fb-b85b0e3ee6ec None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:19.199458 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c14d8-44d0-498c-a0fb-b85b0e3ee6ec None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:19.214062 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:19.234665 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca9048-6d91-48bd-841c-613a746d54b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:19.235349 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca9048-6d91-48bd-841c-613a746d54b2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:19.235628 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca9048-6d91-48bd-841c-613a746d54b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:19.235898 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca9048-6d91-48bd-841c-613a746d54b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:19.246869 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca9048-6d91-48bd-841c-613a746d54b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:19.248330 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca9048-6d91-48bd-841c-613a746d54b2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:19.263453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-88ca9048-6d91-48bd-841c-613a746d54b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:19.263453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:19.263453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:19.263453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:19.263453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:19.263453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:19.263453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:19.263453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:19.263453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:19.263453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:19.263453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:19.263453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:19.263453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:19.263453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:19.263453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:19.263453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:19.265045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:19.265045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:19.265045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:19.265045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:19.265045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:19.265045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:19.265045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:19.265045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:19.265045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:19.265045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:19.265045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:19.265045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:19.265045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:19.265045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:19.265045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:19.265045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:19.265045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:19.266729 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:19.266729 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:19.266729 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:19.266729 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 313/616] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:19.272736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b06e5e-e56f-4039-8875-8792da93e90c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:19.309307 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:19.383534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b06e5e-e56f-4039-8875-8792da93e90c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:19.419832 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2627d2-3960-42b6-9d4d-98f80f1ec823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:19.420554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2627d2-3960-42b6-9d4d-98f80f1ec823 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:19.420830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2627d2-3960-42b6-9d4d-98f80f1ec823 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:19.421150 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2627d2-3960-42b6-9d4d-98f80f1ec823 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:19.421785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2627d2-3960-42b6-9d4d-98f80f1ec823 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:19.422134 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2627d2-3960-42b6-9d4d-98f80f1ec823 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:19.423585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2627d2-3960-42b6-9d4d-98f80f1ec823 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:19.435411 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 304/617] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:19.441167 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca9048-6d91-48bd-841c-613a746d54b2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:19.566514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca9048-6d91-48bd-841c-613a746d54b2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:19.600777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ea778-2682-4988-ac21-65926e7370c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:19.601407 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ea778-2682-4988-ac21-65926e7370c3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:19.601682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ea778-2682-4988-ac21-65926e7370c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:19.601952 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ea778-2682-4988-ac21-65926e7370c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:19.609739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ea778-2682-4988-ac21-65926e7370c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:19.611190 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ea778-2682-4988-ac21-65926e7370c3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:19.622905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-484ea778-2682-4988-ac21-65926e7370c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:19.622905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:19.622905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:19.622905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:19.622905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:19.622905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:19.622905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:19.622905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:19.622905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:19.622905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:19.622905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:19.622905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:19.622905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:19.622905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:19.622905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:19.624561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:19.624561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:19.624561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:19.624561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:19.624561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:19.624561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:19.624561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:19.624561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:19.624561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:19.624561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:19.624561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:19.624561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:19.624561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:19.624561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:19.624561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:19.624561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:19.624561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:19.625451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:19.625451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:19.625451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:19.625451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:19.625451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:19.625451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:19.625451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:19.625451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:19.625451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 314/618] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:19.633082 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2627d2-3960-42b6-9d4d-98f80f1ec823 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:19.734972 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:19.745353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2627d2-3960-42b6-9d4d-98f80f1ec823 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:19.783519 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0df4de-6ce7-4fba-aae0-0671ff205797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:19.784179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0df4de-6ce7-4fba-aae0-0671ff205797 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:19.784458 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0df4de-6ce7-4fba-aae0-0671ff205797 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:19.784727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0df4de-6ce7-4fba-aae0-0671ff205797 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:19.785430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0df4de-6ce7-4fba-aae0-0671ff205797 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:19.785734 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0df4de-6ce7-4fba-aae0-0671ff205797 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:19.787287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0df4de-6ce7-4fba-aae0-0671ff205797 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:19.802506 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 305/619] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:19.809136 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ea778-2682-4988-ac21-65926e7370c3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:19.856483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:19.931493 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ea778-2682-4988-ac21-65926e7370c3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:19.935356 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbc9b9-8d9c-4f93-aef3-5f4962d7c60d None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:19.935837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbc9b9-8d9c-4f93-aef3-5f4962d7c60d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:19.936472 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbc9b9-8d9c-4f93-aef3-5f4962d7c60d None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:19.937976 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 306/620] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:43:19.943748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09215166-8b2c-48c7-ad76-410a26442c73 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:19.944716 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09215166-8b2c-48c7-ad76-410a26442c73 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:19.945009 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09215166-8b2c-48c7-ad76-410a26442c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:19.981997 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-09215166-8b2c-48c7-ad76-410a26442c73 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:19.985987 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-09215166-8b2c-48c7-ad76-410a26442c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:20.004232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf29d2-41d6-4b32-bf0c-54fd95e75a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:20.006770 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf29d2-41d6-4b32-bf0c-54fd95e75a71 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:20.007234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf29d2-41d6-4b32-bf0c-54fd95e75a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:20.007713 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf29d2-41d6-4b32-bf0c-54fd95e75a71 None admin] PATH_INFO: `/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/9570eaa112de460cb9e371278bfb300b/roles/e3de94d5ee924ea4b638d196d282af55` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:20.038682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf29d2-41d6-4b32-bf0c-54fd95e75a71 None admin] RBAC: Authorizing `identity:create_grant(project_id=a57df41195d240fe8f28ac49bfd37921, user_id=9570eaa112de460cb9e371278bfb300b, role_id=e3de94d5ee924ea4b638d196d282af55)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:20.041098 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf29d2-41d6-4b32-bf0c-54fd95e75a71 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:20.064561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 315/621] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:43:19 2022] PUT /identity/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/9570eaa112de460cb9e371278bfb300b/roles/e3de94d5ee924ea4b638d196d282af55 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:43:20.100872 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 307/622] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:20.448256 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36e8e4-6aa0-4bd8-88eb-fb95fc8849ce None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:20.448778 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36e8e4-6aa0-4bd8-88eb-fb95fc8849ce None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:20.448778 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36e8e4-6aa0-4bd8-88eb-fb95fc8849ce None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:20.450373 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 316/623] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:20.456254 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab1ace-ac9e-4e8a-bfff-ee5b6897adcf None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:20.456544 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab1ace-ac9e-4e8a-bfff-ee5b6897adcf None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:20.456824 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab1ace-ac9e-4e8a-bfff-ee5b6897adcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:20.457021 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36e8e4-6aa0-4bd8-88eb-fb95fc8849ce None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:20.489176 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-77ab1ace-ac9e-4e8a-bfff-ee5b6897adcf None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:20.490360 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-77ab1ace-ac9e-4e8a-bfff-ee5b6897adcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:20.572998 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 308/624] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:20.581627 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:20.605206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36e8e4-6aa0-4bd8-88eb-fb95fc8849ce None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:20.641055 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139546e3-685c-4dd6-b00c-217d73341408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:20.641694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139546e3-685c-4dd6-b00c-217d73341408 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:20.641973 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139546e3-685c-4dd6-b00c-217d73341408 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:20.642247 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139546e3-685c-4dd6-b00c-217d73341408 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:20.653106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139546e3-685c-4dd6-b00c-217d73341408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:20.658690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-139546e3-685c-4dd6-b00c-217d73341408 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:20.658690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:20.658690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:20.658690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:20.658690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:20.658690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:20.658690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:20.658690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:20.658690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:20.658690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:20.658690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:20.658690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:20.658690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:20.658690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:20.658690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:20.658690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:20.659635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:20.659635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:20.659635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:20.659635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:20.659635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:20.659635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:20.659635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:20.659635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:20.659635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:20.659635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:20.659635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:20.659635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:20.659635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:20.659635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:20.659635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:20.659635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:20.660656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:20.660656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:20.660656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:20.660656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:20.660656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:20.660656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:20.660656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:20.660656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:20.660656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:20.660656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:20.660656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:20.660656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:20.660656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 317/625] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:43:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:20.667813 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab1ace-ac9e-4e8a-bfff-ee5b6897adcf None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:20.690269 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:20.799767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af43bad-9ee8-46a7-b50f-4dc5e99952a4 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:20.800139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af43bad-9ee8-46a7-b50f-4dc5e99952a4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:20.800360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af43bad-9ee8-46a7-b50f-4dc5e99952a4 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:20.801944 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 318/626] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:20.806867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fbda6-fcbb-4f8b-b8e5-b30c32db447d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:20.808641 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fbda6-fcbb-4f8b-b8e5-b30c32db447d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:20.809806 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fbda6-fcbb-4f8b-b8e5-b30c32db447d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:20.841079 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab1ace-ac9e-4e8a-bfff-ee5b6897adcf None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:20.843966 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-230fbda6-fcbb-4f8b-b8e5-b30c32db447d None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:20.850663 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-230fbda6-fcbb-4f8b-b8e5-b30c32db447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:20.900142 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4f7b6-d6f4-407c-aa88-48fa540e92ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:20.901031 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4f7b6-d6f4-407c-aa88-48fa540e92ff None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:20.901309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4f7b6-d6f4-407c-aa88-48fa540e92ff None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:20.901583 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4f7b6-d6f4-407c-aa88-48fa540e92ff None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:20.902251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4f7b6-d6f4-407c-aa88-48fa540e92ff None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:20.902562 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4f7b6-d6f4-407c-aa88-48fa540e92ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:20.903942 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4f7b6-d6f4-407c-aa88-48fa540e92ff None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:20.913771 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 309/627] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Sep 9 20:43:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:20.913957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4f7b6-d6f4-407c-aa88-48fa540e92ff None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:20.952427 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 319/628] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:43:20.953509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230fbda6-fcbb-4f8b-b8e5-b30c32db447d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:21.010437 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:21.047344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:21.086150 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4f7b6-d6f4-407c-aa88-48fa540e92ff None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:21.088109 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230fbda6-fcbb-4f8b-b8e5-b30c32db447d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:21.131752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048ed11-7528-44a8-93e1-0092b5629ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:21.132330 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048ed11-7528-44a8-93e1-0092b5629ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:21.133765 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048ed11-7528-44a8-93e1-0092b5629ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:21.134052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048ed11-7528-44a8-93e1-0092b5629ee9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:21.151123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271de65c-2556-487a-90e7-64bcfa28a47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:21.151762 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271de65c-2556-487a-90e7-64bcfa28a47e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:21.152059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271de65c-2556-487a-90e7-64bcfa28a47e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:21.152332 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271de65c-2556-487a-90e7-64bcfa28a47e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:21.155517 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048ed11-7528-44a8-93e1-0092b5629ee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:21.158163 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048ed11-7528-44a8-93e1-0092b5629ee9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:21.173517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271de65c-2556-487a-90e7-64bcfa28a47e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:21.178877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-271de65c-2556-487a-90e7-64bcfa28a47e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:21.178877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:21.178877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:21.178877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:21.178877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:21.178877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:21.178877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:21.178877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:21.178877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:21.178877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:21.178877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:21.178877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:21.178877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:21.178877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:21.178877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:21.178877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:21.179770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:21.179770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:21.179770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:21.179770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:21.179770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:21.179770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:21.179770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:21.179770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:21.179770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:21.179770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:21.179770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:21.179770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:21.179770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:21.179770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:21.179770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:21.179770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:21.180893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:21.180893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:21.180893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:21.180893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:21.180893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:21.180893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:21.180893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:21.180893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:21.180893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:21.180893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:21.180893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:21.180893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:21.180893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 310/629] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:43:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:21.185259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d048ed11-7528-44a8-93e1-0092b5629ee9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:21.185259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:21.185259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:21.185259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:21.185259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:21.185259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:21.185259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:21.185259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:21.185259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:21.185259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:21.185259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:21.185259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:21.185259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:21.185259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:21.185259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:21.185259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:21.187815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:21.187815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:21.187815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:21.187815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:21.187815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:21.187815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:21.187815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:21.187815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:21.187815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:21.187815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:21.187815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:21.187815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:21.187815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:21.187815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:21.187815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:21.187815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:21.187815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:21.189295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:21.189295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:21.189295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:21.189295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 320/630] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:21.190493 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271de65c-2556-487a-90e7-64bcfa28a47e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:21.195222 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048ed11-7528-44a8-93e1-0092b5629ee9 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:21.339003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048ed11-7528-44a8-93e1-0092b5629ee9 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:21.349972 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271de65c-2556-487a-90e7-64bcfa28a47e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:21.359746 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:21.380931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e4bf4-404b-4180-8705-fde6e259785c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:21.381557 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e4bf4-404b-4180-8705-fde6e259785c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:21.381893 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e4bf4-404b-4180-8705-fde6e259785c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:21.382110 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e4bf4-404b-4180-8705-fde6e259785c None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:21.382900 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e4bf4-404b-4180-8705-fde6e259785c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:21.383208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e4bf4-404b-4180-8705-fde6e259785c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:21.384651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e4bf4-404b-4180-8705-fde6e259785c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:21.393768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:21.399136 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 321/631] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:21.400192 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef14971-0331-449b-8c2a-03e73f22c7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:21.400763 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e4bf4-404b-4180-8705-fde6e259785c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:21.401072 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef14971-0331-449b-8c2a-03e73f22c7eb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:21.401351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef14971-0331-449b-8c2a-03e73f22c7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:21.401623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef14971-0331-449b-8c2a-03e73f22c7eb None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:21.406947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef14971-0331-449b-8c2a-03e73f22c7eb None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:21.406947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef14971-0331-449b-8c2a-03e73f22c7eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:21.406947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef14971-0331-449b-8c2a-03e73f22c7eb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:21.414967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 311/632] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Sep 9 20:43:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:21.415974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef14971-0331-449b-8c2a-03e73f22c7eb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:21.509158 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e4bf4-404b-4180-8705-fde6e259785c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:21.530191 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef14971-0331-449b-8c2a-03e73f22c7eb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:21.546834 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07c6be-56ae-4076-9141-52d850ff0d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:21.547461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07c6be-56ae-4076-9141-52d850ff0d81 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:21.547737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07c6be-56ae-4076-9141-52d850ff0d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:21.548028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07c6be-56ae-4076-9141-52d850ff0d81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:21.559437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07c6be-56ae-4076-9141-52d850ff0d81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:21.564543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-0d07c6be-56ae-4076-9141-52d850ff0d81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:21.564543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:21.564543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:21.564543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:21.564543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:21.564543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:21.564543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:21.564543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:21.564543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:21.564543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:21.564543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:21.564543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:21.564543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:21.564543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:21.564543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:21.564543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:21.565660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:21.565660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:21.565660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:21.565660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:21.565660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:21.565660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:21.565660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:21.565660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:21.565660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:21.565660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:21.565660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:21.565660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:21.565660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:21.565660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:21.565660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:21.565660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:21.569058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:21.569058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:21.569058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:21.569058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:21.569058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:21.569058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:21.569058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:21.569058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:21.569058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:21.569058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:21.569058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:21.569058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:21.569058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 322/633] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:43:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:21.569058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07c6be-56ae-4076-9141-52d850ff0d81 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:21.571112 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d37155-1723-4dd6-92f1-7aade0a7e7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:21.571973 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d37155-1723-4dd6-92f1-7aade0a7e7a5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:21.572471 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d37155-1723-4dd6-92f1-7aade0a7e7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:21.572919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d37155-1723-4dd6-92f1-7aade0a7e7a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:21.581981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d37155-1723-4dd6-92f1-7aade0a7e7a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:21.583691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d37155-1723-4dd6-92f1-7aade0a7e7a5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:21.595796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-94d37155-1723-4dd6-92f1-7aade0a7e7a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 20:43:21.595796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:21.595796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:21.595796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:21.595796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:21.595796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:21.595796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:21.595796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:21.595796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:21.595796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:21.595796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:21.595796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:21.595796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:21.595796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:21.595796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:21.595796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:21.596811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:21.596811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:21.596811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:21.596811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:21.596811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:21.596811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:21.596811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:21.596811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:21.596811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:21.596811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:21.596811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:21.596811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:21.596811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:21.596811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:21.596811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:21.596811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:21.596811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:21.596811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:21.597779 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:21.597779 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:21.597779 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:21.597779 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:21.597779 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:21.597779 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:21.597779 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:21.597779 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:21.597779 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 20:43:21.597779 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:21.597779 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 312/634] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Sep 9 20:43:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:21.598833 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d93c14-d32b-4af2-adc7-60ec5c8dfb71 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:21.598833 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d93c14-d32b-4af2-adc7-60ec5c8dfb71 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:21.598833 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d93c14-d32b-4af2-adc7-60ec5c8dfb71 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:21.600044 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 313/635] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:21.604577 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d93c14-d32b-4af2-adc7-60ec5c8dfb71 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:21.619950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:21.665717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:21.684658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07c6be-56ae-4076-9141-52d850ff0d81 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:21.714990 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d93c14-d32b-4af2-adc7-60ec5c8dfb71 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:21.721794 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40080d18-761d-48b6-92a1-2927c4349040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:21.722425 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40080d18-761d-48b6-92a1-2927c4349040 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:21.722697 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40080d18-761d-48b6-92a1-2927c4349040 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:21.722966 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40080d18-761d-48b6-92a1-2927c4349040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:21.733927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40080d18-761d-48b6-92a1-2927c4349040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:21.735373 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40080d18-761d-48b6-92a1-2927c4349040 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:21.751396 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de6214-80ff-461a-a1e3-f8dd66d2b57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:21.751887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-40080d18-761d-48b6-92a1-2927c4349040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:21.751887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:21.751887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:21.751887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:21.751887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:21.751887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:21.751887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:21.751887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:21.751887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:21.751887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:21.751887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:21.751887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:21.751887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:21.751887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:21.751887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:21.751887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:21.752871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:21.752871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:21.752871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:21.752871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:21.752871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:21.752871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:21.752871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:21.752871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:21.752871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:21.752871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:21.752871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:21.752871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:21.752871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:21.752871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:21.752871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:21.752871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:21.752871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:21.754121 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:21.754121 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:21.754121 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:21.754288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de6214-80ff-461a-a1e3-f8dd66d2b57c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:21.754288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de6214-80ff-461a-a1e3-f8dd66d2b57c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:21.754288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de6214-80ff-461a-a1e3-f8dd66d2b57c None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:21.754288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de6214-80ff-461a-a1e3-f8dd66d2b57c None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:21.754288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de6214-80ff-461a-a1e3-f8dd66d2b57c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:21.754866 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de6214-80ff-461a-a1e3-f8dd66d2b57c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:21.758363 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 323/636] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:21.759271 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40080d18-761d-48b6-92a1-2927c4349040 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:21.769218 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 314/637] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Sep 9 20:43:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:21.769218 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a12bb-f55d-4cb1-8cc2-e2eb930e7be6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:21.769218 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a12bb-f55d-4cb1-8cc2-e2eb930e7be6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:21.769218 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a12bb-f55d-4cb1-8cc2-e2eb930e7be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:21.785327 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a38a12bb-f55d-4cb1-8cc2-e2eb930e7be6 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:21.786603 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a38a12bb-f55d-4cb1-8cc2-e2eb930e7be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:21.855681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 315/638] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:21.857003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a12bb-f55d-4cb1-8cc2-e2eb930e7be6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:21.864828 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:21.871246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40080d18-761d-48b6-92a1-2927c4349040 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:21.913958 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892b5d8-8f8e-4b99-a3e0-8ac3675b35f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:21.914750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892b5d8-8f8e-4b99-a3e0-8ac3675b35f8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:21.915205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892b5d8-8f8e-4b99-a3e0-8ac3675b35f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:21.915550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892b5d8-8f8e-4b99-a3e0-8ac3675b35f8 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:21.916184 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:21.917088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892b5d8-8f8e-4b99-a3e0-8ac3675b35f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:21.917439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892b5d8-8f8e-4b99-a3e0-8ac3675b35f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:21.919087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4892b5d8-8f8e-4b99-a3e0-8ac3675b35f8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:21.943202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 324/639] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Sep 9 20:43:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:21.944144 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892b5d8-8f8e-4b99-a3e0-8ac3675b35f8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:21.978139 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a12bb-f55d-4cb1-8cc2-e2eb930e7be6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:22.019181 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4f86f-d4be-4fc6-bbdd-b96bec3ef1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:22.020099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4f86f-d4be-4fc6-bbdd-b96bec3ef1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:22.020390 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4f86f-d4be-4fc6-bbdd-b96bec3ef1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:22.020664 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4f86f-d4be-4fc6-bbdd-b96bec3ef1a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:22.021968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4f86f-d4be-4fc6-bbdd-b96bec3ef1a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:22.022292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4f86f-d4be-4fc6-bbdd-b96bec3ef1a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:22.024011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4f86f-d4be-4fc6-bbdd-b96bec3ef1a3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:22.040721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 316/640] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:22.041570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4f86f-d4be-4fc6-bbdd-b96bec3ef1a3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:22.067077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892b5d8-8f8e-4b99-a3e0-8ac3675b35f8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:22.114146 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3576b-2100-485a-a9e0-3e400b7d5d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:22.115228 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3576b-2100-485a-a9e0-3e400b7d5d31 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:22.115515 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3576b-2100-485a-a9e0-3e400b7d5d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:22.115914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3576b-2100-485a-a9e0-3e400b7d5d31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:22.128905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3576b-2100-485a-a9e0-3e400b7d5d31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:22.130363 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3576b-2100-485a-a9e0-3e400b7d5d31 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:22.140559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:22.148632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f5b3576b-2100-485a-a9e0-3e400b7d5d31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:22.148632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:22.148632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:22.148632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:22.148632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:22.148632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:22.148632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:22.148632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:22.148632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:22.148632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:22.148632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:22.148632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:22.148632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:22.148632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:22.148632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:22.148632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:22.149800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:22.149800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:22.149800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:22.149800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:22.149800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:22.149800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:22.149800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:22.149800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:22.149800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:22.149800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:22.149800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:22.149800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:22.149800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:22.149800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:22.149800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:22.149800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:22.149800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:22.151302 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:22.151302 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:22.151302 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:22.153270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 325/641] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:22.158252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3576b-2100-485a-a9e0-3e400b7d5d31 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:22.172505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4f86f-d4be-4fc6-bbdd-b96bec3ef1a3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:22.180436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:22.211677 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eddca9-5bd9-4c6b-ac73-c8aa7e9bef92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:22.212754 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eddca9-5bd9-4c6b-ac73-c8aa7e9bef92 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:22.213106 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eddca9-5bd9-4c6b-ac73-c8aa7e9bef92 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:22.213386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eddca9-5bd9-4c6b-ac73-c8aa7e9bef92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:22.261575 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3576b-2100-485a-a9e0-3e400b7d5d31 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:22.292123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eddca9-5bd9-4c6b-ac73-c8aa7e9bef92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:22.294042 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eddca9-5bd9-4c6b-ac73-c8aa7e9bef92 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:22.300547 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6e428-e030-43b2-9f1f-73b839846e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:22.301184 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6e428-e030-43b2-9f1f-73b839846e59 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:22.301467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6e428-e030-43b2-9f1f-73b839846e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:22.301743 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6e428-e030-43b2-9f1f-73b839846e59 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:22.310712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6e428-e030-43b2-9f1f-73b839846e59 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:22.312651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6e428-e030-43b2-9f1f-73b839846e59 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:22.324246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8bc6e428-e030-43b2-9f1f-73b839846e59 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 20:43:22.324246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:22.324246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:22.324246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:22.324246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:22.324246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:22.324246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:22.324246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:22.324246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:22.324246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:22.324246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:22.324246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:22.324246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:22.324246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:22.324246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:22.324246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:22.325257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:22.325257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:22.325257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:22.325257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:22.325257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:22.325257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:22.325257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:22.325257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:22.325257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:22.325257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:22.325257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:22.325257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:22.325257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:22.325257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:22.325257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:22.325257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:22.325257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:22.325257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:22.326198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:22.326198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:22.326198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:22.326198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:22.326198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:22.326198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:22.326198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:22.326198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:22.326198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 20:43:22.326198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:22.326198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 326/642] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:43:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:22.326198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6e428-e030-43b2-9f1f-73b839846e59 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:22.392875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:22.414209 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 317/643] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:43:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:43:22.415372 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eddca9-5bd9-4c6b-ac73-c8aa7e9bef92 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:22.424849 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:22.442444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6e428-e030-43b2-9f1f-73b839846e59 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:22.477881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8dc27e-dca8-4874-bca8-b4c03bfe595a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:22.478480 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8dc27e-dca8-4874-bca8-b4c03bfe595a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:22.478760 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8dc27e-dca8-4874-bca8-b4c03bfe595a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:22.479032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8dc27e-dca8-4874-bca8-b4c03bfe595a None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:22.479694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8dc27e-dca8-4874-bca8-b4c03bfe595a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:22.480028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8dc27e-dca8-4874-bca8-b4c03bfe595a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:22.481457 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8dc27e-dca8-4874-bca8-b4c03bfe595a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:22.495768 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 327/644] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:22.496684 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8dc27e-dca8-4874-bca8-b4c03bfe595a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:22.535195 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eddca9-5bd9-4c6b-ac73-c8aa7e9bef92 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:22.572427 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27379fb5-f176-414e-b963-cc9f05a0d0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:22.573351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27379fb5-f176-414e-b963-cc9f05a0d0be None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:22.573809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27379fb5-f176-414e-b963-cc9f05a0d0be None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:22.574260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27379fb5-f176-414e-b963-cc9f05a0d0be None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:22.585733 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27379fb5-f176-414e-b963-cc9f05a0d0be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:22.590964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-27379fb5-f176-414e-b963-cc9f05a0d0be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:22.590964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:22.590964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:22.590964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:22.590964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:22.590964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:22.590964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:22.590964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:22.590964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:22.590964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:22.590964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:22.590964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:22.590964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:22.590964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:22.590964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:22.590964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:22.591930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:22.591930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:22.591930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:22.591930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:22.591930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:22.591930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:22.591930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:22.591930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:22.591930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:22.591930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:22.591930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:22.591930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:22.591930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:22.591930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:22.591930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:22.591930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:22.593683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:22.593683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:22.593683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:22.593683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:22.593683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:22.593683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:22.593683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:22.593683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:22.593683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:22.593683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:22.593683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:22.593683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:22.595655 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 318/645] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:43:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:22.597094 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27379fb5-f176-414e-b963-cc9f05a0d0be None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:22.606544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8dc27e-dca8-4874-bca8-b4c03bfe595a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:22.626462 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:22.642243 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dd467-96bd-4802-9f75-a75313af413f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:22.642843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dd467-96bd-4802-9f75-a75313af413f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:22.643117 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dd467-96bd-4802-9f75-a75313af413f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:22.643386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dd467-96bd-4802-9f75-a75313af413f None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:22.644139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dd467-96bd-4802-9f75-a75313af413f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:22.644439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dd467-96bd-4802-9f75-a75313af413f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:22.645850 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676dd467-96bd-4802-9f75-a75313af413f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:22.663318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 328/646] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Sep 9 20:43:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:22.663933 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dd467-96bd-4802-9f75-a75313af413f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:22.664164 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:22.700034 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27379fb5-f176-414e-b963-cc9f05a0d0be None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:22.733758 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dafc51-591f-46be-8b94-9c18043d6814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:22.734387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dafc51-591f-46be-8b94-9c18043d6814 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:22.734669 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dafc51-591f-46be-8b94-9c18043d6814 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:22.734945 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dafc51-591f-46be-8b94-9c18043d6814 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:22.744892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dafc51-591f-46be-8b94-9c18043d6814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:22.746337 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dafc51-591f-46be-8b94-9c18043d6814 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:22.762229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-25dafc51-591f-46be-8b94-9c18043d6814 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:22.762229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:22.762229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:22.762229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:22.762229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:22.762229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:22.762229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:22.762229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:22.762229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:22.762229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:22.762229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:22.762229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:22.762229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:22.762229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:22.762229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:22.762229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:22.763168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:22.763168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:22.763168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:22.763168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:22.763168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:22.763168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:22.763168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:22.763168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:22.763168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:22.763168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:22.763168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:22.763168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:22.763168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:22.763168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:22.763168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:22.763168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:22.763168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:22.764684 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:22.764684 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:22.764684 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:22.764894 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676dd467-96bd-4802-9f75-a75313af413f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:22.764980 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 319/647] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:22.764980 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ca322-d3fd-4172-9481-e888ba3ab381 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:22.765217 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ca322-d3fd-4172-9481-e888ba3ab381 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:22.765537 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ca322-d3fd-4172-9481-e888ba3ab381 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:22.766745 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 320/648] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:22.767427 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ca322-d3fd-4172-9481-e888ba3ab381 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:22.801607 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4191f-c4b0-46e1-b217-5b0685277ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:22.802228 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4191f-c4b0-46e1-b217-5b0685277ffd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:22.802507 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4191f-c4b0-46e1-b217-5b0685277ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:22.802775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4191f-c4b0-46e1-b217-5b0685277ffd None admin] PATH_INFO: `/v3/users/glance` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:22.809600 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4191f-c4b0-46e1-b217-5b0685277ffd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:22.811728 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b4191f-c4b0-46e1-b217-5b0685277ffd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:22.822903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d5b4191f-c4b0-46e1-b217-5b0685277ffd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 09 20:43:22.822903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:22.822903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:22.822903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:22.822903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:22.822903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:22.822903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:22.822903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:22.822903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:22.822903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:22.822903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:22.822903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:22.822903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:22.822903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:22.822903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:22.822903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:22.823884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:22.823884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:22.823884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:22.823884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:22.823884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:22.823884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:22.823884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:22.823884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:22.823884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:22.823884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:22.823884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:22.823884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:22.823884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:22.823884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:22.823884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:22.823884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:22.823884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:22.823884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:22.824851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:22.824851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:22.824851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:22.824851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:22.824851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:22.824851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:22.824851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:22.824851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:22.824851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 09 20:43:22.824851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:22.824851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 329/649] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:43:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:22.824851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4191f-c4b0-46e1-b217-5b0685277ffd None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:22.863756 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:22.876314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ca322-d3fd-4172-9481-e888ba3ab381 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:22.892966 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:22.910682 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91898b8-28d7-46d7-9563-a9017b98952b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:22.911289 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91898b8-28d7-46d7-9563-a9017b98952b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:22.911570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91898b8-28d7-46d7-9563-a9017b98952b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:22.911842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91898b8-28d7-46d7-9563-a9017b98952b None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:22.912534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91898b8-28d7-46d7-9563-a9017b98952b None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:22.912840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91898b8-28d7-46d7-9563-a9017b98952b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:22.914268 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91898b8-28d7-46d7-9563-a9017b98952b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:22.923445 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 321/650] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Sep 9 20:43:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:22.924251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91898b8-28d7-46d7-9563-a9017b98952b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:22.924909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4191f-c4b0-46e1-b217-5b0685277ffd None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:22.960164 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d8523-5adf-42ba-9896-b77902e4db66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:22.960704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d8523-5adf-42ba-9896-b77902e4db66 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:22.960980 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d8523-5adf-42ba-9896-b77902e4db66 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:22.961251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d8523-5adf-42ba-9896-b77902e4db66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:23.025796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91898b8-28d7-46d7-9563-a9017b98952b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:23.029582 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d8523-5adf-42ba-9896-b77902e4db66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:23.031084 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d8523-5adf-42ba-9896-b77902e4db66 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:23.058702 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557fe38-4d5f-4f1d-82a3-081235de0f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:23.059307 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557fe38-4d5f-4f1d-82a3-081235de0f9d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:23.059594 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557fe38-4d5f-4f1d-82a3-081235de0f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:23.059867 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557fe38-4d5f-4f1d-82a3-081235de0f9d None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:23.060526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557fe38-4d5f-4f1d-82a3-081235de0f9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:23.061365 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557fe38-4d5f-4f1d-82a3-081235de0f9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:23.062739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557fe38-4d5f-4f1d-82a3-081235de0f9d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:23.069395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:23.079246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 322/651] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:23.079246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fd78f-bea8-4467-9711-3dc26c475be4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:23.079246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fd78f-bea8-4467-9711-3dc26c475be4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:23.079246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fd78f-bea8-4467-9711-3dc26c475be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:23.094529 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-564fd78f-bea8-4467-9711-3dc26c475be4 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:23.095720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-564fd78f-bea8-4467-9711-3dc26c475be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:23.129544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 330/652] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:43:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:43:23.130378 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d8523-5adf-42ba-9896-b77902e4db66 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:23.130640 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:23.165947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 323/653] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:23.166776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fd78f-bea8-4467-9711-3dc26c475be4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:23.229766 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d8523-5adf-42ba-9896-b77902e4db66 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:23.266903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6edf8d-d6a8-4d01-9206-8fe10fb25019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:23.267617 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6edf8d-d6a8-4d01-9206-8fe10fb25019 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:23.267895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6edf8d-d6a8-4d01-9206-8fe10fb25019 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:23.268193 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6edf8d-d6a8-4d01-9206-8fe10fb25019 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:23.268913 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6edf8d-d6a8-4d01-9206-8fe10fb25019 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:23.269217 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6edf8d-d6a8-4d01-9206-8fe10fb25019 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:23.270734 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6edf8d-d6a8-4d01-9206-8fe10fb25019 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:23.279130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:23.282366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fd78f-bea8-4467-9711-3dc26c475be4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:23.289893 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 331/654] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Sep 9 20:43:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:23.290712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6edf8d-d6a8-4d01-9206-8fe10fb25019 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:23.325104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa599604-3ff7-4531-af65-36ea4b709eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:23.325818 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa599604-3ff7-4531-af65-36ea4b709eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:23.326103 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa599604-3ff7-4531-af65-36ea4b709eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:23.326381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa599604-3ff7-4531-af65-36ea4b709eb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:23.338672 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa599604-3ff7-4531-af65-36ea4b709eb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:23.340817 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa599604-3ff7-4531-af65-36ea4b709eb2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:23.356720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-fa599604-3ff7-4531-af65-36ea4b709eb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:23.356720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:23.356720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:23.356720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:23.356720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:23.356720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:23.356720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:23.356720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:23.356720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:23.356720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:23.356720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:23.356720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:23.356720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:23.356720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:23.356720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:23.356720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:23.357784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:23.357784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:23.357784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:23.357784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:23.357784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:23.357784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:23.357784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:23.357784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:23.357784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:23.357784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:23.357784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:23.357784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:23.357784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:23.357784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:23.357784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:23.357784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:23.357784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:23.358843 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:23.358843 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:23.358843 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:23.358843 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 324/655] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:23.358843 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa599604-3ff7-4531-af65-36ea4b709eb2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:23.383288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:23.407154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6edf8d-d6a8-4d01-9206-8fe10fb25019 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:23.445886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06830021-cb23-46b7-9337-ac8a97edb8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:23.446517 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06830021-cb23-46b7-9337-ac8a97edb8fc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:23.446793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06830021-cb23-46b7-9337-ac8a97edb8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:23.447066 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06830021-cb23-46b7-9337-ac8a97edb8fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:23.454439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06830021-cb23-46b7-9337-ac8a97edb8fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:23.455868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06830021-cb23-46b7-9337-ac8a97edb8fc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:23.459473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa599604-3ff7-4531-af65-36ea4b709eb2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:23.467723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-06830021-cb23-46b7-9337-ac8a97edb8fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:23.467723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:23.467723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:23.467723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:23.467723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:23.467723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:23.467723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:23.467723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:23.467723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:23.467723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:23.467723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:23.467723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:23.467723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:23.467723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:23.467723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:23.469003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:23.469003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:23.469003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:23.469003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:23.469003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:23.469003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:23.469003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:23.469003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:23.469003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:23.469003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:23.469003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:23.469003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:23.469003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:23.469003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:23.469003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:23.469003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:23.469003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:23.469887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:23.469887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:23.469887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:23.469887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:23.469887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:23.469887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:23.469887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:23.469887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:23.469887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 332/656] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:23.469887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06830021-cb23-46b7-9337-ac8a97edb8fc None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:23.496186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb7455-b3a3-4892-8cce-9b5412625e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:23.496750 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb7455-b3a3-4892-8cce-9b5412625e49 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:23.497033 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb7455-b3a3-4892-8cce-9b5412625e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:23.497308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb7455-b3a3-4892-8cce-9b5412625e49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:23.508378 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb7455-b3a3-4892-8cce-9b5412625e49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:23.509858 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb7455-b3a3-4892-8cce-9b5412625e49 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:23.524777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6edb7455-b3a3-4892-8cce-9b5412625e49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:23.524777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:23.524777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:23.524777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:23.524777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:23.524777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:23.524777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:23.524777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:23.524777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:23.524777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:23.524777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:23.524777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:23.524777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:23.524777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:23.524777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:23.524777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:23.525969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:23.525969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:23.525969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:23.525969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:23.525969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:23.525969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:23.525969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:23.525969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:23.525969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:23.525969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:23.525969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:23.525969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:23.525969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:23.525969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:23.525969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:23.525969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:23.525969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:23.526849 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:23.526849 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:23.526849 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:23.526849 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 325/657] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:23.527088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:23.527160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb7455-b3a3-4892-8cce-9b5412625e49 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:23.573968 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06830021-cb23-46b7-9337-ac8a97edb8fc None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:23.605821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:23.607896 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371f770-d038-4e0b-a8dd-ded55660e3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:23.608889 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371f770-d038-4e0b-a8dd-ded55660e3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:23.609197 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371f770-d038-4e0b-a8dd-ded55660e3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:23.609495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371f770-d038-4e0b-a8dd-ded55660e3f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:23.632108 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb7455-b3a3-4892-8cce-9b5412625e49 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:23.666340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1726f-3206-4579-9dd7-7076e4c1502d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:23.666946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1726f-3206-4579-9dd7-7076e4c1502d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:23.667229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1726f-3206-4579-9dd7-7076e4c1502d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:23.667504 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1726f-3206-4579-9dd7-7076e4c1502d None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:23.668171 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1726f-3206-4579-9dd7-7076e4c1502d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:23.668477 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1726f-3206-4579-9dd7-7076e4c1502d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:23.669847 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1726f-3206-4579-9dd7-7076e4c1502d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:23.677229 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371f770-d038-4e0b-a8dd-ded55660e3f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:23.678678 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371f770-d038-4e0b-a8dd-ded55660e3f6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:23.681988 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 326/658] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:23.682781 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1726f-3206-4579-9dd7-7076e4c1502d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:23.734847 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:23.783596 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 333/659] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:43:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:43:23.784484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371f770-d038-4e0b-a8dd-ded55660e3f6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:23.789981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1726f-3206-4579-9dd7-7076e4c1502d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:23.824804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6df0c7-a7c5-4211-bcc2-871cc1949c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:23.825428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6df0c7-a7c5-4211-bcc2-871cc1949c3b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:23.825703 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6df0c7-a7c5-4211-bcc2-871cc1949c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:23.825970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6df0c7-a7c5-4211-bcc2-871cc1949c3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:23.827822 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:23.836851 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6df0c7-a7c5-4211-bcc2-871cc1949c3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:23.841538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7a6df0c7-a7c5-4211-bcc2-871cc1949c3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:23.841538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:23.841538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:23.841538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:23.841538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:23.841538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:23.841538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:23.841538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:23.841538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:23.841538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:23.841538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:23.841538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:23.841538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:23.841538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:23.841538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:23.841538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:23.842983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:23.842983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:23.842983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:23.842983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:23.842983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:23.842983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:23.842983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:23.842983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:23.842983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:23.842983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:23.842983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:23.842983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:23.842983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:23.842983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:23.842983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:23.842983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:23.843826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:23.843826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:23.843826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:23.843826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:23.843826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:23.843826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:23.843826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:23.843826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:23.843826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:23.843826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:23.843826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:23.843826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:23.843826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 327/660] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:43:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:23.844638 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6df0c7-a7c5-4211-bcc2-871cc1949c3b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:23.889851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371f770-d038-4e0b-a8dd-ded55660e3f6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:23.922808 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d55ad2-6a08-4fb2-a2ca-927d49102900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:23.923411 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d55ad2-6a08-4fb2-a2ca-927d49102900 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:23.923698 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d55ad2-6a08-4fb2-a2ca-927d49102900 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:23.923971 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d55ad2-6a08-4fb2-a2ca-927d49102900 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:23.924688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d55ad2-6a08-4fb2-a2ca-927d49102900 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:23.924996 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d55ad2-6a08-4fb2-a2ca-927d49102900 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:23.926433 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d55ad2-6a08-4fb2-a2ca-927d49102900 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:23.938541 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 334/661] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:23.939340 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d55ad2-6a08-4fb2-a2ca-927d49102900 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:23.947206 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6df0c7-a7c5-4211-bcc2-871cc1949c3b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:23.957468 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:23.982503 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0c2ca-3040-489d-9593-825a1bfd1aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:23.983711 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0c2ca-3040-489d-9593-825a1bfd1aca None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:23.984044 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0c2ca-3040-489d-9593-825a1bfd1aca None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:23.984288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0c2ca-3040-489d-9593-825a1bfd1aca None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:23.984914 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0c2ca-3040-489d-9593-825a1bfd1aca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:23.985215 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0c2ca-3040-489d-9593-825a1bfd1aca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:23.986585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0c2ca-3040-489d-9593-825a1bfd1aca None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:23.999006 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 328/662] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:23.999972 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0c2ca-3040-489d-9593-825a1bfd1aca None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:24.043094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d55ad2-6a08-4fb2-a2ca-927d49102900 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:24.054953 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:24.077107 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27a497-491a-4bf9-9c4b-0bae93fec62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:24.077722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27a497-491a-4bf9-9c4b-0bae93fec62c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:24.078000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27a497-491a-4bf9-9c4b-0bae93fec62c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:24.078282 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27a497-491a-4bf9-9c4b-0bae93fec62c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:24.085542 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27a497-491a-4bf9-9c4b-0bae93fec62c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:24.086969 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27a497-491a-4bf9-9c4b-0bae93fec62c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:24.098270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-6e27a497-491a-4bf9-9c4b-0bae93fec62c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 20:43:24.098270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:24.098270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:24.098270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:24.098270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:24.098270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:24.098270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:24.098270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:24.098270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:24.098270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:24.098270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:24.098270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:24.098270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:24.098270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:24.098270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:24.098270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:24.099453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:24.099453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:24.099453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:24.099453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:24.099453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:24.099453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:24.099453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:24.099453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:24.099453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:24.099453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:24.099453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:24.099453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:24.099453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:24.099453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:24.099453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:24.099453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:24.099453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:24.099453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:24.100422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:24.100422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:24.100422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:24.100422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:24.100422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:24.100422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:24.100422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:24.100422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:24.100422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 09 20:43:24.100422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:24.100974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0c2ca-3040-489d-9593-825a1bfd1aca None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:24.101048 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 335/663] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:43:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:24.101048 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27a497-491a-4bf9-9c4b-0bae93fec62c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:24.134524 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecd4fe-3458-4aeb-afb0-8c148d1e543b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:24.135160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecd4fe-3458-4aeb-afb0-8c148d1e543b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:24.135440 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecd4fe-3458-4aeb-afb0-8c148d1e543b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:24.135716 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ecd4fe-3458-4aeb-afb0-8c148d1e543b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:24.145753 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ecd4fe-3458-4aeb-afb0-8c148d1e543b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:24.147199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ecd4fe-3458-4aeb-afb0-8c148d1e543b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:24.162303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-91ecd4fe-3458-4aeb-afb0-8c148d1e543b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:24.162303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:24.162303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:24.162303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:24.162303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:24.162303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:24.162303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:24.162303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:24.162303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:24.162303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:24.162303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:24.162303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:24.162303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:24.162303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:24.162303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:24.162303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:24.163259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:24.163259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:24.163259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:24.163259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:24.163259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:24.163259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:24.163259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:24.163259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:24.163259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:24.163259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:24.163259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:24.163259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:24.163259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:24.163259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:24.163259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:24.163259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:24.163259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:24.164204 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:24.164204 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:24.164204 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:24.164204 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 329/664] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:24.164204 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecd4fe-3458-4aeb-afb0-8c148d1e543b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:24.183921 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:24.207870 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27a497-491a-4bf9-9c4b-0bae93fec62c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:24.241736 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e5527-6cef-43b9-be83-6dda76fd8274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:24.242343 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e5527-6cef-43b9-be83-6dda76fd8274 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:24.242620 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e5527-6cef-43b9-be83-6dda76fd8274 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:24.242894 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e5527-6cef-43b9-be83-6dda76fd8274 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:24.243553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e5527-6cef-43b9-be83-6dda76fd8274 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:24.243853 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e5527-6cef-43b9-be83-6dda76fd8274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:24.245261 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e5527-6cef-43b9-be83-6dda76fd8274 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:24.253273 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 336/665] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Sep 9 20:43:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:24.254074 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e5527-6cef-43b9-be83-6dda76fd8274 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:24.263185 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ecd4fe-3458-4aeb-afb0-8c148d1e543b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:24.270920 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:24.300064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570bddf-45d0-4149-b86c-747ba53afca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:24.300613 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570bddf-45d0-4149-b86c-747ba53afca7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:24.300890 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570bddf-45d0-4149-b86c-747ba53afca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:24.301159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3570bddf-45d0-4149-b86c-747ba53afca7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:24.301868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570bddf-45d0-4149-b86c-747ba53afca7 None admin] RBAC: Adding query filter params (role.id=e3de94d5ee924ea4b638d196d282af55, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=dc210376e57a41e6b3812110db249099) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:24.302173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570bddf-45d0-4149-b86c-747ba53afca7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:24.303612 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3570bddf-45d0-4149-b86c-747ba53afca7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:24.309532 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 330/666] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:43:24 2022] GET /identity/v3/role_assignments?user.id=dc210376e57a41e6b3812110db249099&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=e3de94d5ee924ea4b638d196d282af55 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:24.310153 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570bddf-45d0-4149-b86c-747ba53afca7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:24.371186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e5527-6cef-43b9-be83-6dda76fd8274 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:24.410810 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63497373-faaf-47ff-b38f-8622a1d33b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:24.411563 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63497373-faaf-47ff-b38f-8622a1d33b69 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:24.411847 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63497373-faaf-47ff-b38f-8622a1d33b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:24.412155 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63497373-faaf-47ff-b38f-8622a1d33b69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:24.420899 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63497373-faaf-47ff-b38f-8622a1d33b69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:24.422538 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63497373-faaf-47ff-b38f-8622a1d33b69 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:24.424693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:24.432114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3570bddf-45d0-4149-b86c-747ba53afca7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:24.438096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-63497373-faaf-47ff-b38f-8622a1d33b69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:24.438096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:24.438096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:24.438096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:24.438096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:24.438096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:24.438096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:24.438096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:24.438096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:24.438096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:24.438096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:24.438096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:24.438096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:24.438096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:24.438096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:24.439246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:24.439246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:24.439246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:24.439246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:24.439246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:24.439246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:24.439246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:24.439246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:24.439246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:24.439246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:24.439246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:24.439246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:24.439246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:24.439246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:24.439246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:24.439246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:24.439246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:24.440509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:24.440509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:24.440509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:24.440509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:24.440509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:24.440509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:24.440509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:24.440509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:24.440949 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 337/667] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:24.441714 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63497373-faaf-47ff-b38f-8622a1d33b69 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:24.476278 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a1429-3648-4071-acb8-4aa0820f5212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:24.477079 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a1429-3648-4071-acb8-4aa0820f5212 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:24.477456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a1429-3648-4071-acb8-4aa0820f5212 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:24.477941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a1429-3648-4071-acb8-4aa0820f5212 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:24.478894 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a1429-3648-4071-acb8-4aa0820f5212 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:24.479306 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a1429-3648-4071-acb8-4aa0820f5212 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:24.480908 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a1429-3648-4071-acb8-4aa0820f5212 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:24.502846 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 331/668] 10.222.0.15 () {56 vars in 1139 bytes} [Fri Sep 9 20:43:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:24.503767 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a1429-3648-4071-acb8-4aa0820f5212 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:24.538464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:24.564764 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63497373-faaf-47ff-b38f-8622a1d33b69 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:24.600604 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b712f-bc24-48cc-bef0-530f5025b0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:24.601638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b712f-bc24-48cc-bef0-530f5025b0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:24.601982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b712f-bc24-48cc-bef0-530f5025b0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:24.602617 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b712f-bc24-48cc-bef0-530f5025b0b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:24.603362 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b712f-bc24-48cc-bef0-530f5025b0b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:24.603737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b712f-bc24-48cc-bef0-530f5025b0b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:24.605717 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b712f-bc24-48cc-bef0-530f5025b0b2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:24.619191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 338/669] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:24.619970 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b712f-bc24-48cc-bef0-530f5025b0b2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:24.629359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a1429-3648-4071-acb8-4aa0820f5212 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:24.666345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cce731-f816-4857-a411-1afdde38209a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:24.666981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cce731-f816-4857-a411-1afdde38209a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:24.667261 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cce731-f816-4857-a411-1afdde38209a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:24.667532 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cce731-f816-4857-a411-1afdde38209a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:24.678540 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cce731-f816-4857-a411-1afdde38209a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:24.680010 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cce731-f816-4857-a411-1afdde38209a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:24.681660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:24.695223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-47cce731-f816-4857-a411-1afdde38209a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:24.695223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:24.695223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:24.695223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:24.695223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:24.695223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:24.695223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:24.695223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:24.695223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:24.695223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:24.695223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:24.695223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:24.695223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:24.695223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:24.695223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:24.695223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:24.696275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:24.696275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:24.696275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:24.696275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:24.696275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:24.696275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:24.696275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:24.696275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:24.696275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:24.696275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:24.696275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:24.696275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:24.696275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:24.696275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:24.696275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:24.696275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:24.696275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:24.697183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:24.697183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:24.697183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:24.697183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 332/670] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:24.697183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cce731-f816-4857-a411-1afdde38209a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:24.738147 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b712f-bc24-48cc-bef0-530f5025b0b2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:24.784218 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029150e9-611d-463b-a225-5c60ffe61a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:24.786098 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029150e9-611d-463b-a225-5c60ffe61a53 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:24.786547 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029150e9-611d-463b-a225-5c60ffe61a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:24.787225 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029150e9-611d-463b-a225-5c60ffe61a53 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:24.788112 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029150e9-611d-463b-a225-5c60ffe61a53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:24.788450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029150e9-611d-463b-a225-5c60ffe61a53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:24.790197 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029150e9-611d-463b-a225-5c60ffe61a53 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:24.804064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:24.819525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 339/671] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:24.819525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029150e9-611d-463b-a225-5c60ffe61a53 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:24.833647 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cce731-f816-4857-a411-1afdde38209a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:24.870603 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7ee34-8de1-4937-9f6c-cd6ff4852fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:24.871224 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7ee34-8de1-4937-9f6c-cd6ff4852fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:24.871508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7ee34-8de1-4937-9f6c-cd6ff4852fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:24.871788 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7ee34-8de1-4937-9f6c-cd6ff4852fe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:24.951404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7ee34-8de1-4937-9f6c-cd6ff4852fe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:24.953205 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7ee34-8de1-4937-9f6c-cd6ff4852fe3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:24.955145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029150e9-611d-463b-a225-5c60ffe61a53 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:24.977369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:25.001647 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822545aa-b2c5-4af1-9fb0-531393927d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:25.002282 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822545aa-b2c5-4af1-9fb0-531393927d4e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:25.002558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822545aa-b2c5-4af1-9fb0-531393927d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:25.002828 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822545aa-b2c5-4af1-9fb0-531393927d4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:25.013893 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822545aa-b2c5-4af1-9fb0-531393927d4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:25.015366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822545aa-b2c5-4af1-9fb0-531393927d4e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:25.028674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-822545aa-b2c5-4af1-9fb0-531393927d4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:25.028674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:25.028674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:25.028674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:25.028674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:25.028674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:25.028674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:25.028674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:25.028674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:25.028674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:25.028674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:25.028674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:25.028674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:25.028674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:25.028674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:25.029623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:25.029623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:25.029623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:25.029623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:25.029623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:25.029623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:25.029623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:25.029623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:25.029623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:25.029623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:25.029623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:25.029623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:25.029623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:25.029623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:25.029623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:25.029623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:25.029623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:25.030540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:25.030540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:25.030540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:25.030540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:25.030540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:25.030540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:25.030540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:25.030540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:25.030965 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 340/672] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:25.031674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822545aa-b2c5-4af1-9fb0-531393927d4e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:25.055643 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:25.081483 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 333/673] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:43:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:43:25.081674 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7ee34-8de1-4937-9f6c-cd6ff4852fe3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:25.172158 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822545aa-b2c5-4af1-9fb0-531393927d4e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:25.209473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7ee34-8de1-4937-9f6c-cd6ff4852fe3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:25.218471 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eab8fd-7762-470a-a314-92429bdaed99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:25.219087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eab8fd-7762-470a-a314-92429bdaed99 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:25.219358 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eab8fd-7762-470a-a314-92429bdaed99 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:25.219631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eab8fd-7762-470a-a314-92429bdaed99 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:25.220309 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eab8fd-7762-470a-a314-92429bdaed99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:25.220610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eab8fd-7762-470a-a314-92429bdaed99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:25.221968 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eab8fd-7762-470a-a314-92429bdaed99 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:25.237421 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 341/674] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:25.238275 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eab8fd-7762-470a-a314-92429bdaed99 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:25.256303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b161118-56cf-4007-aa55-6f55c78368d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:25.257657 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b161118-56cf-4007-aa55-6f55c78368d0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:25.258198 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b161118-56cf-4007-aa55-6f55c78368d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:25.258668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b161118-56cf-4007-aa55-6f55c78368d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:25.259721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b161118-56cf-4007-aa55-6f55c78368d0 None admin] RBAC: Adding query filter params (role.id=e3de94d5ee924ea4b638d196d282af55, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=cf65c58c74fc49e4ba7605f3c6c27f8b) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:25.260606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b161118-56cf-4007-aa55-6f55c78368d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:25.262724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b161118-56cf-4007-aa55-6f55c78368d0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:25.278387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 334/675] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:43:25 2022] GET /identity/v3/role_assignments?user.id=cf65c58c74fc49e4ba7605f3c6c27f8b&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=e3de94d5ee924ea4b638d196d282af55 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:25.278387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b161118-56cf-4007-aa55-6f55c78368d0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:25.322239 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:25.363483 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:25.403927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eab8fd-7762-470a-a314-92429bdaed99 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:25.452204 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b161118-56cf-4007-aa55-6f55c78368d0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:25.457777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8fba2-394e-42c7-b7c2-dd0db0c13ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:25.458789 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8fba2-394e-42c7-b7c2-dd0db0c13ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:25.459267 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8fba2-394e-42c7-b7c2-dd0db0c13ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:25.459832 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8fba2-394e-42c7-b7c2-dd0db0c13ad1 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:25.461414 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8fba2-394e-42c7-b7c2-dd0db0c13ad1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:25.461958 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8fba2-394e-42c7-b7c2-dd0db0c13ad1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:25.464655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8fba2-394e-42c7-b7c2-dd0db0c13ad1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:25.487947 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 342/676] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:25.489193 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8fba2-394e-42c7-b7c2-dd0db0c13ad1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:25.508909 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a14e08-deeb-41cd-a97f-8d2aca4f2c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:25.509567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a14e08-deeb-41cd-a97f-8d2aca4f2c69 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:25.509852 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a14e08-deeb-41cd-a97f-8d2aca4f2c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:25.510168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a14e08-deeb-41cd-a97f-8d2aca4f2c69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:25.524458 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a14e08-deeb-41cd-a97f-8d2aca4f2c69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:25.526213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a14e08-deeb-41cd-a97f-8d2aca4f2c69 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:25.549930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-47a14e08-deeb-41cd-a97f-8d2aca4f2c69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:25.549930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:25.549930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:25.549930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:25.549930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:25.549930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:25.549930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:25.549930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:25.549930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:25.549930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:25.549930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:25.549930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:25.549930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:25.549930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:25.549930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:25.549930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:25.550949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:25.550949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:25.550949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:25.550949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:25.550949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:25.550949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:25.550949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:25.550949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:25.550949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:25.550949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:25.550949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:25.550949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:25.550949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:25.550949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:25.550949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:25.550949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:25.550949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:25.552754 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:25.552754 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:25.552754 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:25.552754 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 335/677] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:25.552754 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a14e08-deeb-41cd-a97f-8d2aca4f2c69 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:25.609308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:25.613244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8fba2-394e-42c7-b7c2-dd0db0c13ad1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:25.658406 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4f3ea-c011-4c76-97ec-ce66ac8d7ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:25.659020 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4f3ea-c011-4c76-97ec-ce66ac8d7ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:25.659098 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4f3ea-c011-4c76-97ec-ce66ac8d7ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:25.659361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4f3ea-c011-4c76-97ec-ce66ac8d7ff1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:25.670463 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4f3ea-c011-4c76-97ec-ce66ac8d7ff1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:25.672344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4f3ea-c011-4c76-97ec-ce66ac8d7ff1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:25.688199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-59c4f3ea-c011-4c76-97ec-ce66ac8d7ff1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 20:43:25.688199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:25.688199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:25.688199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:25.688199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:25.688199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:25.688199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:25.688199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:25.688199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:25.688199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:25.688199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:25.688199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:25.688199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:25.688199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:25.688199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:25.688199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:25.689208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:25.689208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:25.689208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:25.689208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:25.689208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:25.689208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:25.689208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:25.689208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:25.689208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:25.689208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:25.689208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:25.689208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:25.689208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:25.689208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:25.689208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:25.689208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:25.689208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:25.689208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:25.690120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:25.690120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:25.690120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:25.690120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:25.690120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:25.690120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:25.690120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:25.690120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:25.690120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 20:43:25.690120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:25.692097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 343/678] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:43:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:25.693216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4f3ea-c011-4c76-97ec-ce66ac8d7ff1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:25.708510 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:25.715717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a14e08-deeb-41cd-a97f-8d2aca4f2c69 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:25.767809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd69924-a160-4906-820b-272705fc0505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:25.769503 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd69924-a160-4906-820b-272705fc0505 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:25.770098 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd69924-a160-4906-820b-272705fc0505 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:25.770578 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd69924-a160-4906-820b-272705fc0505 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:25.771517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd69924-a160-4906-820b-272705fc0505 None admin] RBAC: Adding query filter params (role.id=e3de94d5ee924ea4b638d196d282af55, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=8d298efe48464956b7a03cba1001060b) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:25.772080 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd69924-a160-4906-820b-272705fc0505 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:25.774581 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd69924-a160-4906-820b-272705fc0505 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:25.784693 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 336/679] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:43:25 2022] GET /identity/v3/role_assignments?user.id=8d298efe48464956b7a03cba1001060b&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=e3de94d5ee924ea4b638d196d282af55 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:25.785805 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd69924-a160-4906-820b-272705fc0505 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:25.878369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4f3ea-c011-4c76-97ec-ce66ac8d7ff1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:25.950065 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95277d-b50b-4afb-9459-c482922353da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:25.950674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95277d-b50b-4afb-9459-c482922353da None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:25.950956 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95277d-b50b-4afb-9459-c482922353da None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:25.951299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95277d-b50b-4afb-9459-c482922353da None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:25.952068 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95277d-b50b-4afb-9459-c482922353da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:25.952381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95277d-b50b-4afb-9459-c482922353da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:25.953779 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad95277d-b50b-4afb-9459-c482922353da None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:25.983695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 344/680] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:25.989952 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95277d-b50b-4afb-9459-c482922353da None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:26.016216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:26.017497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd69924-a160-4906-820b-272705fc0505 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:26.066323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72987d10-9502-458b-8ebc-043fcbeb9df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:26.066970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72987d10-9502-458b-8ebc-043fcbeb9df2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:26.067213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72987d10-9502-458b-8ebc-043fcbeb9df2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:26.067489 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72987d10-9502-458b-8ebc-043fcbeb9df2 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:26.068245 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72987d10-9502-458b-8ebc-043fcbeb9df2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:26.068589 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72987d10-9502-458b-8ebc-043fcbeb9df2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:26.070092 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72987d10-9502-458b-8ebc-043fcbeb9df2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:26.090428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 337/681] 10.222.0.15 () {56 vars in 1135 bytes} [Fri Sep 9 20:43:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:26.096478 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72987d10-9502-458b-8ebc-043fcbeb9df2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:26.115819 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95277d-b50b-4afb-9459-c482922353da None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:26.118787 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:26.159761 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16c9a1-beb7-4182-ba10-f1e957547d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:26.160875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16c9a1-beb7-4182-ba10-f1e957547d66 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:26.161365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16c9a1-beb7-4182-ba10-f1e957547d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:26.161929 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16c9a1-beb7-4182-ba10-f1e957547d66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:26.171422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16c9a1-beb7-4182-ba10-f1e957547d66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:26.174048 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a16c9a1-beb7-4182-ba10-f1e957547d66 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:26.188645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-5a16c9a1-beb7-4182-ba10-f1e957547d66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:26.188645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:26.188645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:26.188645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:26.188645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:26.188645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:26.188645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:26.188645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:26.188645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:26.188645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:26.188645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:26.188645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:26.188645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:26.188645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:26.188645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:26.189561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:26.189561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:26.189561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:26.189561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:26.189561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:26.189561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:26.189561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:26.189561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:26.189561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:26.189561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:26.189561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:26.189561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:26.189561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:26.189561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:26.189561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:26.189561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:26.189561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:26.190439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:26.190439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:26.190439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:26.190439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:26.190439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:26.190439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:26.190439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:26.190439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:26.193759 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 345/682] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:26.200359 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16c9a1-beb7-4182-ba10-f1e957547d66 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:26.221416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72987d10-9502-458b-8ebc-043fcbeb9df2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:26.260139 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85a3f6-3c61-4c9d-afca-b5315c9140fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:26.260767 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85a3f6-3c61-4c9d-afca-b5315c9140fb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:26.261038 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85a3f6-3c61-4c9d-afca-b5315c9140fb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:26.261311 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85a3f6-3c61-4c9d-afca-b5315c9140fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:26.300851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:26.333657 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16c9a1-beb7-4182-ba10-f1e957547d66 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:26.353105 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85a3f6-3c61-4c9d-afca-b5315c9140fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:26.355108 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85a3f6-3c61-4c9d-afca-b5315c9140fb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:26.377313 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9102e3-7b75-4a7e-b11f-07d4db92ce03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:26.378067 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9102e3-7b75-4a7e-b11f-07d4db92ce03 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:26.378352 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9102e3-7b75-4a7e-b11f-07d4db92ce03 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:26.378621 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9102e3-7b75-4a7e-b11f-07d4db92ce03 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:26.379691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:26.380278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9102e3-7b75-4a7e-b11f-07d4db92ce03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:26.380389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9102e3-7b75-4a7e-b11f-07d4db92ce03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:26.381846 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9102e3-7b75-4a7e-b11f-07d4db92ce03 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:26.398873 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 346/683] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:26.405934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9102e3-7b75-4a7e-b11f-07d4db92ce03 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:26.477002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 338/684] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 09 20:43:26.484200 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85a3f6-3c61-4c9d-afca-b5315c9140fb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:26.528234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9102e3-7b75-4a7e-b11f-07d4db92ce03 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:26.567914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc153f0-a54a-4ec8-ab2c-1342cf0a3111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:26.568560 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc153f0-a54a-4ec8-ab2c-1342cf0a3111 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:26.568837 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc153f0-a54a-4ec8-ab2c-1342cf0a3111 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:26.569109 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc153f0-a54a-4ec8-ab2c-1342cf0a3111 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:26.569836 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc153f0-a54a-4ec8-ab2c-1342cf0a3111 None admin] RBAC: Adding query filter params (role.id=e3de94d5ee924ea4b638d196d282af55, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=27e2be33ebdc4c5a97befcbd4d09ee4c) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:26.570143 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc153f0-a54a-4ec8-ab2c-1342cf0a3111 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:26.571974 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc153f0-a54a-4ec8-ab2c-1342cf0a3111 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:26.580353 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 347/685] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:43:26 2022] GET /identity/v3/role_assignments?user.id=27e2be33ebdc4c5a97befcbd4d09ee4c&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=e3de94d5ee924ea4b638d196d282af55 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:26.687282 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85a3f6-3c61-4c9d-afca-b5315c9140fb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:26.713512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:26.741941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3524157-ea4b-4017-84c0-0769a96d5892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:26.742534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3524157-ea4b-4017-84c0-0769a96d5892 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:26.742822 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3524157-ea4b-4017-84c0-0769a96d5892 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:26.743099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3524157-ea4b-4017-84c0-0769a96d5892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:26.759307 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81cab7-b861-4f94-8f68-cce0e2675d1b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:26.759840 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81cab7-b861-4f94-8f68-cce0e2675d1b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:26.759840 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81cab7-b861-4f94-8f68-cce0e2675d1b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:26.761437 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3524157-ea4b-4017-84c0-0769a96d5892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:26.762690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 348/686] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:26.762923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3524157-ea4b-4017-84c0-0769a96d5892 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:26.767079 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948b7d5-4350-47ce-aafb-231ec118da5c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:26.767360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948b7d5-4350-47ce-aafb-231ec118da5c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:26.767636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948b7d5-4350-47ce-aafb-231ec118da5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:26.774295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:26.791340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c3524157-ea4b-4017-84c0-0769a96d5892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:26.791340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:26.791340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:26.791340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:26.791340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:26.791340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:26.791340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:26.791340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:26.791340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:26.791340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:26.791340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:26.791340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:26.791340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:26.791340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:26.791340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:26.791340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:26.792404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:26.792404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:26.792404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:26.792404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:26.792404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:26.792404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:26.792404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:26.792404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:26.792404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:26.792404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:26.792404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:26.792404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:26.792404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:26.792404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:26.792404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:26.792404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:26.792404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:26.793302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:26.793302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:26.793302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:26.793302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 339/687] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:26.797253 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6948b7d5-4350-47ce-aafb-231ec118da5c None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:26.798453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6948b7d5-4350-47ce-aafb-231ec118da5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:26.803742 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3524157-ea4b-4017-84c0-0769a96d5892 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:26.888525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 349/688] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:43:26.933600 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3524157-ea4b-4017-84c0-0769a96d5892 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:26.971359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3821c-12c3-4d9e-a910-922e9f9557e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:26.971971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3821c-12c3-4d9e-a910-922e9f9557e0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:26.972312 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3821c-12c3-4d9e-a910-922e9f9557e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:26.972586 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3821c-12c3-4d9e-a910-922e9f9557e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:26.973229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3821c-12c3-4d9e-a910-922e9f9557e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:26.973536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3821c-12c3-4d9e-a910-922e9f9557e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:26.974987 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3821c-12c3-4d9e-a910-922e9f9557e0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:26.988249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 340/689] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:26.993506 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948b7d5-4350-47ce-aafb-231ec118da5c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:27.119314 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948b7d5-4350-47ce-aafb-231ec118da5c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:27.157850 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:27.165309 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cbed3-63d3-4ece-95a2-c74f7fe1f525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:27.166228 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cbed3-63d3-4ece-95a2-c74f7fe1f525 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:27.166734 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cbed3-63d3-4ece-95a2-c74f7fe1f525 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:27.167187 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8cbed3-63d3-4ece-95a2-c74f7fe1f525 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:27.181139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cbed3-63d3-4ece-95a2-c74f7fe1f525 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:27.182890 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8cbed3-63d3-4ece-95a2-c74f7fe1f525 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:27.197202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-4d8cbed3-63d3-4ece-95a2-c74f7fe1f525 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:27.197202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:27.197202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:27.197202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:27.197202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:27.197202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:27.197202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:27.197202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:27.197202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:27.197202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:27.197202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:27.197202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:27.197202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:27.197202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:27.197202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:27.198140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:27.198140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:27.198140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:27.198140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:27.198140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:27.198140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:27.198140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:27.198140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:27.198140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:27.198140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:27.198140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:27.198140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:27.198140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:27.198140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:27.198140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:27.198140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:27.198140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:27.199065 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:27.199065 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:27.199065 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:27.199065 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:27.199065 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:27.199065 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:27.199065 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:27.199065 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:27.199497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3821c-12c3-4d9e-a910-922e9f9557e0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:27.202081 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 350/690] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:27.207472 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cbed3-63d3-4ece-95a2-c74f7fe1f525 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:27.292048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:27.310826 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8cbed3-63d3-4ece-95a2-c74f7fe1f525 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:27.346903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f75dc-bb4d-4701-9d50-264dbb87d4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:27.347916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f75dc-bb4d-4701-9d50-264dbb87d4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:27.348416 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f75dc-bb4d-4701-9d50-264dbb87d4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:27.348909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f75dc-bb4d-4701-9d50-264dbb87d4d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:27.349839 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f75dc-bb4d-4701-9d50-264dbb87d4d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:27.350353 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f75dc-bb4d-4701-9d50-264dbb87d4d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:27.352052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241f75dc-bb4d-4701-9d50-264dbb87d4d6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:27.370176 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 351/691] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:27.371978 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f75dc-bb4d-4701-9d50-264dbb87d4d6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:27.428672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:27.447770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3821c-12c3-4d9e-a910-922e9f9557e0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:27.474934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f75dc-bb4d-4701-9d50-264dbb87d4d6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:27.485534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14582e3-c346-4c0c-a495-c7520719f66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:27.486036 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14582e3-c346-4c0c-a495-c7520719f66a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:27.486327 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14582e3-c346-4c0c-a495-c7520719f66a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:27.486604 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14582e3-c346-4c0c-a495-c7520719f66a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:27.498092 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14582e3-c346-4c0c-a495-c7520719f66a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:27.503955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-d14582e3-c346-4c0c-a495-c7520719f66a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:43:27.503955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:27.503955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:27.503955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:27.503955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:27.503955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:27.503955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:27.503955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:27.503955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:27.503955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:27.503955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:27.503955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:27.503955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:27.503955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:27.503955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:27.503955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:27.504981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:27.504981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:27.504981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:27.504981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:27.504981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:27.504981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:27.504981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:27.504981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:27.504981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:27.504981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:27.504981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:27.504981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:27.504981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:27.504981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:27.504981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:27.504981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:27.506180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:27.506180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:27.506180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:27.506180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:27.506180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:27.506180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:27.506180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:27.506180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:27.506180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:27.506180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:27.506180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:43:27.506180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:27.506180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 341/692] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:43:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:43:27.511263 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14582e3-c346-4c0c-a495-c7520719f66a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:27.516841 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697df0d-b1ee-4649-b60b-c44881570850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:27.517758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697df0d-b1ee-4649-b60b-c44881570850 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:27.518288 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697df0d-b1ee-4649-b60b-c44881570850 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:27.518749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697df0d-b1ee-4649-b60b-c44881570850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:27.519665 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697df0d-b1ee-4649-b60b-c44881570850 None admin] RBAC: Adding query filter params (role.id=e3de94d5ee924ea4b638d196d282af55, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=9570eaa112de460cb9e371278bfb300b) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:27.520204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697df0d-b1ee-4649-b60b-c44881570850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:27.521881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697df0d-b1ee-4649-b60b-c44881570850 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:27.536149 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 352/693] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:43:27 2022] GET /identity/v3/role_assignments?user.id=9570eaa112de460cb9e371278bfb300b&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=e3de94d5ee924ea4b638d196d282af55 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:27.688005 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:27.699784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14582e3-c346-4c0c-a495-c7520719f66a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:27.738380 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde963f-bc5e-4194-82a5-09366c86a95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:27.738997 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde963f-bc5e-4194-82a5-09366c86a95e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:27.739278 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde963f-bc5e-4194-82a5-09366c86a95e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:27.739551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde963f-bc5e-4194-82a5-09366c86a95e None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:27.740354 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde963f-bc5e-4194-82a5-09366c86a95e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:27.740659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde963f-bc5e-4194-82a5-09366c86a95e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:27.742035 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afde963f-bc5e-4194-82a5-09366c86a95e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:27.751390 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 342/694] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:43:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:27.756786 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697df0d-b1ee-4649-b60b-c44881570850 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:27.866337 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697df0d-b1ee-4649-b60b-c44881570850 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:27.883491 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:27.901906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b1b0f-2d3b-459e-ac84-a2e13f62b2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:27.902544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b1b0f-2d3b-459e-ac84-a2e13f62b2d6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:27.902821 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b1b0f-2d3b-459e-ac84-a2e13f62b2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:27.903094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b1b0f-2d3b-459e-ac84-a2e13f62b2d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:27.915105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b1b0f-2d3b-459e-ac84-a2e13f62b2d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:27.916572 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b1b0f-2d3b-459e-ac84-a2e13f62b2d6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:27.931165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-af1b1b0f-2d3b-459e-ac84-a2e13f62b2d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:27.931165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:27.931165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:27.931165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:27.931165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:27.931165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:27.931165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:27.931165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:27.931165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:27.931165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:27.931165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:27.931165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:27.931165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:27.931165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:27.931165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:27.931165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:27.932339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:27.932339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:27.932339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:27.932339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:27.932339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:27.932339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:27.932339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:27.932339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:27.932339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:27.932339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:27.932339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:27.932339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:27.932339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:27.932339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:27.932339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:27.932339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:27.932339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:27.933429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:27.933429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:27.933429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:27.933429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 353/695] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:27.940057 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde963f-bc5e-4194-82a5-09366c86a95e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:28.055796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde963f-bc5e-4194-82a5-09366c86a95e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:28.094002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca53891-0cf8-4b9e-87d3-83b2a7d4b36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:28.094629 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca53891-0cf8-4b9e-87d3-83b2a7d4b36e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:28.094910 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca53891-0cf8-4b9e-87d3-83b2a7d4b36e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:28.095183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca53891-0cf8-4b9e-87d3-83b2a7d4b36e None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:28.095826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca53891-0cf8-4b9e-87d3-83b2a7d4b36e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:28.096159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca53891-0cf8-4b9e-87d3-83b2a7d4b36e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:28.097620 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca53891-0cf8-4b9e-87d3-83b2a7d4b36e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:28.112996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 343/696] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:28.121339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b1b0f-2d3b-459e-ac84-a2e13f62b2d6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:28.122462 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309a681-b0b8-4b29-a133-3c591a6ad442 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:28.122759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309a681-b0b8-4b29-a133-3c591a6ad442 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:28.123038 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2309a681-b0b8-4b29-a133-3c591a6ad442 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:28.124937 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 344/697] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:43:28.132322 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719fe79-b663-4f58-955f-f9a59449ad63 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:28.132608 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719fe79-b663-4f58-955f-f9a59449ad63 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:28.132885 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719fe79-b663-4f58-955f-f9a59449ad63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:28.155482 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2719fe79-b663-4f58-955f-f9a59449ad63 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:28.157008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2719fe79-b663-4f58-955f-f9a59449ad63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:28.172355 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:28.244168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 345/698] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 09 20:43:28.346760 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b1b0f-2d3b-459e-ac84-a2e13f62b2d6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:28.395610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fbc2c-53ad-4e55-843b-f676c01a3db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:28.396288 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fbc2c-53ad-4e55-843b-f676c01a3db4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:28.396572 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fbc2c-53ad-4e55-843b-f676c01a3db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:28.396849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fbc2c-53ad-4e55-843b-f676c01a3db4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:28.405965 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fbc2c-53ad-4e55-843b-f676c01a3db4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:28.407417 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fbc2c-53ad-4e55-843b-f676c01a3db4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:28.429401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-643fbc2c-53ad-4e55-843b-f676c01a3db4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 20:43:28.429401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:28.429401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:28.429401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:28.429401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:28.429401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:28.429401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:28.429401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:28.429401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:28.429401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:28.429401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:28.429401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:28.429401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:28.429401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:28.429401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:28.429401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:28.430460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:28.430460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:28.430460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:28.430460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:28.430460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:28.430460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:28.430460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:28.430460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:28.430460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:28.430460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:28.430460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:28.430460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:28.430460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:28.430460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:28.430460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:28.430460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:28.430460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:28.430460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:28.431432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:28.431432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:28.431432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:28.431432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:28.431432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:28.431432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:28.431432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:28.431432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:28.431432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 20:43:28.431432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:28.431432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 354/699] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Sep 9 20:43:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:28.436456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719fe79-b663-4f58-955f-f9a59449ad63 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:28.566538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719fe79-b663-4f58-955f-f9a59449ad63 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:28.603677 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee867ba1-a51a-4c66-9d4c-b82143f0faf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:28.604720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee867ba1-a51a-4c66-9d4c-b82143f0faf0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:28.605202 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee867ba1-a51a-4c66-9d4c-b82143f0faf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:28.605697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee867ba1-a51a-4c66-9d4c-b82143f0faf0 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:28.606616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee867ba1-a51a-4c66-9d4c-b82143f0faf0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:28.607123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee867ba1-a51a-4c66-9d4c-b82143f0faf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:28.608877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee867ba1-a51a-4c66-9d4c-b82143f0faf0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:28.615701 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fbc2c-53ad-4e55-843b-f676c01a3db4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:28.626681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:28.631100 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 346/700] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Sep 9 20:43:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:28.636612 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee867ba1-a51a-4c66-9d4c-b82143f0faf0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:28.652059 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:28.746487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fbc2c-53ad-4e55-843b-f676c01a3db4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:28.785309 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3285b81-179a-47b0-97b9-10f5e14afb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:28.786420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3285b81-179a-47b0-97b9-10f5e14afb73 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:28.786920 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3285b81-179a-47b0-97b9-10f5e14afb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:28.787392 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3285b81-179a-47b0-97b9-10f5e14afb73 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:28.788204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3285b81-179a-47b0-97b9-10f5e14afb73 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:28.789763 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3285b81-179a-47b0-97b9-10f5e14afb73 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:28.802298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-e3285b81-179a-47b0-97b9-10f5e14afb73 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 20:43:28.802298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:28.802298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:43:28.802298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:43:28.802298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:43:28.802298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:43:28.802298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:43:28.802298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:28.802298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 20:43:28.802298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:28.802298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:43:28.802298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:28.802298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:28.802298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:28.802298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:28.802298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:28.802298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:28.803346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:28.803346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:28.803346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:28.803346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:28.803346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:28.803346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:28.803346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:43:28.803346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:43:28.803346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:43:28.803346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:43:28.803346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:28.803346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:28.803346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:28.803346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:28.803346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:28.803346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:28.804688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:28.804688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:28.804688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:28.804688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:28.804688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:28.804688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:28.804688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:28.804688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:28.804688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:28.804688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:28.804688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:43:28.804688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:28.804688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 20:43:28.804688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:28.807607 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 355/701] 10.222.0.15 () {56 vars in 1129 bytes} [Fri Sep 9 20:43:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:43:28.813627 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3285b81-179a-47b0-97b9-10f5e14afb73 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:28.822127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee867ba1-a51a-4c66-9d4c-b82143f0faf0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:28.858090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756010e1-35ec-4f06-b476-fdcee5ad85c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:28.858457 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756010e1-35ec-4f06-b476-fdcee5ad85c1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:28.858861 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756010e1-35ec-4f06-b476-fdcee5ad85c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:28.859140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756010e1-35ec-4f06-b476-fdcee5ad85c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:28.924558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:28.934500 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3285b81-179a-47b0-97b9-10f5e14afb73 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:28.941890 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756010e1-35ec-4f06-b476-fdcee5ad85c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:28.944057 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756010e1-35ec-4f06-b476-fdcee5ad85c1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:28.948347 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:28.975974 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b0cc6-eb24-4612-9148-5a11f7f8d23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:28.976729 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b0cc6-eb24-4612-9148-5a11f7f8d23e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:28.977053 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b0cc6-eb24-4612-9148-5a11f7f8d23e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:28.977336 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b0cc6-eb24-4612-9148-5a11f7f8d23e None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:28.978133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b0cc6-eb24-4612-9148-5a11f7f8d23e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:28.978443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b0cc6-eb24-4612-9148-5a11f7f8d23e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:28.980451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b0cc6-eb24-4612-9148-5a11f7f8d23e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:28.987945 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 356/702] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Sep 9 20:43:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:28.989185 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f50de-e1d8-412a-aae9-63f70ec12629 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:28.989469 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f50de-e1d8-412a-aae9-63f70ec12629 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:28.989743 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05f50de-e1d8-412a-aae9-63f70ec12629 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:28.992070 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 357/703] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:28.996016 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f50de-e1d8-412a-aae9-63f70ec12629 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:29.083427 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 347/704] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:43:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:43:29.086045 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1701264-90c9-4991-927e-94d6cb826603 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:29.086817 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1701264-90c9-4991-927e-94d6cb826603 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:29.087298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1701264-90c9-4991-927e-94d6cb826603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:29.110284 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05f50de-e1d8-412a-aae9-63f70ec12629 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:29.112334 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b1701264-90c9-4991-927e-94d6cb826603 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:29.114606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b1701264-90c9-4991-927e-94d6cb826603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:29.149066 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c91ea-bda3-404a-82c3-e6b42806795a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:29.149822 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c91ea-bda3-404a-82c3-e6b42806795a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:29.150102 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c91ea-bda3-404a-82c3-e6b42806795a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:29.150425 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c91ea-bda3-404a-82c3-e6b42806795a None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:29.151423 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c91ea-bda3-404a-82c3-e6b42806795a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:29.151728 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c91ea-bda3-404a-82c3-e6b42806795a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:29.153427 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c91ea-bda3-404a-82c3-e6b42806795a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:29.160885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 358/705] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Sep 9 20:43:28 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:29.161915 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c91ea-bda3-404a-82c3-e6b42806795a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:29.190608 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:29.207068 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 348/706] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:29.280973 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c91ea-bda3-404a-82c3-e6b42806795a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:29.323833 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168b24d-a1f5-4ef8-8b04-9f80606e2a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:29.324515 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168b24d-a1f5-4ef8-8b04-9f80606e2a8c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:29.324792 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168b24d-a1f5-4ef8-8b04-9f80606e2a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:29.325063 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9168b24d-a1f5-4ef8-8b04-9f80606e2a8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:29.336742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168b24d-a1f5-4ef8-8b04-9f80606e2a8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:29.338154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9168b24d-a1f5-4ef8-8b04-9f80606e2a8c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:29.353503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-9168b24d-a1f5-4ef8-8b04-9f80606e2a8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:29.353503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:29.353503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:29.353503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:29.353503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:29.353503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:29.353503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:29.353503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:29.353503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:29.353503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:29.353503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:29.353503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:29.353503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:29.353503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:29.353503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:29.353503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:29.354488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:29.354488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:29.354488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:29.354488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:29.354488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:29.354488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:29.354488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:29.354488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:29.354488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:29.354488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:29.354488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:29.354488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:29.354488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:29.354488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:29.354488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:29.354488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:29.354488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:29.355358 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:29.355358 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:29.355358 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:29.355358 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 359/707] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:29.362129 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1701264-90c9-4991-927e-94d6cb826603 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:29.418408 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:29.505560 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1701264-90c9-4991-927e-94d6cb826603 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:29.548056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2276524-7812-42a5-a1e2-cfb38adaf7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:29.548684 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2276524-7812-42a5-a1e2-cfb38adaf7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:29.548971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2276524-7812-42a5-a1e2-cfb38adaf7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:29.549246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2276524-7812-42a5-a1e2-cfb38adaf7b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:29.549898 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2276524-7812-42a5-a1e2-cfb38adaf7b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:29.550203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2276524-7812-42a5-a1e2-cfb38adaf7b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:29.551585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2276524-7812-42a5-a1e2-cfb38adaf7b6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:29.554289 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168b24d-a1f5-4ef8-8b04-9f80606e2a8c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:29.567068 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 349/708] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:29.572091 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2276524-7812-42a5-a1e2-cfb38adaf7b6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:29.636845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:29.677413 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9168b24d-a1f5-4ef8-8b04-9f80606e2a8c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:29.685339 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:29.698468 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2276524-7812-42a5-a1e2-cfb38adaf7b6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:29.717067 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4cc054-4fb0-47f5-91ac-1c8e2085be85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:29.717870 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cc054-4fb0-47f5-91ac-1c8e2085be85 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:29.718152 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cc054-4fb0-47f5-91ac-1c8e2085be85 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:29.718428 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cc054-4fb0-47f5-91ac-1c8e2085be85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:29.732196 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4cc054-4fb0-47f5-91ac-1c8e2085be85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:29.733617 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4cc054-4fb0-47f5-91ac-1c8e2085be85 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:29.737550 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b6f09c-b042-44ac-935f-16a9d7aa33d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:29.738392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6f09c-b042-44ac-935f-16a9d7aa33d1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:29.738849 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6f09c-b042-44ac-935f-16a9d7aa33d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:29.739320 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b6f09c-b042-44ac-935f-16a9d7aa33d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:29.746679 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6f09c-b042-44ac-935f-16a9d7aa33d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:29.749094 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b6f09c-b042-44ac-935f-16a9d7aa33d1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:29.749643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8e4cc054-4fb0-47f5-91ac-1c8e2085be85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:29.749643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:29.749643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:29.749643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:29.749643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:29.749643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:29.749643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:29.749643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:29.749643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:29.749643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:29.749643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:29.749643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:29.749643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:29.749643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:29.749643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:29.749643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:29.750609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:29.750609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:29.750609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:29.750609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:29.750609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:29.750609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:29.750609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:29.750609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:29.750609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:29.750609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:29.750609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:29.750609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:29.750609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:29.750609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:29.750609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:29.750609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:29.750609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:29.751515 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:29.751515 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:29.751515 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:29.751515 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 360/709] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:29.757280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681f183-8c72-41b0-84bc-ca67e75c384b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:29.757575 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681f183-8c72-41b0-84bc-ca67e75c384b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:29.757926 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681f183-8c72-41b0-84bc-ca67e75c384b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:29.759831 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 361/710] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:29.761025 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681f183-8c72-41b0-84bc-ca67e75c384b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:29.767135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-11b6f09c-b042-44ac-935f-16a9d7aa33d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:29.767135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:29.767135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:29.767135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:29.767135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:29.767135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:29.767135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:29.767135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:29.767135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:29.767135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:29.767135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:29.767135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:29.767135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:29.767135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:29.767135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:29.768309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:29.768309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:29.768309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:29.768309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:29.768309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:29.768309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:29.768309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:29.768309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:29.768309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:29.768309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:29.768309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:29.768309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:29.768309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:29.768309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:29.768309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:29.768309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:29.768309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:29.769447 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:29.769447 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:29.769447 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:29.769447 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:29.769447 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:29.769447 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:29.769447 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:29.769447 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:29.771562 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 350/711] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:43:29.773187 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77ce4e-13a7-4091-a8a8-af506ae4a203 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:29.773646 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77ce4e-13a7-4091-a8a8-af506ae4a203 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:29.774117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77ce4e-13a7-4091-a8a8-af506ae4a203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:29.795760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7b77ce4e-13a7-4091-a8a8-af506ae4a203 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:29.797754 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7b77ce4e-13a7-4091-a8a8-af506ae4a203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:29.876099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 351/712] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:29.878032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77ce4e-13a7-4091-a8a8-af506ae4a203 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:29.895599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681f183-8c72-41b0-84bc-ca67e75c384b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:29.936150 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:29.966130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aacbe5-643a-486d-ad6d-f7ffdf505955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:29.967680 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aacbe5-643a-486d-ad6d-f7ffdf505955 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:29.967793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aacbe5-643a-486d-ad6d-f7ffdf505955 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:29.968082 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aacbe5-643a-486d-ad6d-f7ffdf505955 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:29.968726 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aacbe5-643a-486d-ad6d-f7ffdf505955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:29.969029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aacbe5-643a-486d-ad6d-f7ffdf505955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:29.970404 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aacbe5-643a-486d-ad6d-f7ffdf505955 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:29.995947 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 362/713] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:30.001134 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:30.002644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aacbe5-643a-486d-ad6d-f7ffdf505955 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:30.022309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77ce4e-13a7-4091-a8a8-af506ae4a203 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:30.062483 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13387a2-3488-4c95-b7dd-c87637e8607f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:30.063481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13387a2-3488-4c95-b7dd-c87637e8607f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:30.063963 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13387a2-3488-4c95-b7dd-c87637e8607f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:30.064491 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13387a2-3488-4c95-b7dd-c87637e8607f None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:30.065536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13387a2-3488-4c95-b7dd-c87637e8607f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:30.066142 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13387a2-3488-4c95-b7dd-c87637e8607f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:30.067842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13387a2-3488-4c95-b7dd-c87637e8607f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:30.081973 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 352/714] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:30.094044 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13387a2-3488-4c95-b7dd-c87637e8607f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:30.139889 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aacbe5-643a-486d-ad6d-f7ffdf505955 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:30.171308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979f623-032c-4556-a021-9401e3519b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:30.171923 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979f623-032c-4556-a021-9401e3519b48 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:30.172226 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979f623-032c-4556-a021-9401e3519b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:30.172493 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979f623-032c-4556-a021-9401e3519b48 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:30.173415 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979f623-032c-4556-a021-9401e3519b48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:30.174853 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979f623-032c-4556-a021-9401e3519b48 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:30.214451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 363/715] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Sep 9 20:43:30 2022] POST /identity/v3/users => generated 254 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:43:30.232239 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979f623-032c-4556-a021-9401e3519b48 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:30.294329 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13387a2-3488-4c95-b7dd-c87637e8607f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:30.332355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:30.381589 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886b65d-bb91-49ab-acc3-96896f006ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:30.382443 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886b65d-bb91-49ab-acc3-96896f006ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:30.384945 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886b65d-bb91-49ab-acc3-96896f006ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:30.385228 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886b65d-bb91-49ab-acc3-96896f006ed0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:30.385991 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886b65d-bb91-49ab-acc3-96896f006ed0 None admin] RBAC: Adding query filter params (role.id=be620fc7968740269d233c5ace94a563, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=dc210376e57a41e6b3812110db249099) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:30.386299 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886b65d-bb91-49ab-acc3-96896f006ed0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:30.388381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886b65d-bb91-49ab-acc3-96896f006ed0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:30.400905 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 353/716] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:43:30 2022] GET /identity/v3/role_assignments?user.id=dc210376e57a41e6b3812110db249099&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=be620fc7968740269d233c5ace94a563 => generated 259 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:30.412865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff5d33-8184-4d97-8e03-2eca43e0461b None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:30.413188 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff5d33-8184-4d97-8e03-2eca43e0461b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:30.413426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff5d33-8184-4d97-8e03-2eca43e0461b None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:30.415187 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 354/717] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:30.434024 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e1ffe-f332-4211-8902-da811a2f18f9 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:30.434218 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e1ffe-f332-4211-8902-da811a2f18f9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:30.434486 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e1ffe-f332-4211-8902-da811a2f18f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:30.444348 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:30.455816 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979f623-032c-4556-a021-9401e3519b48 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:30.459245 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5e4e1ffe-f332-4211-8902-da811a2f18f9 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:30.461823 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5e4e1ffe-f332-4211-8902-da811a2f18f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:30.532201 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc7b55-ff06-4e51-bb0b-5b2b54618fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:30.532862 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc7b55-ff06-4e51-bb0b-5b2b54618fbd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:30.533141 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc7b55-ff06-4e51-bb0b-5b2b54618fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:30.533415 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc7b55-ff06-4e51-bb0b-5b2b54618fbd None admin] PATH_INFO: `/v3/services/network` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:30.534122 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc7b55-ff06-4e51-bb0b-5b2b54618fbd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:30.535627 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc7b55-ff06-4e51-bb0b-5b2b54618fbd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:30.542865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 355/718] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:30.553852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-22cc7b55-ff06-4e51-bb0b-5b2b54618fbd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 20:43:30.553852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:30.553852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:43:30.553852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:43:30.553852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:43:30.553852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:43:30.553852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:43:30.553852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:30.553852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 20:43:30.553852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:30.553852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:43:30.553852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:30.553852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:30.553852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:30.553852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:30.553852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:30.553852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:30.555133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:30.555133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:30.555133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:30.555133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:30.555133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:30.555133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:30.555133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:43:30.555133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:43:30.555133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:43:30.555133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:43:30.555133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:30.555133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:30.555133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:30.555133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:30.555133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:30.555133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:30.555972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:30.555972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:30.555972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:30.555972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:30.555972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:30.555972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:30.555972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:30.555972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:30.555972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:30.555972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:30.555972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:43:30.555972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:30.555972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 20:43:30.555972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:30.557068 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 364/719] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:30 2022] GET /identity/v3/services/network => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:30.563687 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e1ffe-f332-4211-8902-da811a2f18f9 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:30.683830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e1ffe-f332-4211-8902-da811a2f18f9 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:30.726855 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390812e-a349-40c7-ac20-0503cfc0f132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:30.727877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390812e-a349-40c7-ac20-0503cfc0f132 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:30.728390 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390812e-a349-40c7-ac20-0503cfc0f132 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:30.728917 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390812e-a349-40c7-ac20-0503cfc0f132 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:30.729769 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390812e-a349-40c7-ac20-0503cfc0f132 None admin] RBAC: Adding query filter params (name=network) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:30.730272 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390812e-a349-40c7-ac20-0503cfc0f132 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:30.731901 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390812e-a349-40c7-ac20-0503cfc0f132 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:30.733965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:30.745087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 356/720] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Sep 9 20:43:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:30.756550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc7b55-ff06-4e51-bb0b-5b2b54618fbd None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:30.851309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390812e-a349-40c7-ac20-0503cfc0f132 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:30.877036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc7b55-ff06-4e51-bb0b-5b2b54618fbd None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:30.879613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:30.969262 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9490a-1b45-44ed-b51c-8fdefcd2d077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:30.969885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9490a-1b45-44ed-b51c-8fdefcd2d077 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:30.970149 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9490a-1b45-44ed-b51c-8fdefcd2d077 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:30.970399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9490a-1b45-44ed-b51c-8fdefcd2d077 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:30.976831 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9490a-1b45-44ed-b51c-8fdefcd2d077 None admin] RBAC: Adding query filter params (type=network) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:30.977206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9490a-1b45-44ed-b51c-8fdefcd2d077 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:30.978534 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9490a-1b45-44ed-b51c-8fdefcd2d077 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:30.986823 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 365/721] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Sep 9 20:43:30 2022] GET /identity/v3/services?type=network => generated 124 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:30.994516 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390812e-a349-40c7-ac20-0503cfc0f132 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:31.059702 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2898ea1-782a-4fbc-a8a0-87f1e14f90a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:31.060422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2898ea1-782a-4fbc-a8a0-87f1e14f90a4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:31.061269 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2898ea1-782a-4fbc-a8a0-87f1e14f90a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:31.061565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2898ea1-782a-4fbc-a8a0-87f1e14f90a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:31.097121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2898ea1-782a-4fbc-a8a0-87f1e14f90a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:31.102061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b2898ea1-782a-4fbc-a8a0-87f1e14f90a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:43:31.102061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:31.102061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:31.102061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:31.102061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:31.102061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:31.102061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:31.102061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:31.102061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:31.102061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:31.102061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:31.102061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:31.102061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:31.102061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:31.102061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:31.102061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:31.103011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:31.103011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:31.103011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:31.103011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:31.103011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:31.103011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:31.103011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:31.103011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:31.103011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:31.103011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:31.103011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:31.103011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:31.103011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:31.103011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:31.103011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:31.103011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:31.103834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:31.103834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:31.103834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:31.103834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:31.103834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:31.103834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:31.103834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:31.103834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:31.103834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:31.103834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:31.103834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:43:31.103834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:31.108150 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 357/722] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:43:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:31.113162 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9490a-1b45-44ed-b51c-8fdefcd2d077 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:31.255338 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9490a-1b45-44ed-b51c-8fdefcd2d077 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:31.295586 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc45b62-135f-49a5-9ba3-1cbdae54570e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:31.296225 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc45b62-135f-49a5-9ba3-1cbdae54570e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:31.296501 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc45b62-135f-49a5-9ba3-1cbdae54570e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:31.296770 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc45b62-135f-49a5-9ba3-1cbdae54570e None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:31.297487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc45b62-135f-49a5-9ba3-1cbdae54570e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:31.297797 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc45b62-135f-49a5-9ba3-1cbdae54570e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:31.299152 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc45b62-135f-49a5-9ba3-1cbdae54570e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:31.311144 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 366/723] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:43:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:31.316747 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2898ea1-782a-4fbc-a8a0-87f1e14f90a4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:31.406290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:31.459761 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2898ea1-782a-4fbc-a8a0-87f1e14f90a4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:31.502957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a894bf-ff3c-46d0-8819-936c3c6c75bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:31.503626 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a894bf-ff3c-46d0-8819-936c3c6c75bf None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:31.503907 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a894bf-ff3c-46d0-8819-936c3c6c75bf None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:31.504202 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a894bf-ff3c-46d0-8819-936c3c6c75bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:31.517376 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a894bf-ff3c-46d0-8819-936c3c6c75bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:31.518801 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a894bf-ff3c-46d0-8819-936c3c6c75bf None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:31.544259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-77a894bf-ff3c-46d0-8819-936c3c6c75bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:31.544259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:31.544259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:31.544259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:31.544259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:31.544259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:31.544259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:31.544259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:31.544259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:31.544259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:31.544259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:31.544259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:31.544259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:31.544259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:31.544259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:31.544259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:31.545886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:31.545886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:31.545886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:31.545886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:31.545886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:31.545886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:31.545886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:31.545886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:31.545886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:31.545886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:31.545886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:31.545886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:31.545886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:31.545886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:31.545886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:31.545886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:31.545886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:31.546768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:31.546768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:31.546768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:31.546768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 358/724] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:43:31.551936 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc45b62-135f-49a5-9ba3-1cbdae54570e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:31.599383 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:31.686481 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc45b62-135f-49a5-9ba3-1cbdae54570e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:31.729400 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b1319-1df4-43bc-b4d5-cc6b51b85e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:31.730013 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b1319-1df4-43bc-b4d5-cc6b51b85e95 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:31.730291 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b1319-1df4-43bc-b4d5-cc6b51b85e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:31.730563 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b1319-1df4-43bc-b4d5-cc6b51b85e95 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:31.731200 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b1319-1df4-43bc-b4d5-cc6b51b85e95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:31.731503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b1319-1df4-43bc-b4d5-cc6b51b85e95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:31.733155 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b1319-1df4-43bc-b4d5-cc6b51b85e95 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:31.749700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 367/725] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:31.754967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a894bf-ff3c-46d0-8819-936c3c6c75bf None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:31.868597 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a894bf-ff3c-46d0-8819-936c3c6c75bf None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:31.879946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:31.915153 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91614f4-33c1-4112-a027-a19aa3a826d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:31.915796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91614f4-33c1-4112-a027-a19aa3a826d0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:31.916100 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91614f4-33c1-4112-a027-a19aa3a826d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:31.916375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91614f4-33c1-4112-a027-a19aa3a826d0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:31.925551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91614f4-33c1-4112-a027-a19aa3a826d0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:31.927071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91614f4-33c1-4112-a027-a19aa3a826d0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:31.939404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-a91614f4-33c1-4112-a027-a19aa3a826d0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 20:43:31.939404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:31.939404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:31.939404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:31.939404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:31.939404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:31.939404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:31.939404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:31.939404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:31.939404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:31.939404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:31.939404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:31.939404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:31.939404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:31.939404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:31.939404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:31.940426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:31.940426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:31.940426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:31.940426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:31.940426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:31.940426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:31.940426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:31.940426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:31.940426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:31.940426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:31.940426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:31.940426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:31.940426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:31.940426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:31.940426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:31.940426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:31.940426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:31.940426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:31.941366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:31.941366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:31.941366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:31.941366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:31.941366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:31.941366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:31.941366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:31.941366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:31.941366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 20:43:31.941366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:31.941366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 359/726] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:43:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:31.949144 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b1319-1df4-43bc-b4d5-cc6b51b85e95 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:32.099145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:32.109273 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b1319-1df4-43bc-b4d5-cc6b51b85e95 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:32.160972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee3653-85cd-4ed6-b209-a90019cb5f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:32.161590 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee3653-85cd-4ed6-b209-a90019cb5f77 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:32.161875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee3653-85cd-4ed6-b209-a90019cb5f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:32.162153 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee3653-85cd-4ed6-b209-a90019cb5f77 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:32.162881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee3653-85cd-4ed6-b209-a90019cb5f77 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:32.163195 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee3653-85cd-4ed6-b209-a90019cb5f77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:32.164656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee3653-85cd-4ed6-b209-a90019cb5f77 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:32.193659 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 368/727] 10.222.0.15 () {56 vars in 1135 bytes} [Fri Sep 9 20:43:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:32.199289 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91614f4-33c1-4112-a027-a19aa3a826d0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:32.267671 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d9533-2709-441b-aebb-df0666aa5c03 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:32.268012 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d9533-2709-441b-aebb-df0666aa5c03 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:32.268254 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d9533-2709-441b-aebb-df0666aa5c03 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:32.269730 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 369/728] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:32.285229 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d9353-2018-4c8a-9871-1f331cd463fd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:32.285229 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d9353-2018-4c8a-9871-1f331cd463fd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:32.285474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d9353-2018-4c8a-9871-1f331cd463fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:32.339283 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-eb5d9353-2018-4c8a-9871-1f331cd463fd None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:32.340531 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-eb5d9353-2018-4c8a-9871-1f331cd463fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:32.354505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91614f4-33c1-4112-a027-a19aa3a826d0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:32.391802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830397ef-170d-4ea6-a97c-cc06fb1bf63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:32.392892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830397ef-170d-4ea6-a97c-cc06fb1bf63c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:32.393427 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830397ef-170d-4ea6-a97c-cc06fb1bf63c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:32.393906 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830397ef-170d-4ea6-a97c-cc06fb1bf63c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:32.448423 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:32.499113 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830397ef-170d-4ea6-a97c-cc06fb1bf63c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:32.500611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830397ef-170d-4ea6-a97c-cc06fb1bf63c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:32.514810 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 370/729] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:32.645624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 360/730] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:43:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 09 20:43:32.651338 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d9353-2018-4c8a-9871-1f331cd463fd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:32.745815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:32.772171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d9353-2018-4c8a-9871-1f331cd463fd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:32.818636 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830397ef-170d-4ea6-a97c-cc06fb1bf63c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:32.819715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df446f-717a-4f78-856b-eb64c7990a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:32.820392 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df446f-717a-4f78-856b-eb64c7990a85 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:32.820668 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df446f-717a-4f78-856b-eb64c7990a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:32.820934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df446f-717a-4f78-856b-eb64c7990a85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:32.832567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df446f-717a-4f78-856b-eb64c7990a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:32.834145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df446f-717a-4f78-856b-eb64c7990a85 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:32.855861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-20df446f-717a-4f78-856b-eb64c7990a85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:32.855861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:32.855861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:32.855861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:32.855861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:32.855861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:32.855861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:32.855861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:32.855861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:32.855861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:32.855861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:32.855861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:32.855861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:32.855861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:32.855861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:32.855861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:32.856878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:32.856878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:32.856878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:32.856878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:32.856878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:32.856878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:32.856878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:32.856878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:32.856878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:32.856878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:32.856878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:32.856878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:32.856878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:32.856878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:32.856878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:32.856878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:32.856878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:32.858509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:32.858509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:32.858509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:32.858509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 371/731] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:32.863330 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df446f-717a-4f78-856b-eb64c7990a85 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:32.897931 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:32.925568 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830397ef-170d-4ea6-a97c-cc06fb1bf63c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:32.963559 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812c571-a543-48e0-9a97-d45bfd3caba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:32.964211 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812c571-a543-48e0-9a97-d45bfd3caba4 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:32.964486 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812c571-a543-48e0-9a97-d45bfd3caba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:32.964961 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812c571-a543-48e0-9a97-d45bfd3caba4 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:32.965633 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812c571-a543-48e0-9a97-d45bfd3caba4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:32.967543 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812c571-a543-48e0-9a97-d45bfd3caba4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:32.998953 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 361/732] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Sep 9 20:43:32 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:43:33.048963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df446f-717a-4f78-856b-eb64c7990a85 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:33.093891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:33.121474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c0df6-8c2a-452a-bfb3-2ef858e8ceb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:33.122105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c0df6-8c2a-452a-bfb3-2ef858e8ceb2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:33.122358 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c0df6-8c2a-452a-bfb3-2ef858e8ceb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:33.122623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c0df6-8c2a-452a-bfb3-2ef858e8ceb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:33.124015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c0df6-8c2a-452a-bfb3-2ef858e8ceb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:33.125745 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e8142-33ba-4e7a-8533-b00eb92567e4 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:33.126023 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e8142-33ba-4e7a-8533-b00eb92567e4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:33.126290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e8142-33ba-4e7a-8533-b00eb92567e4 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:33.127820 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 362/733] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:33.128067 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c0df6-8c2a-452a-bfb3-2ef858e8ceb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:33.129480 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c0df6-8c2a-452a-bfb3-2ef858e8ceb2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:33.131342 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58605a4d-1c82-4c7a-908a-e9d48549ab89 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:33.131625 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58605a4d-1c82-4c7a-908a-e9d48549ab89 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:33.131968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58605a4d-1c82-4c7a-908a-e9d48549ab89 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:33.133356 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 363/734] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:33.134263 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba64f0-6200-49b5-b1bd-940018711a0a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:33.134540 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba64f0-6200-49b5-b1bd-940018711a0a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:33.134811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba64f0-6200-49b5-b1bd-940018711a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:33.151116 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 372/735] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:33.156598 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ea425-c7b6-443d-9f3a-f75d2d009e86 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:33.156901 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ea425-c7b6-443d-9f3a-f75d2d009e86 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:33.157157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ea425-c7b6-443d-9f3a-f75d2d009e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:33.159103 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9bba64f0-6200-49b5-b1bd-940018711a0a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:33.160695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9bba64f0-6200-49b5-b1bd-940018711a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:33.177179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-894ea425-c7b6-443d-9f3a-f75d2d009e86 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:33.178526 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-894ea425-c7b6-443d-9f3a-f75d2d009e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:33.239105 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 364/736] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:33.240413 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba64f0-6200-49b5-b1bd-940018711a0a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:33.255554 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 373/737] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:33.328391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:33.370883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba64f0-6200-49b5-b1bd-940018711a0a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:33.409726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7bd7b-cc22-4de4-bbdb-2c718e665a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:33.410368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7bd7b-cc22-4de4-bbdb-2c718e665a58 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:33.410646 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7bd7b-cc22-4de4-bbdb-2c718e665a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:33.410919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce7bd7b-cc22-4de4-bbdb-2c718e665a58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:33.417793 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7bd7b-cc22-4de4-bbdb-2c718e665a58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:33.419253 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce7bd7b-cc22-4de4-bbdb-2c718e665a58 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:33.432436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-dce7bd7b-cc22-4de4-bbdb-2c718e665a58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:33.432436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:33.432436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:33.432436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:33.432436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:33.432436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:33.432436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:33.432436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:33.432436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:33.432436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:33.432436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:33.432436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:33.432436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:33.432436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:33.432436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:33.433375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:33.433375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:33.433375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:33.433375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:33.433375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:33.433375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:33.433375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:33.433375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:33.433375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:33.433375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:33.433375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:33.433375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:33.433375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:33.433375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:33.433375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:33.433375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:33.433375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:33.434326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:33.434326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:33.434326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:33.434326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:33.434326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:33.434326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:33.434326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:33.434326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:33.434326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 365/738] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:33.439233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ea425-c7b6-443d-9f3a-f75d2d009e86 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:33.528999 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7bd7b-cc22-4de4-bbdb-2c718e665a58 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:33.561523 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ea425-c7b6-443d-9f3a-f75d2d009e86 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:33.586365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:33.606473 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabffd95-a293-413a-947d-4fcc59b9f515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:33.607211 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabffd95-a293-413a-947d-4fcc59b9f515 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:33.608202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabffd95-a293-413a-947d-4fcc59b9f515 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:33.608480 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabffd95-a293-413a-947d-4fcc59b9f515 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:33.609649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabffd95-a293-413a-947d-4fcc59b9f515 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:33.610071 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabffd95-a293-413a-947d-4fcc59b9f515 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:33.611862 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabffd95-a293-413a-947d-4fcc59b9f515 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:33.626012 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 374/739] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:33.627155 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabffd95-a293-413a-947d-4fcc59b9f515 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:33.661556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce7bd7b-cc22-4de4-bbdb-2c718e665a58 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:33.690248 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:33.708529 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf921a1c-958c-4844-94b0-e1d03991ad3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:33.709179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf921a1c-958c-4844-94b0-e1d03991ad3d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:33.709460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf921a1c-958c-4844-94b0-e1d03991ad3d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:33.709733 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf921a1c-958c-4844-94b0-e1d03991ad3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:33.726433 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf921a1c-958c-4844-94b0-e1d03991ad3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:33.731619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-cf921a1c-958c-4844-94b0-e1d03991ad3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:33.731619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:33.731619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:33.731619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:33.731619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:33.731619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:33.731619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:33.731619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:33.731619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:33.731619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:33.731619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:33.731619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:33.731619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:33.731619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:33.731619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:33.731619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:33.733193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:33.733193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:33.733193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:33.733193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:33.733193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:33.733193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:33.733193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:33.733193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:33.733193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:33.733193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:33.733193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:33.733193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:33.733193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:33.733193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:33.733193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:33.733193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:33.734032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:33.734032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:33.734032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:33.734032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:33.734032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:33.734032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:33.734032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:33.734032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:33.734032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:33.734032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:33.734032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:33.734032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:33.741157 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 366/740] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:43:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:43:33.741157 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf921a1c-958c-4844-94b0-e1d03991ad3d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:33.747351 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabffd95-a293-413a-947d-4fcc59b9f515 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:33.787531 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f371e-e221-4155-b104-b3675e66d37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:33.788111 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f371e-e221-4155-b104-b3675e66d37b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:33.788492 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f371e-e221-4155-b104-b3675e66d37b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:33.788741 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f371e-e221-4155-b104-b3675e66d37b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:33.800844 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f371e-e221-4155-b104-b3675e66d37b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:33.806434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-998f371e-e221-4155-b104-b3675e66d37b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:43:33.806434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:33.806434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:33.806434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:33.806434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:33.806434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:33.806434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:33.806434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:33.806434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:33.806434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:33.806434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:33.806434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:33.806434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:33.806434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:33.806434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:33.806434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:33.807355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:33.807355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:33.807355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:33.807355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:33.807355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:33.807355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:33.807355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:33.807355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:33.807355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:33.807355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:33.807355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:33.807355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:33.807355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:33.807355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:33.807355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:33.807355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:33.808215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:33.808215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:33.808215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:33.808215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:33.808215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:33.808215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:33.808215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:33.808215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:33.808215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:33.808215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:33.808215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:43:33.808215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:33.808215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 375/741] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:43:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:33.808916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ce090-a2a6-45df-a832-cae8005cba4f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:33.809485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ce090-a2a6-45df-a832-cae8005cba4f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:33.809485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ce090-a2a6-45df-a832-cae8005cba4f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:33.815474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 376/742] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:33.816206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ce090-a2a6-45df-a832-cae8005cba4f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:33.855375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf921a1c-958c-4844-94b0-e1d03991ad3d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:33.857111 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:33.892205 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e234a1c-3374-48d1-a351-ad482a42e079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:33.892819 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e234a1c-3374-48d1-a351-ad482a42e079 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:33.893103 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e234a1c-3374-48d1-a351-ad482a42e079 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:33.893376 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e234a1c-3374-48d1-a351-ad482a42e079 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:33.894091 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e234a1c-3374-48d1-a351-ad482a42e079 None admin] RBAC: Adding query filter params (role.id=be620fc7968740269d233c5ace94a563, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=9570eaa112de460cb9e371278bfb300b) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:33.894400 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e234a1c-3374-48d1-a351-ad482a42e079 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:33.895847 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e234a1c-3374-48d1-a351-ad482a42e079 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:33.912029 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 367/743] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:43:33 2022] GET /identity/v3/role_assignments?user.id=9570eaa112de460cb9e371278bfb300b&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=be620fc7968740269d233c5ace94a563 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:33.912029 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e234a1c-3374-48d1-a351-ad482a42e079 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:33.944262 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ce090-a2a6-45df-a832-cae8005cba4f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:33.971690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:33.988475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f434220-a54a-41fb-912b-e3eef684fcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:33.989115 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f434220-a54a-41fb-912b-e3eef684fcc6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:33.989775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f434220-a54a-41fb-912b-e3eef684fcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:33.990053 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f434220-a54a-41fb-912b-e3eef684fcc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:33.991025 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f434220-a54a-41fb-912b-e3eef684fcc6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:33.991332 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f434220-a54a-41fb-912b-e3eef684fcc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:33.992776 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f434220-a54a-41fb-912b-e3eef684fcc6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:34.003650 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 377/744] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Sep 9 20:43:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:34.004884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e10077-a3c7-44f2-9fb3-eefea1ddf348 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:34.005176 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e10077-a3c7-44f2-9fb3-eefea1ddf348 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:34.005453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e10077-a3c7-44f2-9fb3-eefea1ddf348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:34.026096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-15e10077-a3c7-44f2-9fb3-eefea1ddf348 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:34.027355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-15e10077-a3c7-44f2-9fb3-eefea1ddf348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:34.041841 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e234a1c-3374-48d1-a351-ad482a42e079 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:34.085509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77947073-1a94-4f17-b861-ce96e0e7b0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:34.086509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77947073-1a94-4f17-b861-ce96e0e7b0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:34.086999 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77947073-1a94-4f17-b861-ce96e0e7b0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:34.087506 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77947073-1a94-4f17-b861-ce96e0e7b0e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:34.088610 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77947073-1a94-4f17-b861-ce96e0e7b0e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:34.089211 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77947073-1a94-4f17-b861-ce96e0e7b0e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:34.090870 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77947073-1a94-4f17-b861-ce96e0e7b0e1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:34.102603 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 368/745] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:43:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:34.103801 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77947073-1a94-4f17-b861-ce96e0e7b0e1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:34.112015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 378/746] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 09 20:43:34.112015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e10077-a3c7-44f2-9fb3-eefea1ddf348 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:34.141878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:34.220288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77947073-1a94-4f17-b861-ce96e0e7b0e1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:34.223659 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e10077-a3c7-44f2-9fb3-eefea1ddf348 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:34.228380 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:34.259552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c2224-9a54-4a19-ab49-702f3173e0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:34.260548 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c2224-9a54-4a19-ab49-702f3173e0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:34.260841 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c2224-9a54-4a19-ab49-702f3173e0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:34.261253 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c2224-9a54-4a19-ab49-702f3173e0b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:34.273011 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c2224-9a54-4a19-ab49-702f3173e0b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:34.274539 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c2224-9a54-4a19-ab49-702f3173e0b0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:34.292024 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bc636-a68d-48be-b646-3823e8c48f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:34.292024 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bc636-a68d-48be-b646-3823e8c48f51 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:34.292024 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bc636-a68d-48be-b646-3823e8c48f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:34.292024 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bc636-a68d-48be-b646-3823e8c48f51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:34.292420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-5c7c2224-9a54-4a19-ab49-702f3173e0b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:34.292420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:34.292420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:34.292420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:34.292420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:34.292420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:34.292420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:34.292420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:34.292420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:34.292420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:34.292420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:34.292420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:34.292420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:34.292420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:34.292420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:34.292420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:34.293257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:34.293257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:34.293257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:34.293257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:34.293257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:34.293257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:34.293257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:34.293257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:34.293257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:34.293257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:34.293257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:34.293257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:34.293257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:34.293257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:34.293257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:34.293257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:34.293257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:34.294227 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:34.294227 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:34.294227 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:34.295552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 379/747] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:34.311398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bc636-a68d-48be-b646-3823e8c48f51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:34.311628 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c2224-9a54-4a19-ab49-702f3173e0b0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:34.313000 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bc636-a68d-48be-b646-3823e8c48f51 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:34.335967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-d95bc636-a68d-48be-b646-3823e8c48f51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:34.335967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:34.335967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:34.335967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:34.335967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:34.335967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:34.335967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:34.335967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:34.335967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:34.335967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:34.335967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:34.335967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:34.335967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:34.335967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:34.335967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:34.335967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:34.336967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:34.336967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:34.336967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:34.336967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:34.336967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:34.336967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:34.336967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:34.336967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:34.336967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:34.336967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:34.336967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:34.336967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:34.336967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:34.336967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:34.336967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:34.336967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:34.336967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:34.337860 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:34.337860 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:34.337860 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:34.344136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 369/748] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:34.349329 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bc636-a68d-48be-b646-3823e8c48f51 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:34.465867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:34.483247 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c2224-9a54-4a19-ab49-702f3173e0b0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:34.520470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11cdd1-d8aa-43d4-8ead-9dc8f49f0894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:34.520859 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bc636-a68d-48be-b646-3823e8c48f51 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:34.521080 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11cdd1-d8aa-43d4-8ead-9dc8f49f0894 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:34.521408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11cdd1-d8aa-43d4-8ead-9dc8f49f0894 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:34.521683 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11cdd1-d8aa-43d4-8ead-9dc8f49f0894 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:34.522323 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11cdd1-d8aa-43d4-8ead-9dc8f49f0894 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:34.522623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11cdd1-d8aa-43d4-8ead-9dc8f49f0894 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:34.523979 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11cdd1-d8aa-43d4-8ead-9dc8f49f0894 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:34.537690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 380/749] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:34.538346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11cdd1-d8aa-43d4-8ead-9dc8f49f0894 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:34.556946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b8090-2a0c-4ef0-a5ba-5b221da5a64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:34.557579 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b8090-2a0c-4ef0-a5ba-5b221da5a64c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:34.557864 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b8090-2a0c-4ef0-a5ba-5b221da5a64c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:34.558231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b8090-2a0c-4ef0-a5ba-5b221da5a64c None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:34.558874 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b8090-2a0c-4ef0-a5ba-5b221da5a64c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:34.559179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b8090-2a0c-4ef0-a5ba-5b221da5a64c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:34.561279 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b8090-2a0c-4ef0-a5ba-5b221da5a64c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:34.578777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 370/750] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:34.579684 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b8090-2a0c-4ef0-a5ba-5b221da5a64c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:34.611572 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:34.641951 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11cdd1-d8aa-43d4-8ead-9dc8f49f0894 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:34.678800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4254c-6281-4564-9b49-6fe1b3e4b647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:34.679467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4254c-6281-4564-9b49-6fe1b3e4b647 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:34.679749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4254c-6281-4564-9b49-6fe1b3e4b647 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:34.680044 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d4254c-6281-4564-9b49-6fe1b3e4b647 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:34.680696 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4254c-6281-4564-9b49-6fe1b3e4b647 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:34.682164 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d4254c-6281-4564-9b49-6fe1b3e4b647 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:34.695342 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b8090-2a0c-4ef0-a5ba-5b221da5a64c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:34.695843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:34.708948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 381/751] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Sep 9 20:43:34 2022] POST /identity/v3/services => generated 240 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:43:34.709920 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4254c-6281-4564-9b49-6fe1b3e4b647 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:34.783323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179fe3d-3655-48b9-bcec-89db0255b132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:34.785319 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179fe3d-3655-48b9-bcec-89db0255b132 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:34.786861 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179fe3d-3655-48b9-bcec-89db0255b132 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:34.788049 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179fe3d-3655-48b9-bcec-89db0255b132 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:34.804247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179fe3d-3655-48b9-bcec-89db0255b132 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:34.807882 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179fe3d-3655-48b9-bcec-89db0255b132 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:34.833809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6179fe3d-3655-48b9-bcec-89db0255b132 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 20:43:34.833809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:34.833809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:34.833809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:34.833809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:34.833809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:34.833809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:34.833809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:34.833809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:34.833809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:34.833809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:34.833809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:34.833809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:34.833809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:34.833809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:34.833809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:34.834821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:34.834821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:34.834821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:34.834821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:34.834821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:34.834821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:34.834821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:34.834821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:34.834821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:34.834821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:34.834821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:34.834821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:34.834821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:34.834821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:34.834821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:34.834821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:34.834821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:34.834821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:34.835780 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:34.835780 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:34.835780 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:34.835780 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:34.835780 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:34.835780 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:34.835780 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:34.835780 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:34.835780 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 20:43:34.835780 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:34.838815 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 371/752] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Sep 9 20:43:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:34.845031 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179fe3d-3655-48b9-bcec-89db0255b132 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:34.924779 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d4254c-6281-4564-9b49-6fe1b3e4b647 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:34.980147 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:34.982835 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c712e9-878a-419e-9d04-66d5121cc719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:34.983782 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c712e9-878a-419e-9d04-66d5121cc719 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:34.984107 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c712e9-878a-419e-9d04-66d5121cc719 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:34.984382 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c712e9-878a-419e-9d04-66d5121cc719 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:34.997077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c712e9-878a-419e-9d04-66d5121cc719 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:34.999362 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c712e9-878a-419e-9d04-66d5121cc719 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:35.014234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-75c712e9-878a-419e-9d04-66d5121cc719 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 20:43:35.014234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:35.014234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:35.014234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:35.014234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:35.014234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:35.014234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:35.014234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:35.014234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:35.014234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:35.014234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:35.014234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:35.014234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:35.014234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:35.014234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:35.014234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:35.015318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:35.015318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:35.015318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:35.015318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:35.015318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:35.015318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:35.015318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:35.015318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:35.015318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:35.015318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:35.015318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:35.015318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:35.015318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:35.015318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:35.015318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:35.015318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:35.015318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:35.015318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:35.016295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:35.016295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:35.016295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:35.016295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:35.016295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:35.016295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:35.016295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:35.016295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:35.016295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 20:43:35.016295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:35.020084 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 382/753] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Sep 9 20:43:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:35.022678 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c712e9-878a-419e-9d04-66d5121cc719 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:35.024756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179fe3d-3655-48b9-bcec-89db0255b132 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:35.065045 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a18d7-ddae-4ccd-80ca-a53a4825560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:35.065945 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a18d7-ddae-4ccd-80ca-a53a4825560f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:35.066481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a18d7-ddae-4ccd-80ca-a53a4825560f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:35.066934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a18d7-ddae-4ccd-80ca-a53a4825560f None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:35.068000 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a18d7-ddae-4ccd-80ca-a53a4825560f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:35.068496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a18d7-ddae-4ccd-80ca-a53a4825560f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:35.070252 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a18d7-ddae-4ccd-80ca-a53a4825560f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:35.089013 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:35.095197 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 372/754] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Sep 9 20:43:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:35.100395 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a18d7-ddae-4ccd-80ca-a53a4825560f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:35.139687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c712e9-878a-419e-9d04-66d5121cc719 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:35.179640 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc55ce-7c2f-4c05-8f2e-61f444a6b5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:35.180329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc55ce-7c2f-4c05-8f2e-61f444a6b5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:35.180540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc55ce-7c2f-4c05-8f2e-61f444a6b5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:35.180815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc55ce-7c2f-4c05-8f2e-61f444a6b5c2 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:35.181536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc55ce-7c2f-4c05-8f2e-61f444a6b5c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:35.181843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc55ce-7c2f-4c05-8f2e-61f444a6b5c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:35.183667 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc55ce-7c2f-4c05-8f2e-61f444a6b5c2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:35.212082 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 383/755] 10.222.0.15 () {56 vars in 1149 bytes} [Fri Sep 9 20:43:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:35.213972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc55ce-7c2f-4c05-8f2e-61f444a6b5c2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:35.220530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a18d7-ddae-4ccd-80ca-a53a4825560f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:35.254448 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:35.260562 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bedbdb-5391-4f8d-814a-46e92274855c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:35.261308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bedbdb-5391-4f8d-814a-46e92274855c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:35.261595 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bedbdb-5391-4f8d-814a-46e92274855c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:35.261864 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bedbdb-5391-4f8d-814a-46e92274855c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:35.273347 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bedbdb-5391-4f8d-814a-46e92274855c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:35.274930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bedbdb-5391-4f8d-814a-46e92274855c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:35.292387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-f9bedbdb-5391-4f8d-814a-46e92274855c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:35.292387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:35.292387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:35.292387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:35.292387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:35.292387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:35.292387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:35.292387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:35.292387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:35.292387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:35.292387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:35.292387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:35.292387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:35.292387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:35.292387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:35.292387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:35.293460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:35.293460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:35.293460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:35.293460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:35.293460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:35.293460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:35.293460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:35.293460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:35.293460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:35.293460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:35.293460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:35.293460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:35.293460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:35.293460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:35.293460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:35.293460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:35.293460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:35.295493 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:35.295493 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:35.295493 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:35.295493 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 373/756] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:35.300305 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bedbdb-5391-4f8d-814a-46e92274855c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:35.351587 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc55ce-7c2f-4c05-8f2e-61f444a6b5c2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:35.372788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:35.393213 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd40d4-56eb-4fe2-85de-4c6107872937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:35.394166 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd40d4-56eb-4fe2-85de-4c6107872937 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:35.394670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd40d4-56eb-4fe2-85de-4c6107872937 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:35.395151 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd40d4-56eb-4fe2-85de-4c6107872937 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:35.482202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd40d4-56eb-4fe2-85de-4c6107872937 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:35.485308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd40d4-56eb-4fe2-85de-4c6107872937 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:35.494086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bedbdb-5391-4f8d-814a-46e92274855c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:35.540699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e934176-2159-4ab2-8435-7ad859084269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:35.541323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e934176-2159-4ab2-8435-7ad859084269 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:35.541605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e934176-2159-4ab2-8435-7ad859084269 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:35.541877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e934176-2159-4ab2-8435-7ad859084269 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:35.542557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e934176-2159-4ab2-8435-7ad859084269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:35.542821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e934176-2159-4ab2-8435-7ad859084269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:35.544315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e934176-2159-4ab2-8435-7ad859084269 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:35.567383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 374/757] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:35.577533 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e934176-2159-4ab2-8435-7ad859084269 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:35.610898 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 384/758] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:43:35 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 20:43:35.613822 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd40d4-56eb-4fe2-85de-4c6107872937 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:35.636996 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:35.674832 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:35.733438 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd40d4-56eb-4fe2-85de-4c6107872937 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:35.771727 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08ac77-9ab6-4e80-a7e4-b6aea651125e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:35.772756 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08ac77-9ab6-4e80-a7e4-b6aea651125e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:35.773512 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08ac77-9ab6-4e80-a7e4-b6aea651125e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:35.774003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08ac77-9ab6-4e80-a7e4-b6aea651125e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:35.786012 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08ac77-9ab6-4e80-a7e4-b6aea651125e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:35.787914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08ac77-9ab6-4e80-a7e4-b6aea651125e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:35.806030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-6a08ac77-9ab6-4e80-a7e4-b6aea651125e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:35.806030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:35.806030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:35.806030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:35.806030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:35.806030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:35.806030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:35.806030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:35.806030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:35.806030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:35.806030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:35.806030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:35.806030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:35.806030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:35.806030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:35.806030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:35.807036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:35.807036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:35.807036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:35.807036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:35.807036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:35.807036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:35.807036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:35.807036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:35.807036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:35.807036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:35.807036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:35.807036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:35.807036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:35.807036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:35.807036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:35.807036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:35.807036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:35.807916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:35.807916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:35.807916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:35.813282 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 385/759] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:35.813282 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae768a-55b2-4685-b376-a2ff7ff216d0 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:35.813282 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae768a-55b2-4685-b376-a2ff7ff216d0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:35.813282 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae768a-55b2-4685-b376-a2ff7ff216d0 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:35.816088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 386/760] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:35.817220 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae768a-55b2-4685-b376-a2ff7ff216d0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:35.819141 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e934176-2159-4ab2-8435-7ad859084269 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:35.862984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfadcf-8568-4e08-9814-023577e21ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:35.863604 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfadcf-8568-4e08-9814-023577e21ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:35.863887 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfadcf-8568-4e08-9814-023577e21ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:35.864203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfadcf-8568-4e08-9814-023577e21ed7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:35.874042 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfadcf-8568-4e08-9814-023577e21ed7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:35.875681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfadcf-8568-4e08-9814-023577e21ed7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:35.891705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-1cdfadcf-8568-4e08-9814-023577e21ed7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:35.891705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:35.891705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:35.891705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:35.891705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:35.891705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:35.891705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:35.891705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:35.891705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:35.891705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:35.891705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:35.891705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:35.891705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:35.891705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:35.891705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:35.892653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:35.892653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:35.892653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:35.892653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:35.892653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:35.892653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:35.892653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:35.892653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:35.892653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:35.892653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:35.892653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:35.892653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:35.892653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:35.892653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:35.892653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:35.892653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:35.892653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:35.894199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:35.894199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:35.894199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:35.894199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:35.894199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:35.894199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:35.894199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:35.894199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:35.894199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 375/761] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:35.894676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9580144-d17e-4804-bf64-8aa0fad073af None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:35.894676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9580144-d17e-4804-bf64-8aa0fad073af None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:35.894971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9580144-d17e-4804-bf64-8aa0fad073af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:35.909632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:35.918235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c9580144-d17e-4804-bf64-8aa0fad073af None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:35.919437 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c9580144-d17e-4804-bf64-8aa0fad073af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:35.941411 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae768a-55b2-4685-b376-a2ff7ff216d0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:35.982181 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbd53d-56de-468b-b02a-91bbc84c0592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:35.984104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbd53d-56de-468b-b02a-91bbc84c0592 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:35.984733 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbd53d-56de-468b-b02a-91bbc84c0592 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:35.985025 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbd53d-56de-468b-b02a-91bbc84c0592 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:35.985785 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddbd53d-56de-468b-b02a-91bbc84c0592 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:35.986102 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddbd53d-56de-468b-b02a-91bbc84c0592 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:35.987625 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddbd53d-56de-468b-b02a-91bbc84c0592 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:35.994617 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 376/762] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:43:35.995808 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9580144-d17e-4804-bf64-8aa0fad073af None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:36.011373 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 387/763] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:36.018347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbd53d-56de-468b-b02a-91bbc84c0592 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:36.054361 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:36.165568 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9580144-d17e-4804-bf64-8aa0fad073af None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:36.228389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbd53d-56de-468b-b02a-91bbc84c0592 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:36.241548 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce7180-293b-4a93-b676-6f5130268363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:36.242282 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce7180-293b-4a93-b676-6f5130268363 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:36.242567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce7180-293b-4a93-b676-6f5130268363 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:36.242847 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce7180-293b-4a93-b676-6f5130268363 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:36.243593 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce7180-293b-4a93-b676-6f5130268363 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:36.244019 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce7180-293b-4a93-b676-6f5130268363 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:36.245489 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce7180-293b-4a93-b676-6f5130268363 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:36.271733 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 377/764] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:36.277593 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce7180-293b-4a93-b676-6f5130268363 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:36.291728 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:36.301115 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb3d1f-42b2-45ac-8fb0-ace3fb48a816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:36.301765 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb3d1f-42b2-45ac-8fb0-ace3fb48a816 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:36.302041 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb3d1f-42b2-45ac-8fb0-ace3fb48a816 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:36.302313 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb3d1f-42b2-45ac-8fb0-ace3fb48a816 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:36.322097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb3d1f-42b2-45ac-8fb0-ace3fb48a816 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:36.323579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb3d1f-42b2-45ac-8fb0-ace3fb48a816 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:36.342461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f8fb3d1f-42b2-45ac-8fb0-ace3fb48a816 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:36.342461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:36.342461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:36.342461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:36.342461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:36.342461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:36.342461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:36.342461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:36.342461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:36.342461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:36.342461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:36.342461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:36.342461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:36.342461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:36.342461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:36.343409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:36.343409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:36.343409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:36.343409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:36.343409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:36.343409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:36.343409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:36.343409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:36.343409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:36.343409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:36.343409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:36.343409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:36.343409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:36.343409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:36.343409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:36.343409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:36.343409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:36.344292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:36.344292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:36.344292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:36.344292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:36.344292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:36.344292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:36.344292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:36.344292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:36.344292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 388/765] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:36.345150 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb3d1f-42b2-45ac-8fb0-ace3fb48a816 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:36.432888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:36.440698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce7180-293b-4a93-b676-6f5130268363 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:36.471634 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb3d1f-42b2-45ac-8fb0-ace3fb48a816 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:36.477247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b2659-0627-41bf-a048-feb461bbf9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:36.478018 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b2659-0627-41bf-a048-feb461bbf9f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:36.478366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b2659-0627-41bf-a048-feb461bbf9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:36.478703 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b2659-0627-41bf-a048-feb461bbf9f0 None admin] PATH_INFO: `/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/dc210376e57a41e6b3812110db249099/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:36.480726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b2659-0627-41bf-a048-feb461bbf9f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=a57df41195d240fe8f28ac49bfd37921, user_id=dc210376e57a41e6b3812110db249099, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:36.482334 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7b2659-0627-41bf-a048-feb461bbf9f0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:36.499236 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 378/766] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:43:36 2022] PUT /identity/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/dc210376e57a41e6b3812110db249099/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:43:36.500854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b2659-0627-41bf-a048-feb461bbf9f0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:36.511032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c06b1-f32f-4c3c-b5dc-4ad53e56ab39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:36.511681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c06b1-f32f-4c3c-b5dc-4ad53e56ab39 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:36.511957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c06b1-f32f-4c3c-b5dc-4ad53e56ab39 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:36.512259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c06b1-f32f-4c3c-b5dc-4ad53e56ab39 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:36.512863 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c06b1-f32f-4c3c-b5dc-4ad53e56ab39 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:36.514398 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c06b1-f32f-4c3c-b5dc-4ad53e56ab39 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:36.524661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-de9c06b1-f32f-4c3c-b5dc-4ad53e56ab39 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 20:43:36.524661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:36.524661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:43:36.524661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:43:36.524661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:43:36.524661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:43:36.524661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:43:36.524661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:36.524661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 20:43:36.524661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:36.524661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:43:36.524661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:36.524661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:36.524661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:36.524661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:36.524661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:36.524661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:36.525982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:36.525982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:36.525982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:36.525982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:36.525982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:36.525982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:36.525982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:43:36.525982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:43:36.525982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:43:36.525982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:43:36.525982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:36.525982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:36.525982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:36.525982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:36.525982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:36.525982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:36.526793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:36.526793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:36.526793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:36.526793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:36.526793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:36.526793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:36.526793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:36.526793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:36.526793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:36.526793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:36.526793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:43:36.526793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:36.526793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 20:43:36.526793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:36.532031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 389/767] 10.222.0.15 () {56 vars in 1129 bytes} [Fri Sep 9 20:43:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:36.533506 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d71a37-dd73-4d97-a675-5d0f5359588a None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:36.533793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d71a37-dd73-4d97-a675-5d0f5359588a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:36.534074 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d71a37-dd73-4d97-a675-5d0f5359588a None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:36.535803 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 390/768] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:36.536635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d71a37-dd73-4d97-a675-5d0f5359588a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:36.617081 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:36.651005 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7b2659-0627-41bf-a048-feb461bbf9f0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:36.677669 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d71a37-dd73-4d97-a675-5d0f5359588a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:36.704361 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e922002-cbc5-48b5-83a5-05f00483901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:36.705251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e922002-cbc5-48b5-83a5-05f00483901a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:36.705251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e922002-cbc5-48b5-83a5-05f00483901a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:36.705438 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e922002-cbc5-48b5-83a5-05f00483901a None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:36.706116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e922002-cbc5-48b5-83a5-05f00483901a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:36.707145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e922002-cbc5-48b5-83a5-05f00483901a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:36.707864 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e922002-cbc5-48b5-83a5-05f00483901a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:36.722656 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 379/769] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:36.723907 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058464b1-af5c-4149-a8ac-4ad3f2841f4c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:36.724247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058464b1-af5c-4149-a8ac-4ad3f2841f4c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:36.724518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058464b1-af5c-4149-a8ac-4ad3f2841f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:36.727359 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae4bed-298e-4b76-a8b1-34cb4f53cec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:36.728052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae4bed-298e-4b76-a8b1-34cb4f53cec1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:36.728342 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae4bed-298e-4b76-a8b1-34cb4f53cec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:36.729134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae4bed-298e-4b76-a8b1-34cb4f53cec1 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:36.729303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae4bed-298e-4b76-a8b1-34cb4f53cec1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:36.729565 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae4bed-298e-4b76-a8b1-34cb4f53cec1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:36.730939 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae4bed-298e-4b76-a8b1-34cb4f53cec1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:36.737008 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 391/770] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Sep 9 20:43:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:36.737823 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae4bed-298e-4b76-a8b1-34cb4f53cec1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:36.753855 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-058464b1-af5c-4149-a8ac-4ad3f2841f4c None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:36.755368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-058464b1-af5c-4149-a8ac-4ad3f2841f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:36.768781 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:36.847404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 380/771] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:43:36.848438 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058464b1-af5c-4149-a8ac-4ad3f2841f4c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:36.863252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae4bed-298e-4b76-a8b1-34cb4f53cec1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:36.883293 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:36.904205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa27d6-bb3b-4fcf-bfc5-ad5794f78164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:36.905761 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa27d6-bb3b-4fcf-bfc5-ad5794f78164 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:36.906245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa27d6-bb3b-4fcf-bfc5-ad5794f78164 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:36.907304 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa27d6-bb3b-4fcf-bfc5-ad5794f78164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:36.908615 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa27d6-bb3b-4fcf-bfc5-ad5794f78164 None admin] RBAC: Adding query filter params (role.id=e3de94d5ee924ea4b638d196d282af55, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=e51ae6959aac49898e75c6786c5dbdf2) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:36.909188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa27d6-bb3b-4fcf-bfc5-ad5794f78164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:36.911051 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa27d6-bb3b-4fcf-bfc5-ad5794f78164 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:36.918563 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 392/772] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:43:36 2022] GET /identity/v3/role_assignments?user.id=e51ae6959aac49898e75c6786c5dbdf2&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=e3de94d5ee924ea4b638d196d282af55 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:36.977582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058464b1-af5c-4149-a8ac-4ad3f2841f4c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:37.038087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d5447-7c74-4410-abed-73cb1682e996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:37.038750 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d5447-7c74-4410-abed-73cb1682e996 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:37.039035 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d5447-7c74-4410-abed-73cb1682e996 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:37.039311 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d5447-7c74-4410-abed-73cb1682e996 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:37.039970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d5447-7c74-4410-abed-73cb1682e996 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:37.040310 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d5447-7c74-4410-abed-73cb1682e996 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:37.041723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d5447-7c74-4410-abed-73cb1682e996 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:37.050997 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 381/773] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Sep 9 20:43:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:37.056939 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa27d6-bb3b-4fcf-bfc5-ad5794f78164 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:37.171478 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa27d6-bb3b-4fcf-bfc5-ad5794f78164 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:37.207677 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4febd-c5cc-482f-92a6-042ea6849b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:37.208602 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4febd-c5cc-482f-92a6-042ea6849b7f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:37.209031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4febd-c5cc-482f-92a6-042ea6849b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:37.209455 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4febd-c5cc-482f-92a6-042ea6849b7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:37.210298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4febd-c5cc-482f-92a6-042ea6849b7f None admin] RBAC: Adding query filter params (interface=public, service_id=b530f2de26114797baf9164e9019fdce, region_id=RegionOne) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:37.210754 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4febd-c5cc-482f-92a6-042ea6849b7f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:37.212307 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4febd-c5cc-482f-92a6-042ea6849b7f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:37.221295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 393/774] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Sep 9 20:43:37 2022] GET /identity/v3/endpoints?service_id=b530f2de26114797baf9164e9019fdce&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:37.227104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d5447-7c74-4410-abed-73cb1682e996 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:37.240036 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:37.248452 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4febd-c5cc-482f-92a6-042ea6849b7f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:37.324391 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:37.368593 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4febd-c5cc-482f-92a6-042ea6849b7f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:37.408471 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a912f-38ed-4d8f-a2e1-17413796fb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:37.410117 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a912f-38ed-4d8f-a2e1-17413796fb08 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:37.410619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a912f-38ed-4d8f-a2e1-17413796fb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:37.411116 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a912f-38ed-4d8f-a2e1-17413796fb08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:37.423221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a912f-38ed-4d8f-a2e1-17413796fb08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:37.430024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-495a912f-38ed-4d8f-a2e1-17413796fb08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:43:37.430024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:37.430024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:37.430024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:37.430024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:37.430024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:37.430024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:37.430024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:37.430024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:37.430024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:37.430024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:37.430024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:37.430024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:37.430024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:37.430024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:37.430024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:37.430988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:37.430988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:37.430988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:37.430988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:37.430988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:37.430988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:37.430988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:37.430988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:37.430988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:37.430988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:37.430988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:37.430988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:37.430988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:37.430988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:37.430988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:37.430988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:37.431845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:37.431845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:37.431845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:37.431845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:37.431845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:37.431845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:37.431845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:37.431845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:37.431845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:37.431845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:37.431845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:43:37.431845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:37.434568 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 394/775] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:43:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:43:37.444998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a912f-38ed-4d8f-a2e1-17413796fb08 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:37.474073 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d5447-7c74-4410-abed-73cb1682e996 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:37.510338 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae2c7f-c966-4967-ae84-670e329600d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:37.510970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae2c7f-c966-4967-ae84-670e329600d9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:37.511251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae2c7f-c966-4967-ae84-670e329600d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:37.511615 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae2c7f-c966-4967-ae84-670e329600d9 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:37.512260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae2c7f-c966-4967-ae84-670e329600d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:37.514160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae2c7f-c966-4967-ae84-670e329600d9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:37.521622 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 382/776] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Sep 9 20:43:37 2022] GET /identity/v3/services => generated 772 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:37.522904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b7448-cd4f-464d-96f4-be1895cd0c59 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:37.523286 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b7448-cd4f-464d-96f4-be1895cd0c59 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:37.523563 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b7448-cd4f-464d-96f4-be1895cd0c59 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:37.530412 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 383/777] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:37.531973 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732db0a-22a5-4305-9d3f-c38ee75cd00a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:37.532280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732db0a-22a5-4305-9d3f-c38ee75cd00a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:37.532551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732db0a-22a5-4305-9d3f-c38ee75cd00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:37.561685 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b732db0a-22a5-4305-9d3f-c38ee75cd00a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:37.563294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b732db0a-22a5-4305-9d3f-c38ee75cd00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:37.571853 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a912f-38ed-4d8f-a2e1-17413796fb08 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:37.584413 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:37.627568 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1974ba-ab94-4c54-aba5-c5b6e8d08b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:37.628242 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1974ba-ab94-4c54-aba5-c5b6e8d08b6f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:37.628524 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1974ba-ab94-4c54-aba5-c5b6e8d08b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:37.628798 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1974ba-ab94-4c54-aba5-c5b6e8d08b6f None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:37.629485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1974ba-ab94-4c54-aba5-c5b6e8d08b6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:37.629790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1974ba-ab94-4c54-aba5-c5b6e8d08b6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:37.631180 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1974ba-ab94-4c54-aba5-c5b6e8d08b6f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:37.652367 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 395/778] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:43:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:37.658327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1974ba-ab94-4c54-aba5-c5b6e8d08b6f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:37.710829 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 384/779] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:43:37.801702 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1974ba-ab94-4c54-aba5-c5b6e8d08b6f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:37.837466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ebc9f-d48d-4809-ba5a-cda68c55282e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:37.838454 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ebc9f-d48d-4809-ba5a-cda68c55282e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:37.838936 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ebc9f-d48d-4809-ba5a-cda68c55282e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:37.839415 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ebc9f-d48d-4809-ba5a-cda68c55282e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:37.851186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ebc9f-d48d-4809-ba5a-cda68c55282e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:37.852904 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ebc9f-d48d-4809-ba5a-cda68c55282e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:37.869287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-024ebc9f-d48d-4809-ba5a-cda68c55282e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:37.869287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:37.869287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:37.869287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:37.869287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:37.869287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:37.869287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:37.869287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:37.869287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:37.869287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:37.869287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:37.869287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:37.869287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:37.869287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:37.869287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:37.869287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:37.870276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:37.870276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:37.870276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:37.870276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:37.870276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:37.870276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:37.870276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:37.870276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:37.870276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:37.870276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:37.870276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:37.870276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:37.870276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:37.870276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:37.870276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:37.870276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:37.870276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:37.871151 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:37.871151 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:37.871151 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:37.873708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 396/780] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:43:37.879000 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732db0a-22a5-4305-9d3f-c38ee75cd00a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:37.883067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:38.002184 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732db0a-22a5-4305-9d3f-c38ee75cd00a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:38.003212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ebc9f-d48d-4809-ba5a-cda68c55282e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:38.044371 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:38.069892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3846cd-5c4c-48ef-a989-e4fe2c3a67e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:38.070432 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3846cd-5c4c-48ef-a989-e4fe2c3a67e2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:38.070709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3846cd-5c4c-48ef-a989-e4fe2c3a67e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:38.070982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3846cd-5c4c-48ef-a989-e4fe2c3a67e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:38.071624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3846cd-5c4c-48ef-a989-e4fe2c3a67e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:38.071923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3846cd-5c4c-48ef-a989-e4fe2c3a67e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:38.073317 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3846cd-5c4c-48ef-a989-e4fe2c3a67e2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:38.099698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 385/781] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:38.108229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3846cd-5c4c-48ef-a989-e4fe2c3a67e2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:38.193078 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:38.199863 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ebc9f-d48d-4809-ba5a-cda68c55282e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:38.253396 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3846cd-5c4c-48ef-a989-e4fe2c3a67e2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:38.272236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27eb79-0aa0-47c2-a3ee-491bff16f2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:38.272995 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27eb79-0aa0-47c2-a3ee-491bff16f2d7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:38.273275 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27eb79-0aa0-47c2-a3ee-491bff16f2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:38.273545 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27eb79-0aa0-47c2-a3ee-491bff16f2d7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:38.274130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27eb79-0aa0-47c2-a3ee-491bff16f2d7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:38.275488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27eb79-0aa0-47c2-a3ee-491bff16f2d7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:38.290233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-1b27eb79-0aa0-47c2-a3ee-491bff16f2d7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 20:43:38.290233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:38.290233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:43:38.290233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:43:38.290233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:43:38.290233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:43:38.290233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:43:38.290233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:38.290233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 20:43:38.290233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:38.290233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:43:38.290233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:38.290233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:38.290233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:38.290233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:38.290233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:38.290233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:38.291251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:38.291251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:38.291251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:38.291251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:38.291251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:38.291251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:38.291251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:43:38.291251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:43:38.291251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:43:38.291251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:43:38.291251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:38.291251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:38.291251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:38.291251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:38.291251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:38.291251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:38.292100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:38.292100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:38.292100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:38.292100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:38.292100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:38.292100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:38.292100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:38.292100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:38.292100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:38.292100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:38.292100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:43:38.292100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:38.292100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 20:43:38.292100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:38.292100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 397/782] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:38 2022] GET /identity/v3/services/network => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:38.299175 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27eb79-0aa0-47c2-a3ee-491bff16f2d7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:38.343570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0aa08d-4a3d-462a-9e8c-1df4248003bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:38.344201 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0aa08d-4a3d-462a-9e8c-1df4248003bd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:38.344486 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0aa08d-4a3d-462a-9e8c-1df4248003bd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:38.344759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0aa08d-4a3d-462a-9e8c-1df4248003bd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:38.362176 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0aa08d-4a3d-462a-9e8c-1df4248003bd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:38.363954 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0aa08d-4a3d-462a-9e8c-1df4248003bd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:38.381549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-1d0aa08d-4a3d-462a-9e8c-1df4248003bd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 20:43:38.381549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:38.381549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:38.381549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:38.381549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:38.381549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:38.381549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:38.381549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:38.381549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:38.381549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:38.381549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:38.381549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:38.381549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:38.381549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:38.381549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:38.381549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:38.382505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:38.382505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:38.382505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:38.382505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:38.382505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:38.382505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:38.382505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:38.382505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:38.382505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:38.382505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:38.382505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:38.382505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:38.382505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:38.382505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:38.382505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:38.382505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:38.382505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:38.382505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:38.383475 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:38.383475 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:38.383475 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:38.383475 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:38.383475 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:38.383475 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:38.383475 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:38.383475 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:38.383475 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 20:43:38.383475 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:38.383475 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 386/783] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:43:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:38.393488 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0aa08d-4a3d-462a-9e8c-1df4248003bd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:38.415596 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:38.433119 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27eb79-0aa0-47c2-a3ee-491bff16f2d7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:38.528525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c0e52-393f-4a28-944d-e0ec0581b072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:38.529250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c0e52-393f-4a28-944d-e0ec0581b072 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:38.529682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c0e52-393f-4a28-944d-e0ec0581b072 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:38.529965 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c0e52-393f-4a28-944d-e0ec0581b072 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:38.533359 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c0e52-393f-4a28-944d-e0ec0581b072 None admin] RBAC: Adding query filter params (name=network) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:38.533670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c0e52-393f-4a28-944d-e0ec0581b072 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:38.535045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c0e52-393f-4a28-944d-e0ec0581b072 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:38.546041 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 398/784] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Sep 9 20:43:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:38.551756 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c0e52-393f-4a28-944d-e0ec0581b072 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:38.562108 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0aa08d-4a3d-462a-9e8c-1df4248003bd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:38.604445 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:38.615939 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f165303-3bf5-42e4-972a-e6b2883878ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:38.616692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f165303-3bf5-42e4-972a-e6b2883878ff None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:38.616983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f165303-3bf5-42e4-972a-e6b2883878ff None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:38.617266 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f165303-3bf5-42e4-972a-e6b2883878ff None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:38.618125 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f165303-3bf5-42e4-972a-e6b2883878ff None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:38.618466 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f165303-3bf5-42e4-972a-e6b2883878ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:38.628151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f165303-3bf5-42e4-972a-e6b2883878ff None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:38.655916 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 387/785] 10.222.0.15 () {56 vars in 1135 bytes} [Fri Sep 9 20:43:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:38.661321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f165303-3bf5-42e4-972a-e6b2883878ff None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:38.695467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c0e52-393f-4a28-944d-e0ec0581b072 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:38.760605 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd6911-2de5-4164-9a1e-d87ea45c7c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:38.762318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd6911-2de5-4164-9a1e-d87ea45c7c62 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:38.763454 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd6911-2de5-4164-9a1e-d87ea45c7c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:38.768405 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd6911-2de5-4164-9a1e-d87ea45c7c62 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:38.769090 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd6911-2de5-4164-9a1e-d87ea45c7c62 None admin] RBAC: Adding query filter params (type=network) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:38.769425 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd6911-2de5-4164-9a1e-d87ea45c7c62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:38.770838 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd6911-2de5-4164-9a1e-d87ea45c7c62 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:38.781466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 399/786] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Sep 9 20:43:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:38.787066 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd6911-2de5-4164-9a1e-d87ea45c7c62 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:38.814311 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:38.831489 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f165303-3bf5-42e4-972a-e6b2883878ff None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:38.897925 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27cc06-18ec-40b6-a542-8a8a30412fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:38.898901 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27cc06-18ec-40b6-a542-8a8a30412fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:38.899378 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27cc06-18ec-40b6-a542-8a8a30412fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:38.899845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27cc06-18ec-40b6-a542-8a8a30412fb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:38.912676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27cc06-18ec-40b6-a542-8a8a30412fb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:38.914683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27cc06-18ec-40b6-a542-8a8a30412fb8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:38.932136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-fb27cc06-18ec-40b6-a542-8a8a30412fb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:38.932136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:38.932136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:38.932136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:38.932136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:38.932136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:38.932136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:38.932136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:38.932136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:38.932136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:38.932136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:38.932136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:38.932136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:38.932136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:38.932136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:38.932136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:38.933087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:38.933087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:38.933087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:38.933087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:38.933087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:38.933087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:38.933087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:38.933087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:38.933087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:38.933087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:38.933087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:38.933087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:38.933087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:38.933087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:38.933087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:38.933087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:38.933087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:38.933944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:38.933944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:38.933944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:38.936929 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 388/787] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:38.942895 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27cc06-18ec-40b6-a542-8a8a30412fb8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:38.979352 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:38.990367 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd6911-2de5-4164-9a1e-d87ea45c7c62 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:39.116230 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27cc06-18ec-40b6-a542-8a8a30412fb8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:39.160341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68bb76-9dbe-4a67-982e-dac233208610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:39.161369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68bb76-9dbe-4a67-982e-dac233208610 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:39.161842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68bb76-9dbe-4a67-982e-dac233208610 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:39.162288 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce68bb76-9dbe-4a67-982e-dac233208610 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:39.163193 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68bb76-9dbe-4a67-982e-dac233208610 None admin] RBAC: Adding query filter params (interface=public, service_id=5facf98d3d364639a73c999aed192bda, region_id=RegionOne) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:39.163702 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68bb76-9dbe-4a67-982e-dac233208610 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:39.165317 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce68bb76-9dbe-4a67-982e-dac233208610 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:39.166030 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906692b-0145-4ea7-880d-bde6493a0277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:39.166752 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906692b-0145-4ea7-880d-bde6493a0277 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:39.167106 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906692b-0145-4ea7-880d-bde6493a0277 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:39.167454 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906692b-0145-4ea7-880d-bde6493a0277 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:39.172388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906692b-0145-4ea7-880d-bde6493a0277 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:39.172388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906692b-0145-4ea7-880d-bde6493a0277 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:39.172388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906692b-0145-4ea7-880d-bde6493a0277 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:39.177706 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 400/788] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Sep 9 20:43:38 2022] GET /identity/v3/endpoints?service_id=5facf98d3d364639a73c999aed192bda&interface=public®ion_id=RegionOne => generated 194 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:39.184289 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68bb76-9dbe-4a67-982e-dac233208610 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:39.189458 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 389/789] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:39.199954 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906692b-0145-4ea7-880d-bde6493a0277 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:39.288439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:39.326758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce68bb76-9dbe-4a67-982e-dac233208610 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:39.353162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:39.364353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906692b-0145-4ea7-880d-bde6493a0277 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:39.374496 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63346931-a379-4334-8979-540508870352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:39.375753 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63346931-a379-4334-8979-540508870352 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:39.376205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63346931-a379-4334-8979-540508870352 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:39.376645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63346931-a379-4334-8979-540508870352 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:39.377785 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63346931-a379-4334-8979-540508870352 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:39.379575 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63346931-a379-4334-8979-540508870352 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:39.386780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 401/790] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Sep 9 20:43:39 2022] GET /identity/v3/services => generated 772 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:39.388954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc35d05-b0e6-46ae-ab68-42a2aa07649a None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:39.389239 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc35d05-b0e6-46ae-ab68-42a2aa07649a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:39.389513 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc35d05-b0e6-46ae-ab68-42a2aa07649a None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:39.392268 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 402/791] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:39.406374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa64e3-36b9-46f4-a030-4fc3fe247eb2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:39.406684 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa64e3-36b9-46f4-a030-4fc3fe247eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:39.406911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa64e3-36b9-46f4-a030-4fc3fe247eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:39.426754 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eaee9c-1a3e-462d-8be2-bebd2fe343af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:39.427311 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaee9c-1a3e-462d-8be2-bebd2fe343af None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:39.427592 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaee9c-1a3e-462d-8be2-bebd2fe343af None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:39.427863 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaee9c-1a3e-462d-8be2-bebd2fe343af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:39.441134 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eaee9c-1a3e-462d-8be2-bebd2fe343af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:39.441611 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-13aa64e3-36b9-46f4-a030-4fc3fe247eb2 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:39.442720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eaee9c-1a3e-462d-8be2-bebd2fe343af None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:39.442818 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-13aa64e3-36b9-46f4-a030-4fc3fe247eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:39.455590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-44eaee9c-1a3e-462d-8be2-bebd2fe343af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:39.455590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:39.455590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:39.455590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:39.455590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:39.455590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:39.455590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:39.455590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:39.455590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:39.455590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:39.455590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:39.455590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:39.455590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:39.455590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:39.455590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:39.456606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:39.456606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:39.456606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:39.456606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:39.456606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:39.456606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:39.456606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:39.456606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:39.456606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:39.456606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:39.456606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:39.456606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:39.456606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:39.456606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:39.456606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:39.456606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:39.456606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:39.457479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:39.457479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:39.457479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:39.457479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:39.457479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:39.457479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:39.457479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:39.457479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:39.457479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 390/792] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:39.458408 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef5d94-51e3-40ff-8469-b4aec66aeeb6 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:39.458408 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef5d94-51e3-40ff-8469-b4aec66aeeb6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:39.458557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef5d94-51e3-40ff-8469-b4aec66aeeb6 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:39.460088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 391/793] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:39.462363 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef5d94-51e3-40ff-8469-b4aec66aeeb6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:39.536814 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 403/794] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:43:39.538141 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f000a64-c701-491a-923d-b429b508eca5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:39.538428 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f000a64-c701-491a-923d-b429b508eca5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:39.538699 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f000a64-c701-491a-923d-b429b508eca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:39.562224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9f000a64-c701-491a-923d-b429b508eca5 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:39.571956 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9f000a64-c701-491a-923d-b429b508eca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:39.629903 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef5d94-51e3-40ff-8469-b4aec66aeeb6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:39.671379 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:39.676396 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2d5ff-9013-4ef7-a07f-ad686b6c4c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:39.677331 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2d5ff-9013-4ef7-a07f-ad686b6c4c61 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:39.677832 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2d5ff-9013-4ef7-a07f-ad686b6c4c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:39.678141 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 404/795] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:43:39.678562 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2d5ff-9013-4ef7-a07f-ad686b6c4c61 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:39.679483 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2d5ff-9013-4ef7-a07f-ad686b6c4c61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:39.680013 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2d5ff-9013-4ef7-a07f-ad686b6c4c61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:39.681678 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2d5ff-9013-4ef7-a07f-ad686b6c4c61 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:39.695666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 392/796] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:39.703441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f000a64-c701-491a-923d-b429b508eca5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:39.814195 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f000a64-c701-491a-923d-b429b508eca5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:39.849697 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52597f80-202f-4589-b269-85885bcf0521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:39.850361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52597f80-202f-4589-b269-85885bcf0521 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:39.850637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52597f80-202f-4589-b269-85885bcf0521 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:39.850906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52597f80-202f-4589-b269-85885bcf0521 None admin] PATH_INFO: `/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/9570eaa112de460cb9e371278bfb300b/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:39.852959 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52597f80-202f-4589-b269-85885bcf0521 None admin] RBAC: Authorizing `identity:create_grant(project_id=a57df41195d240fe8f28ac49bfd37921, user_id=9570eaa112de460cb9e371278bfb300b, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:39.854505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52597f80-202f-4589-b269-85885bcf0521 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:39.875216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 405/797] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:43:39 2022] PUT /identity/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/9570eaa112de460cb9e371278bfb300b/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:43:39.883737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2d5ff-9013-4ef7-a07f-ad686b6c4c61 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:39.901743 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:40.028422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2d5ff-9013-4ef7-a07f-ad686b6c4c61 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:40.080845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffface-1d22-4f12-bebc-8cea0b17a644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:40.081528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffface-1d22-4f12-bebc-8cea0b17a644 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:40.081798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffface-1d22-4f12-bebc-8cea0b17a644 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:40.082061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffface-1d22-4f12-bebc-8cea0b17a644 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:40.097960 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffface-1d22-4f12-bebc-8cea0b17a644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:40.103321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7fffface-1d22-4f12-bebc-8cea0b17a644 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:40.103321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:40.103321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:40.103321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:40.103321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:40.103321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:40.103321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:40.103321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:40.103321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:40.103321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:40.103321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:40.103321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:40.103321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:40.103321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:40.103321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:40.103321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:40.104293 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:40.104293 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:40.104293 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:40.104293 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:40.104293 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:40.104293 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:40.104293 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:40.104293 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:40.104293 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:40.104293 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:40.104293 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:40.104293 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:40.104293 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:40.104293 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:40.104293 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:40.104293 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:40.105122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:40.105122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:40.105122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:40.105122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:40.105122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:40.105122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:40.105122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:40.105122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:40.105122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:40.105122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:40.105122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:40.105122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:40.105122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 393/798] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:43:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:40.111876 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52597f80-202f-4589-b269-85885bcf0521 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:40.130328 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffface-1d22-4f12-bebc-8cea0b17a644 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:40.187650 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:40.235298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52597f80-202f-4589-b269-85885bcf0521 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:40.245057 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffface-1d22-4f12-bebc-8cea0b17a644 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:40.248720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:40.293498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ba9cdf-9b50-4700-8f80-633b4d5deca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:40.294109 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba9cdf-9b50-4700-8f80-633b4d5deca1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:40.294381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba9cdf-9b50-4700-8f80-633b4d5deca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:40.294695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ba9cdf-9b50-4700-8f80-633b4d5deca1 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:40.295378 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba9cdf-9b50-4700-8f80-633b4d5deca1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:40.295682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba9cdf-9b50-4700-8f80-633b4d5deca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:40.298054 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ba9cdf-9b50-4700-8f80-633b4d5deca1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:40.307834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1944f07-91ab-425a-b256-9a06125377f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:40.313213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1944f07-91ab-425a-b256-9a06125377f3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:40.313213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1944f07-91ab-425a-b256-9a06125377f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:40.313213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1944f07-91ab-425a-b256-9a06125377f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:40.315867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 406/799] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Sep 9 20:43:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:40.317503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3994f-39cf-4622-a887-b01736e2a781 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:40.317790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3994f-39cf-4622-a887-b01736e2a781 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:40.318346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3994f-39cf-4622-a887-b01736e2a781 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:40.320136 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 407/800] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:40.322216 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1944f07-91ab-425a-b256-9a06125377f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:40.322503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3994f-39cf-4622-a887-b01736e2a781 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:40.327830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c1944f07-91ab-425a-b256-9a06125377f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:43:40.327830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:40.327830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:40.327830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:40.327830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:40.327830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:40.327830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:40.327830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:40.327830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:40.327830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:40.327830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:40.327830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:40.327830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:40.327830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:40.327830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:40.327830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:40.328848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:40.328848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:40.328848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:40.328848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:40.328848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:40.328848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:40.328848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:40.328848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:40.328848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:40.328848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:40.328848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:40.328848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:40.328848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:40.328848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:40.328848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:40.328848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:40.329676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:40.329676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:40.329676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:40.329676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:40.329676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:40.329676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:40.329676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:40.329676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:40.329676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:40.329676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:40.329676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:43:40.329676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:40.329676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 394/801] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:43:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:43:40.334950 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91e7eb-cd8e-4c07-96ab-073f56c24b18 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:40.334950 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91e7eb-cd8e-4c07-96ab-073f56c24b18 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:40.334950 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91e7eb-cd8e-4c07-96ab-073f56c24b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:40.351010 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8a91e7eb-cd8e-4c07-96ab-073f56c24b18 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:40.352352 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8a91e7eb-cd8e-4c07-96ab-073f56c24b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:40.428076 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 395/802] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:43:40.428943 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91e7eb-cd8e-4c07-96ab-073f56c24b18 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:40.472929 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3994f-39cf-4622-a887-b01736e2a781 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:40.505118 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:40.530433 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356df0ad-5565-42fe-996e-3c28baba3c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:40.531107 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356df0ad-5565-42fe-996e-3c28baba3c9f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:40.531383 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356df0ad-5565-42fe-996e-3c28baba3c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:40.531657 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356df0ad-5565-42fe-996e-3c28baba3c9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:40.552966 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356df0ad-5565-42fe-996e-3c28baba3c9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:40.554409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356df0ad-5565-42fe-996e-3c28baba3c9f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:40.571891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-356df0ad-5565-42fe-996e-3c28baba3c9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:40.571891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:40.571891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:40.571891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:40.571891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:40.571891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:40.571891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:40.571891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:40.571891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:40.571891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:40.571891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:40.571891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:40.571891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:40.571891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:40.571891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:40.571891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:40.574104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:40.574104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:40.574104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:40.574104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:40.574104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:40.574104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:40.574104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:40.574104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:40.574104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:40.574104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:40.574104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:40.574104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:40.574104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:40.574104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:40.574104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:40.574104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:40.574104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:40.576901 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:40.576901 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:40.576901 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:40.584050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 408/803] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:40.584050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356df0ad-5565-42fe-996e-3c28baba3c9f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:40.719656 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:40.782808 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91e7eb-cd8e-4c07-96ab-073f56c24b18 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:40.792139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356df0ad-5565-42fe-996e-3c28baba3c9f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:40.827947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cbf4e-6dab-4c83-9491-d59c000f7186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:40.828571 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c553e-e277-4c29-a87e-4c32536e73cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:40.828694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cbf4e-6dab-4c83-9491-d59c000f7186 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:40.828874 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cbf4e-6dab-4c83-9491-d59c000f7186 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:40.829148 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cbf4e-6dab-4c83-9491-d59c000f7186 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:40.829264 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c553e-e277-4c29-a87e-4c32536e73cf None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:40.829440 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c553e-e277-4c29-a87e-4c32536e73cf None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:40.829715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c553e-e277-4c29-a87e-4c32536e73cf None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:40.829813 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cbf4e-6dab-4c83-9491-d59c000f7186 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:40.830113 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cbf4e-6dab-4c83-9491-d59c000f7186 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:40.830360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c553e-e277-4c29-a87e-4c32536e73cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:40.830654 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c553e-e277-4c29-a87e-4c32536e73cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:40.831820 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cbf4e-6dab-4c83-9491-d59c000f7186 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:40.832010 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c553e-e277-4c29-a87e-4c32536e73cf None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:40.841215 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 396/804] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:43:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:40.842868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cbf4e-6dab-4c83-9491-d59c000f7186 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:40.845251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 409/805] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:40.847509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c553e-e277-4c29-a87e-4c32536e73cf None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:40.884469 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:40.963711 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cbf4e-6dab-4c83-9491-d59c000f7186 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:40.964536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c553e-e277-4c29-a87e-4c32536e73cf None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:40.997206 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:41.004435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39189c29-7928-420b-898d-60b611fa3f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:41.005353 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39189c29-7928-420b-898d-60b611fa3f88 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:41.006021 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39189c29-7928-420b-898d-60b611fa3f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:41.006497 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39189c29-7928-420b-898d-60b611fa3f88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:41.012210 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228786c7-436c-46da-bdf9-f3275b5667cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:41.012851 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228786c7-436c-46da-bdf9-f3275b5667cf None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:41.013132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228786c7-436c-46da-bdf9-f3275b5667cf None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:41.014037 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228786c7-436c-46da-bdf9-f3275b5667cf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:41.014632 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228786c7-436c-46da-bdf9-f3275b5667cf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:41.016156 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228786c7-436c-46da-bdf9-f3275b5667cf None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:41.021178 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39189c29-7928-420b-898d-60b611fa3f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:41.022996 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39189c29-7928-420b-898d-60b611fa3f88 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:41.030401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-228786c7-436c-46da-bdf9-f3275b5667cf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 20:43:41.030401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:41.030401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:43:41.030401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:43:41.030401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:43:41.030401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:43:41.030401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:43:41.030401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:41.030401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 20:43:41.030401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:41.030401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:43:41.030401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:41.030401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:41.030401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:41.030401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:41.030401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:41.030401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:41.031357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:41.031357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:41.031357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:41.031357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:41.031357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:41.031357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:41.031357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:43:41.031357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:43:41.031357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:43:41.031357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:43:41.031357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:41.031357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:41.031357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:41.031357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:41.031357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:41.031357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:41.032609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:41.032609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:41.032609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:41.032609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:41.032609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:41.032609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:41.032609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:41.032609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:41.032609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:41.032609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:41.032609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:43:41.032609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:41.032609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 09 20:43:41.032609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:41.039418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-39189c29-7928-420b-898d-60b611fa3f88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:41.039418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:41.039418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:41.039418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:41.039418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:41.039418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:41.039418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:41.039418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:41.039418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:41.039418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:41.039418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:41.039418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:41.039418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:41.039418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:41.039418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:41.039418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:41.040790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:41.040790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:41.040790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:41.040790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:41.040790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:41.040790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:41.040790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:41.040790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:41.040790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:41.040790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:41.040790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:41.040790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:41.040790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:41.040790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:41.040790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:41.040790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:41.040790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:41.041674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:41.041674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:41.041674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:41.041674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 410/807] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:41.041674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39189c29-7928-420b-898d-60b611fa3f88 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:41.042248 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 397/807] 10.222.0.15 () {56 vars in 1129 bytes} [Fri Sep 9 20:43:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:41.043623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228786c7-436c-46da-bdf9-f3275b5667cf None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:41.147915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228786c7-436c-46da-bdf9-f3275b5667cf None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:41.157661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39189c29-7928-420b-898d-60b611fa3f88 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:41.177477 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:41.190665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61ce3b-3e84-477b-bf1a-5536d0ba90c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:41.191477 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61ce3b-3e84-477b-bf1a-5536d0ba90c2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:41.191900 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61ce3b-3e84-477b-bf1a-5536d0ba90c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:41.192468 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61ce3b-3e84-477b-bf1a-5536d0ba90c2 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:41.193337 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61ce3b-3e84-477b-bf1a-5536d0ba90c2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:41.193782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61ce3b-3e84-477b-bf1a-5536d0ba90c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:41.195288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61ce3b-3e84-477b-bf1a-5536d0ba90c2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:41.199253 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd5579-47bf-4ab3-a3d1-0ad641746b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:41.200016 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd5579-47bf-4ab3-a3d1-0ad641746b4c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:41.200533 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd5579-47bf-4ab3-a3d1-0ad641746b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:41.200907 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd5579-47bf-4ab3-a3d1-0ad641746b4c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:41.201071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 398/808] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Sep 9 20:43:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:41.202063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61ce3b-3e84-477b-bf1a-5536d0ba90c2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:41.210355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd5579-47bf-4ab3-a3d1-0ad641746b4c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:41.212380 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdd5579-47bf-4ab3-a3d1-0ad641746b4c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:41.226577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-5fdd5579-47bf-4ab3-a3d1-0ad641746b4c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 20:43:41.226577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:41.226577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:41.226577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:41.226577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:41.226577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:41.226577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:41.226577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:41.226577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:41.226577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:41.226577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:41.226577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:41.226577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:41.226577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:41.226577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:41.226577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:41.227788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:41.227788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:41.227788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:41.227788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:41.227788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:41.227788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:41.227788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:41.227788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:41.227788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:41.227788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:41.227788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:41.227788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:41.227788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:41.227788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:41.227788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:41.227788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:41.227788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:41.227788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:41.228756 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:41.228756 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:41.228756 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:41.228756 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:41.228756 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:41.228756 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:41.228756 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:41.228756 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:41.228756 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 20:43:41.228756 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:41.228756 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 411/809] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Sep 9 20:43:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:41.229422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd5579-47bf-4ab3-a3d1-0ad641746b4c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:41.260855 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:41.323241 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61ce3b-3e84-477b-bf1a-5536d0ba90c2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:41.350177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd5579-47bf-4ab3-a3d1-0ad641746b4c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:41.365996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60907aae-7def-443e-9323-a7ae2dd8e7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:41.367194 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60907aae-7def-443e-9323-a7ae2dd8e7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:41.367883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60907aae-7def-443e-9323-a7ae2dd8e7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:41.368365 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60907aae-7def-443e-9323-a7ae2dd8e7d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:41.369554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60907aae-7def-443e-9323-a7ae2dd8e7d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:41.370050 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60907aae-7def-443e-9323-a7ae2dd8e7d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:41.371597 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60907aae-7def-443e-9323-a7ae2dd8e7d2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:41.390528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 399/810] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:41.390528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60907aae-7def-443e-9323-a7ae2dd8e7d2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:41.392386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313f4da-61f3-4aef-93fa-3fe1381d311f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:41.393196 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313f4da-61f3-4aef-93fa-3fe1381d311f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:41.393671 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313f4da-61f3-4aef-93fa-3fe1381d311f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:41.394114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313f4da-61f3-4aef-93fa-3fe1381d311f None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:41.394916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313f4da-61f3-4aef-93fa-3fe1381d311f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:41.395389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313f4da-61f3-4aef-93fa-3fe1381d311f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:41.397076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313f4da-61f3-4aef-93fa-3fe1381d311f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:41.403208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 412/811] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Sep 9 20:43:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:41.405035 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313f4da-61f3-4aef-93fa-3fe1381d311f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:41.419448 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:41.508873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60907aae-7def-443e-9323-a7ae2dd8e7d2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:41.522584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:41.530746 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313f4da-61f3-4aef-93fa-3fe1381d311f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:41.545722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa0f67-a44b-477c-bafd-25ae3132a5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:41.546371 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa0f67-a44b-477c-bafd-25ae3132a5db None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:41.546777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa0f67-a44b-477c-bafd-25ae3132a5db None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:41.547055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa0f67-a44b-477c-bafd-25ae3132a5db None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:41.547776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa0f67-a44b-477c-bafd-25ae3132a5db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:41.548488 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa0f67-a44b-477c-bafd-25ae3132a5db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:41.550187 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fa0f67-a44b-477c-bafd-25ae3132a5db None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:41.570477 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd6139-cce4-40f1-b6b7-9760624c3f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:41.571465 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd6139-cce4-40f1-b6b7-9760624c3f25 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:41.571939 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd6139-cce4-40f1-b6b7-9760624c3f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:41.572525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd6139-cce4-40f1-b6b7-9760624c3f25 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:41.576087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 400/812] 10.222.0.15 () {56 vars in 1149 bytes} [Fri Sep 9 20:43:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:41.578121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa0f67-a44b-477c-bafd-25ae3132a5db None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:41.584487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd6139-cce4-40f1-b6b7-9760624c3f25 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:41.586220 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd6139-cce4-40f1-b6b7-9760624c3f25 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:41.599056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-96cd6139-cce4-40f1-b6b7-9760624c3f25 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 20:43:41.599056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:41.599056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:41.599056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:41.599056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:41.599056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:41.599056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:41.599056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:41.599056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:41.599056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:41.599056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:41.599056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:41.599056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:41.599056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:41.599056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:41.599056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:41.600040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:41.600040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:41.600040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:41.600040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:41.600040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:41.600040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:41.600040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:41.600040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:41.600040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:41.600040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:41.600040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:41.600040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:41.600040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:41.600040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:41.600040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:41.600040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:41.600040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:41.600040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:41.600963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:41.600963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:41.600963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:41.600963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:41.600963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:41.600963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:41.600963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:41.600963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:41.600963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 20:43:41.600963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:41.603481 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 413/813] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Sep 9 20:43:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:41.604474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd6139-cce4-40f1-b6b7-9760624c3f25 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:41.681521 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:41.699705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa0f67-a44b-477c-bafd-25ae3132a5db None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:41.723548 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd6139-cce4-40f1-b6b7-9760624c3f25 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:41.739923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b400e8a-e999-4423-9237-af43927b8967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:41.740991 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b400e8a-e999-4423-9237-af43927b8967 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:41.741567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b400e8a-e999-4423-9237-af43927b8967 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:41.742066 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b400e8a-e999-4423-9237-af43927b8967 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:41.742924 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b400e8a-e999-4423-9237-af43927b8967 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:41.744754 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b400e8a-e999-4423-9237-af43927b8967 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:41.767108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f2dd7-3cd7-40f7-a433-0c912fec524c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:41.767749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f2dd7-3cd7-40f7-a433-0c912fec524c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:41.768097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f2dd7-3cd7-40f7-a433-0c912fec524c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:41.768369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f2dd7-3cd7-40f7-a433-0c912fec524c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:41.775918 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 401/814] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:43:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:43:41.777357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b400e8a-e999-4423-9237-af43927b8967 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:41.793212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f2dd7-3cd7-40f7-a433-0c912fec524c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:41.795330 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f2dd7-3cd7-40f7-a433-0c912fec524c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:41.833910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f75f2dd7-3cd7-40f7-a433-0c912fec524c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:41.833910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:41.833910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:41.833910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:41.833910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:41.833910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:41.833910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:41.833910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:41.833910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:41.833910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:41.833910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:41.833910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:41.833910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:41.833910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:41.833910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:41.833910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:41.834906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:41.834906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:41.834906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:41.834906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:41.834906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:41.834906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:41.834906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:41.834906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:41.834906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:41.834906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:41.834906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:41.834906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:41.834906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:41.834906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:41.834906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:41.834906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:41.834906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:41.835780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:41.835780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:41.835780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:41.836875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 414/815] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:41.843579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f2dd7-3cd7-40f7-a433-0c912fec524c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:41.844238 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:41.986909 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b400e8a-e999-4423-9237-af43927b8967 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:42.024116 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f2dd7-3cd7-40f7-a433-0c912fec524c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:42.031697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d09c78-42a6-4939-9376-0d2c636b5a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:42.032585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d09c78-42a6-4939-9376-0d2c636b5a97 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:42.033008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d09c78-42a6-4939-9376-0d2c636b5a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:42.033429 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d09c78-42a6-4939-9376-0d2c636b5a97 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:42.034309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d09c78-42a6-4939-9376-0d2c636b5a97 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:42.034769 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d09c78-42a6-4939-9376-0d2c636b5a97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:42.036258 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d09c78-42a6-4939-9376-0d2c636b5a97 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:42.053489 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:42.060993 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 402/816] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Sep 9 20:43:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:42.062546 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35e59e-42fb-4cc7-babb-de3369c3a042 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:42.062974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35e59e-42fb-4cc7-babb-de3369c3a042 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:42.063380 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35e59e-42fb-4cc7-babb-de3369c3a042 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:42.065254 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 403/817] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:42.069799 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35e59e-42fb-4cc7-babb-de3369c3a042 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:42.073266 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808cf0c6-6f7f-435b-83fc-175992577309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:42.074986 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cf0c6-6f7f-435b-83fc-175992577309 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:42.075366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cf0c6-6f7f-435b-83fc-175992577309 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:42.075742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808cf0c6-6f7f-435b-83fc-175992577309 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:42.076882 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cf0c6-6f7f-435b-83fc-175992577309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:42.077252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cf0c6-6f7f-435b-83fc-175992577309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:42.078726 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808cf0c6-6f7f-435b-83fc-175992577309 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:42.098891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 415/818] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:42.100471 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee23aa-f944-48bf-a7f6-75c86a6e5c13 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:42.101094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee23aa-f944-48bf-a7f6-75c86a6e5c13 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:42.101468 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee23aa-f944-48bf-a7f6-75c86a6e5c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:42.123423 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5fee23aa-f944-48bf-a7f6-75c86a6e5c13 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:42.124812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5fee23aa-f944-48bf-a7f6-75c86a6e5c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:42.177909 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:42.204446 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35e59e-42fb-4cc7-babb-de3369c3a042 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:42.205635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 416/819] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:43:42.206744 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee23aa-f944-48bf-a7f6-75c86a6e5c13 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:42.246629 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5542a00-3aa3-46e3-8388-a84e98f9bb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:42.247357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5542a00-3aa3-46e3-8388-a84e98f9bb01 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:42.247817 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5542a00-3aa3-46e3-8388-a84e98f9bb01 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:42.248988 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5542a00-3aa3-46e3-8388-a84e98f9bb01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:42.337105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee23aa-f944-48bf-a7f6-75c86a6e5c13 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:42.338670 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5542a00-3aa3-46e3-8388-a84e98f9bb01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:42.340199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5542a00-3aa3-46e3-8388-a84e98f9bb01 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:42.353353 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:42.388872 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbede89-9522-447f-96a5-78675d246c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:42.389504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbede89-9522-447f-96a5-78675d246c5d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:42.389787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbede89-9522-447f-96a5-78675d246c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:42.390060 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbede89-9522-447f-96a5-78675d246c5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:42.403277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbede89-9522-447f-96a5-78675d246c5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:42.405289 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbede89-9522-447f-96a5-78675d246c5d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:42.431401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-6cbede89-9522-447f-96a5-78675d246c5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:42.431401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:42.431401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:42.431401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:42.431401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:42.431401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:42.431401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:42.431401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:42.431401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:42.431401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:42.431401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:42.431401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:42.431401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:42.431401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:42.431401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:42.432389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:42.432389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:42.432389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:42.432389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:42.432389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:42.432389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:42.432389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:42.432389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:42.432389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:42.432389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:42.432389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:42.432389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:42.432389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:42.432389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:42.432389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:42.432389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:42.432389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:42.433270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:42.433270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:42.433270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:42.433270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:42.433270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:42.433270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:42.433270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:42.433270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:42.435138 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 417/820] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:42.439120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbede89-9522-447f-96a5-78675d246c5d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:42.475406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:42.498049 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 404/821] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:43:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 20:43:42.499493 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de780c1-1fef-47d4-964a-458d41b3cdaf None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:42.499851 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de780c1-1fef-47d4-964a-458d41b3cdaf None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:42.500253 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de780c1-1fef-47d4-964a-458d41b3cdaf None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:42.501803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 405/822] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:42.505048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de780c1-1fef-47d4-964a-458d41b3cdaf None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:42.576959 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbede89-9522-447f-96a5-78675d246c5d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:42.618209 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1036d72-324e-4019-91ca-e2fb31640154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:42.619037 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1036d72-324e-4019-91ca-e2fb31640154 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:42.619321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1036d72-324e-4019-91ca-e2fb31640154 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:42.619589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1036d72-324e-4019-91ca-e2fb31640154 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:42.620311 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1036d72-324e-4019-91ca-e2fb31640154 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:42.620618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1036d72-324e-4019-91ca-e2fb31640154 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:42.622045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1036d72-324e-4019-91ca-e2fb31640154 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:42.626710 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de780c1-1fef-47d4-964a-458d41b3cdaf None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:42.639971 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 418/823] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:42.641382 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcf383-d983-47ac-a140-042cf7e2c431 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:42.641671 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcf383-d983-47ac-a140-042cf7e2c431 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:42.641946 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fcf383-d983-47ac-a140-042cf7e2c431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:42.661333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a2fcf383-d983-47ac-a140-042cf7e2c431 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:42.662468 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a2fcf383-d983-47ac-a140-042cf7e2c431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:42.665189 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcef11-5b02-461f-adfe-88d457b14b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:42.665847 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcef11-5b02-461f-adfe-88d457b14b23 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:42.666126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcef11-5b02-461f-adfe-88d457b14b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:42.666395 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcef11-5b02-461f-adfe-88d457b14b23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:42.677403 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcef11-5b02-461f-adfe-88d457b14b23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:42.678847 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcef11-5b02-461f-adfe-88d457b14b23 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:42.690760 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:42.696602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-5cfcef11-5b02-461f-adfe-88d457b14b23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:42.696602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:42.696602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:42.696602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:42.696602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:42.696602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:42.696602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:42.696602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:42.696602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:42.696602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:42.696602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:42.696602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:42.696602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:42.696602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:42.696602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:42.696602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:42.697530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:42.697530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:42.697530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:42.697530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:42.697530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:42.697530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:42.697530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:42.697530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:42.697530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:42.697530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:42.697530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:42.697530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:42.697530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:42.697530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:42.697530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:42.697530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:42.697530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:42.698392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:42.698392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:42.698392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:42.698392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 406/824] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:42.704210 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcef11-5b02-461f-adfe-88d457b14b23 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:42.736437 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:42.744122 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 419/825] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:43:42.745235 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcf383-d983-47ac-a140-042cf7e2c431 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:42.818150 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcef11-5b02-461f-adfe-88d457b14b23 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:42.855250 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57e025-9650-4b87-9ba8-3c62ba010b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:42.856202 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57e025-9650-4b87-9ba8-3c62ba010b41 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:42.856314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57e025-9650-4b87-9ba8-3c62ba010b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:42.856577 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57e025-9650-4b87-9ba8-3c62ba010b41 None admin] PATH_INFO: `/v3/services/network` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:42.857786 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57e025-9650-4b87-9ba8-3c62ba010b41 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:42.859190 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57e025-9650-4b87-9ba8-3c62ba010b41 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:42.863454 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fcf383-d983-47ac-a140-042cf7e2c431 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:42.868582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-6b57e025-9650-4b87-9ba8-3c62ba010b41 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 20:43:42.868582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:42.868582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:43:42.868582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:43:42.868582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:43:42.868582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:43:42.868582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:43:42.868582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:42.868582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 20:43:42.868582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:42.868582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:43:42.868582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:42.868582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:42.868582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:42.868582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:42.868582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:42.868582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:42.869542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:42.869542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:42.869542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:42.869542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:42.869542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:42.869542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:42.869542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:43:42.869542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:43:42.869542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:43:42.869542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:43:42.869542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:42.869542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:42.869542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:42.869542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:42.869542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:42.869542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:42.870388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:42.870388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:42.870388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:42.870388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:42.870388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:42.870388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:42.870388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:42.870388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:42.870388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:42.870388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:42.870388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:43:42.870388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:42.870388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 09 20:43:42.870388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:42.875173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 407/826] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:42 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:42.875941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57e025-9650-4b87-9ba8-3c62ba010b41 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:42.906977 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe681f2d-732b-4a48-8c79-62d7813821c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:42.908562 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe681f2d-732b-4a48-8c79-62d7813821c4 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:42.909018 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe681f2d-732b-4a48-8c79-62d7813821c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:42.909729 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe681f2d-732b-4a48-8c79-62d7813821c4 None admin] PATH_INFO: `/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/e51ae6959aac49898e75c6786c5dbdf2/roles/e3de94d5ee924ea4b638d196d282af55` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:42.929218 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe681f2d-732b-4a48-8c79-62d7813821c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a57df41195d240fe8f28ac49bfd37921, user_id=e51ae6959aac49898e75c6786c5dbdf2, role_id=e3de94d5ee924ea4b638d196d282af55)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:42.931136 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe681f2d-732b-4a48-8c79-62d7813821c4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:42.949175 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 420/827] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:43:42 2022] PUT /identity/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/e51ae6959aac49898e75c6786c5dbdf2/roles/e3de94d5ee924ea4b638d196d282af55 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:43:42.950278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe681f2d-732b-4a48-8c79-62d7813821c4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:42.968504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:42.989777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:42.998689 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57e025-9650-4b87-9ba8-3c62ba010b41 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:43.040473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1b99c-0640-44cb-a774-46d30090f1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:43.041028 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1b99c-0640-44cb-a774-46d30090f1a3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:43.041380 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1b99c-0640-44cb-a774-46d30090f1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:43.041732 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1b99c-0640-44cb-a774-46d30090f1a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:43.042450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1b99c-0640-44cb-a774-46d30090f1a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:43.042829 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1b99c-0640-44cb-a774-46d30090f1a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:43.044478 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1b99c-0640-44cb-a774-46d30090f1a3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:43.058155 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 408/828] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:43.064075 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1b99c-0640-44cb-a774-46d30090f1a3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:43.083307 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe681f2d-732b-4a48-8c79-62d7813821c4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:43.136600 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f2118-a646-4edf-a105-ccd8af47e4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:43.137303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f2118-a646-4edf-a105-ccd8af47e4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:43.137585 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f2118-a646-4edf-a105-ccd8af47e4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:43.137856 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f2118-a646-4edf-a105-ccd8af47e4c0 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:43.138535 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f2118-a646-4edf-a105-ccd8af47e4c0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:43.138836 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f2118-a646-4edf-a105-ccd8af47e4c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:43.140378 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f2118-a646-4edf-a105-ccd8af47e4c0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:43.145742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 421/829] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Sep 9 20:43:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:43.146611 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f2118-a646-4edf-a105-ccd8af47e4c0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:43.210428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1b99c-0640-44cb-a774-46d30090f1a3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:43.238403 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:43.257570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ceaf92-6aca-4a74-85aa-1f29d7d46efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:43.259113 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ceaf92-6aca-4a74-85aa-1f29d7d46efd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:43.259545 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ceaf92-6aca-4a74-85aa-1f29d7d46efd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:43.259974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ceaf92-6aca-4a74-85aa-1f29d7d46efd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:43.264163 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f2118-a646-4edf-a105-ccd8af47e4c0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:43.269804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ceaf92-6aca-4a74-85aa-1f29d7d46efd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:43.271443 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ceaf92-6aca-4a74-85aa-1f29d7d46efd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:43.291915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-41ceaf92-6aca-4a74-85aa-1f29d7d46efd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:43.291915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:43.291915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:43.291915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:43.291915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:43.291915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:43.291915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:43.291915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:43.291915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:43.291915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:43.291915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:43.291915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:43.291915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:43.291915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:43.291915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:43.293071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:43.293071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:43.293071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:43.293071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:43.293071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:43.293071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:43.293071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:43.293071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:43.293071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:43.293071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:43.293071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:43.293071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:43.293071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:43.293071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:43.293071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:43.293071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:43.293071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:43.294254 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:43.294254 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:43.294254 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:43.294254 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:43.294254 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:43.294254 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:43.294254 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:43.294254 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:43.297959 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 409/830] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:43:43.299257 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ceaf92-6aca-4a74-85aa-1f29d7d46efd None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:43.305998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496be1da-e4b5-43dc-a49c-7975097b38b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:43.306732 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496be1da-e4b5-43dc-a49c-7975097b38b7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:43.307079 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496be1da-e4b5-43dc-a49c-7975097b38b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:43.307418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496be1da-e4b5-43dc-a49c-7975097b38b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:43.327620 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:43.328051 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496be1da-e4b5-43dc-a49c-7975097b38b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:43.335467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-496be1da-e4b5-43dc-a49c-7975097b38b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:43:43.335467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:43.335467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:43.335467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:43.335467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:43.335467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:43.335467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:43.335467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:43.335467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:43.335467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:43.335467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:43.335467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:43.335467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:43.335467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:43.335467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:43.335467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:43.336441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:43.336441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:43.336441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:43.336441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:43.336441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:43.336441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:43.336441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:43.336441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:43.336441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:43.336441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:43.336441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:43.336441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:43.336441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:43.336441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:43.336441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:43.336441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:43.337278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:43.337278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:43.337278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:43.337278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:43.337278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:43.337278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:43.337278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:43.337278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:43.337278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:43.337278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:43.337278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:43:43.337278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:43.343314 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 422/831] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:43:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:43.343314 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496be1da-e4b5-43dc-a49c-7975097b38b7 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:43.449881 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ceaf92-6aca-4a74-85aa-1f29d7d46efd None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:43.450226 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496be1da-e4b5-43dc-a49c-7975097b38b7 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:43.487646 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f4977-832b-45f7-9110-52bf62cc78aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:43.488322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f4977-832b-45f7-9110-52bf62cc78aa None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:43.488605 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f4977-832b-45f7-9110-52bf62cc78aa None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:43.488880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f4977-832b-45f7-9110-52bf62cc78aa None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:43.489635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f6a70-2471-4067-8247-9d5b8b0b5258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:43.489758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f4977-832b-45f7-9110-52bf62cc78aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:43.489973 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f4977-832b-45f7-9110-52bf62cc78aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:43.490767 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f6a70-2471-4067-8247-9d5b8b0b5258 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:43.491256 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f6a70-2471-4067-8247-9d5b8b0b5258 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:43.491427 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f4977-832b-45f7-9110-52bf62cc78aa None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:43.491879 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31f6a70-2471-4067-8247-9d5b8b0b5258 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:43.492737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f6a70-2471-4067-8247-9d5b8b0b5258 None admin] RBAC: Adding query filter params (type=network) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:43.493237 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f6a70-2471-4067-8247-9d5b8b0b5258 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:43.494112 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:43.495397 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31f6a70-2471-4067-8247-9d5b8b0b5258 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:43.501889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 410/832] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Sep 9 20:43:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:43.503065 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f6a70-2471-4067-8247-9d5b8b0b5258 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:43.511062 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 423/833] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:43.512025 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f4977-832b-45f7-9110-52bf62cc78aa None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:43.596082 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:43.621410 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31f6a70-2471-4067-8247-9d5b8b0b5258 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:43.631220 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f4977-832b-45f7-9110-52bf62cc78aa None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:43.660731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3e6dc-8455-4758-9583-a78ddc020d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:43.661770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3e6dc-8455-4758-9583-a78ddc020d6e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:43.662265 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3e6dc-8455-4758-9583-a78ddc020d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:43.662750 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3e6dc-8455-4758-9583-a78ddc020d6e None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:43.663604 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3e6dc-8455-4758-9583-a78ddc020d6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:43.664163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3e6dc-8455-4758-9583-a78ddc020d6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:43.665733 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d3e6dc-8455-4758-9583-a78ddc020d6e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:43.670343 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3041a79-4566-4968-8dad-7cbf3c6bd499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:43.671183 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3041a79-4566-4968-8dad-7cbf3c6bd499 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:43.671448 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3041a79-4566-4968-8dad-7cbf3c6bd499 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:43.671722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3041a79-4566-4968-8dad-7cbf3c6bd499 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:43.672423 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3041a79-4566-4968-8dad-7cbf3c6bd499 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:43.673829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3041a79-4566-4968-8dad-7cbf3c6bd499 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:43.677578 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 411/834] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:43:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:43.678683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3e6dc-8455-4758-9583-a78ddc020d6e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:43.712208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 424/835] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:43:43 2022] POST /identity/v3/endpoints => generated 337 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:43:43.714582 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3041a79-4566-4968-8dad-7cbf3c6bd499 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:43.838278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:43.875669 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3e6dc-8455-4758-9583-a78ddc020d6e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:43.932496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db80320-21d9-4578-8038-977f0b13bc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:43.933212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db80320-21d9-4578-8038-977f0b13bc54 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:43.933499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db80320-21d9-4578-8038-977f0b13bc54 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:43.933771 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db80320-21d9-4578-8038-977f0b13bc54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:43.934765 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db80320-21d9-4578-8038-977f0b13bc54 None admin] RBAC: Adding query filter params (role.id=be620fc7968740269d233c5ace94a563, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=dc210376e57a41e6b3812110db249099) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:43.934946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db80320-21d9-4578-8038-977f0b13bc54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:43.936957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db80320-21d9-4578-8038-977f0b13bc54 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:43.942962 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3041a79-4566-4968-8dad-7cbf3c6bd499 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:43.945552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 412/836] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:43:43 2022] GET /identity/v3/role_assignments?user.id=dc210376e57a41e6b3812110db249099&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=be620fc7968740269d233c5ace94a563 => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:43.985613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939be938-521d-4a3d-abfd-d66b7784fca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:43.986580 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939be938-521d-4a3d-abfd-d66b7784fca5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:43.987010 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939be938-521d-4a3d-abfd-d66b7784fca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:43.987436 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939be938-521d-4a3d-abfd-d66b7784fca5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:44.003069 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939be938-521d-4a3d-abfd-d66b7784fca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:44.004973 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939be938-521d-4a3d-abfd-d66b7784fca5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:44.023246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-939be938-521d-4a3d-abfd-d66b7784fca5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:44.023246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:44.023246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:44.023246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:44.023246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:44.023246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:44.023246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:44.023246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:44.023246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:44.023246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:44.023246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:44.023246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:44.023246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:44.023246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:44.023246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:44.023246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:44.024522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:44.024522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:44.024522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:44.024522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:44.024522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:44.024522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:44.024522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:44.024522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:44.024522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:44.024522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:44.024522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:44.024522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:44.024522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:44.024522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:44.024522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:44.024522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:44.024522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:44.025877 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:44.025877 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:44.025877 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:44.027915 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 425/837] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:44.033873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db80320-21d9-4578-8038-977f0b13bc54 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:44.037470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:44.148327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d2f04-89ed-4ab3-b7c6-20279cfe7a0f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:44.148534 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d2f04-89ed-4ab3-b7c6-20279cfe7a0f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:44.148810 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d2f04-89ed-4ab3-b7c6-20279cfe7a0f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:44.150429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 426/838] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:43:44.155728 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db80320-21d9-4578-8038-977f0b13bc54 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:44.156947 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6898e9-b968-4499-9711-f31879a396bb None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:44.157232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6898e9-b968-4499-9711-f31879a396bb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:44.157509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6898e9-b968-4499-9711-f31879a396bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:44.184985 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ea6898e9-b968-4499-9711-f31879a396bb None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:44.186927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ea6898e9-b968-4499-9711-f31879a396bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:44.197195 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9877d1-9bbc-48c5-b280-2a4fe999ff76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:44.198078 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9877d1-9bbc-48c5-b280-2a4fe999ff76 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:44.198558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9877d1-9bbc-48c5-b280-2a4fe999ff76 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:44.199008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9877d1-9bbc-48c5-b280-2a4fe999ff76 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:44.199814 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9877d1-9bbc-48c5-b280-2a4fe999ff76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:44.200318 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9877d1-9bbc-48c5-b280-2a4fe999ff76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:44.202444 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9877d1-9bbc-48c5-b280-2a4fe999ff76 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:44.218213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 413/839] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:44.222185 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9877d1-9bbc-48c5-b280-2a4fe999ff76 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:44.275396 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 427/840] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:43:44.296086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:44.336619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9877d1-9bbc-48c5-b280-2a4fe999ff76 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:44.373846 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17d537-cd93-427b-9871-657e91e12fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:44.374846 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17d537-cd93-427b-9871-657e91e12fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:44.375333 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17d537-cd93-427b-9871-657e91e12fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:44.375811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d17d537-cd93-427b-9871-657e91e12fe3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:44.383716 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17d537-cd93-427b-9871-657e91e12fe3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:44.385430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d17d537-cd93-427b-9871-657e91e12fe3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:44.398442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7d17d537-cd93-427b-9871-657e91e12fe3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 09 20:43:44.398442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:44.398442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:44.398442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:44.398442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:44.398442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:44.398442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:44.398442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:44.398442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:44.398442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:44.398442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:44.398442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:44.398442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:44.398442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:44.398442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:44.398442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:44.399405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:44.399405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:44.399405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:44.399405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:44.399405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:44.399405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:44.399405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:44.399405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:44.399405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:44.399405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:44.399405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:44.399405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:44.399405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:44.399405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:44.399405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:44.399405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:44.399405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:44.399405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:44.400453 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:44.400453 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:44.400453 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:44.400453 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:44.400453 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:44.400453 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:44.400453 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:44.400453 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:44.400453 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 09 20:43:44.400453 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:44.402870 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 414/841] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:43:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:43:44.411251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6898e9-b968-4499-9711-f31879a396bb None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:44.443665 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:44.512642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6898e9-b968-4499-9711-f31879a396bb None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:44.549411 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836ad99-55bb-4be7-add5-ff268c077d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:44.550450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836ad99-55bb-4be7-add5-ff268c077d75 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:44.550934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836ad99-55bb-4be7-add5-ff268c077d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:44.551460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836ad99-55bb-4be7-add5-ff268c077d75 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:44.552432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836ad99-55bb-4be7-add5-ff268c077d75 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:44.552936 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836ad99-55bb-4be7-add5-ff268c077d75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:44.554561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836ad99-55bb-4be7-add5-ff268c077d75 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:44.574118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17d537-cd93-427b-9871-657e91e12fe3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:44.574413 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 428/842] 10.222.0.15 () {56 vars in 1135 bytes} [Fri Sep 9 20:43:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:44.581060 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836ad99-55bb-4be7-add5-ff268c077d75 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:44.688750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:44.700225 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d17d537-cd93-427b-9871-657e91e12fe3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:44.704468 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836ad99-55bb-4be7-add5-ff268c077d75 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:44.725103 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:44.739440 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb25681-bdbb-4877-bafc-14c8e99a28af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:44.740385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb25681-bdbb-4877-bafc-14c8e99a28af None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:44.740907 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb25681-bdbb-4877-bafc-14c8e99a28af None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:44.741318 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb25681-bdbb-4877-bafc-14c8e99a28af None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:44.742137 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb25681-bdbb-4877-bafc-14c8e99a28af None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:44.743654 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb25681-bdbb-4877-bafc-14c8e99a28af None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:44.750631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b548c68-cff6-4c8b-a70c-8ff87e452eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:44.751361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b548c68-cff6-4c8b-a70c-8ff87e452eda None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:44.751745 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b548c68-cff6-4c8b-a70c-8ff87e452eda None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:44.752156 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b548c68-cff6-4c8b-a70c-8ff87e452eda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:44.753934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-bbb25681-bdbb-4877-bafc-14c8e99a28af None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 20:43:44.753934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:44.753934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:43:44.753934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:43:44.753934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:43:44.753934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:43:44.753934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:43:44.753934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:44.753934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 20:43:44.753934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:44.753934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:43:44.753934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:44.753934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:44.753934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:44.753934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:44.753934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:44.753934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:44.754946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:44.754946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:44.754946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:44.754946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:44.754946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:44.754946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:44.754946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:43:44.754946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:43:44.754946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:43:44.754946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:43:44.754946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:44.754946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:44.754946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:44.754946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:44.754946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:44.754946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:44.755804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:44.755804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:44.755804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:44.755804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:44.755804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:44.755804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:44.755804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:44.755804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:44.755804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:44.755804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:44.755804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:43:44.755804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:44.755804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 20:43:44.755804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:44.758311 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 415/843] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:43:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:43:44.767771 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb25681-bdbb-4877-bafc-14c8e99a28af None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:44.842614 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b548c68-cff6-4c8b-a70c-8ff87e452eda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:44.844727 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b548c68-cff6-4c8b-a70c-8ff87e452eda None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:44.881168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb25681-bdbb-4877-bafc-14c8e99a28af None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:44.918507 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383095bf-033d-4d36-bea4-5a6cdee90f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:44.919126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383095bf-033d-4d36-bea4-5a6cdee90f11 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:44.919403 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383095bf-033d-4d36-bea4-5a6cdee90f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:44.919775 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383095bf-033d-4d36-bea4-5a6cdee90f11 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:44.920440 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383095bf-033d-4d36-bea4-5a6cdee90f11 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:44.920743 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383095bf-033d-4d36-bea4-5a6cdee90f11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:44.922119 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383095bf-033d-4d36-bea4-5a6cdee90f11 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:44.931361 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 416/844] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:43:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:44.932733 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383095bf-033d-4d36-bea4-5a6cdee90f11 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:44.973097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:44.988844 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 429/845] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:43:44 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 20:43:44.990680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:45.000936 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b548c68-cff6-4c8b-a70c-8ff87e452eda None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:45.051815 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383095bf-033d-4d36-bea4-5a6cdee90f11 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:45.101056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb5a17-2446-4a95-9ee0-5489fe7c39d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:45.101785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb5a17-2446-4a95-9ee0-5489fe7c39d9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:45.102135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb5a17-2446-4a95-9ee0-5489fe7c39d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:45.102478 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb5a17-2446-4a95-9ee0-5489fe7c39d9 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:45.103163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb5a17-2446-4a95-9ee0-5489fe7c39d9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:45.103536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb5a17-2446-4a95-9ee0-5489fe7c39d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:45.105607 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb5a17-2446-4a95-9ee0-5489fe7c39d9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:45.116076 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 417/846] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:43:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:45.126573 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b548c68-cff6-4c8b-a70c-8ff87e452eda None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:45.166582 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cbe28-a7a5-4ab6-9c80-72b334a989f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:45.167538 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cbe28-a7a5-4ab6-9c80-72b334a989f3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:45.168051 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cbe28-a7a5-4ab6-9c80-72b334a989f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:45.168506 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cbe28-a7a5-4ab6-9c80-72b334a989f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:45.181153 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cbe28-a7a5-4ab6-9c80-72b334a989f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:45.183007 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cbe28-a7a5-4ab6-9c80-72b334a989f3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:45.200488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-673cbe28-a7a5-4ab6-9c80-72b334a989f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:45.200488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:45.200488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:45.200488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:45.200488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:45.200488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:45.200488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:45.200488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:45.200488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:45.200488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:45.200488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:45.200488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:45.200488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:45.200488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:45.200488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:45.200488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:45.202087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:45.202087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:45.202087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:45.202087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:45.202087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:45.202087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:45.202087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:45.202087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:45.202087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:45.202087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:45.202087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:45.202087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:45.202087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:45.202087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:45.202087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:45.202087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:45.202087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:45.202991 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:45.202991 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:45.202991 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:45.205136 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 430/847] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:45.213215 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb5a17-2446-4a95-9ee0-5489fe7c39d9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:45.329632 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb5a17-2446-4a95-9ee0-5489fe7c39d9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:45.347170 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:45.370043 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4768c-aac4-4cc7-b4f2-27b021a8e837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:45.370656 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4768c-aac4-4cc7-b4f2-27b021a8e837 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:45.370934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4768c-aac4-4cc7-b4f2-27b021a8e837 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:45.371199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4768c-aac4-4cc7-b4f2-27b021a8e837 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:45.371833 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4768c-aac4-4cc7-b4f2-27b021a8e837 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:45.372162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4768c-aac4-4cc7-b4f2-27b021a8e837 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:45.374229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c4768c-aac4-4cc7-b4f2-27b021a8e837 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:45.386712 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 418/848] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:45.392858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cbe28-a7a5-4ab6-9c80-72b334a989f3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:45.430020 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eac950-48f6-465b-93d2-1ae4f3d8a6a7 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:45.430331 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eac950-48f6-465b-93d2-1ae4f3d8a6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:45.430560 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eac950-48f6-465b-93d2-1ae4f3d8a6a7 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:45.432134 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 419/849] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:43:45.438669 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb5dad-e2ab-46ab-82eb-7394bb39b23a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:45.438956 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb5dad-e2ab-46ab-82eb-7394bb39b23a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:45.439235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb5dad-e2ab-46ab-82eb-7394bb39b23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:45.443857 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:45.463763 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6feb5dad-e2ab-46ab-82eb-7394bb39b23a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:45.465028 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6feb5dad-e2ab-46ab-82eb-7394bb39b23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:45.509812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cbe28-a7a5-4ab6-9c80-72b334a989f3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:45.544411 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 420/850] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 20:43:45.556142 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cbcb4-c1eb-49dd-b83b-47bc449124af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:45.556832 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cbcb4-c1eb-49dd-b83b-47bc449124af None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:45.557166 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cbcb4-c1eb-49dd-b83b-47bc449124af None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:45.557434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cbcb4-c1eb-49dd-b83b-47bc449124af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:45.564671 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cbcb4-c1eb-49dd-b83b-47bc449124af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:45.566104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cbcb4-c1eb-49dd-b83b-47bc449124af None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:45.577960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-219cbcb4-c1eb-49dd-b83b-47bc449124af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:45.577960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:45.577960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:45.577960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:45.577960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:45.577960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:45.577960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:45.577960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:45.577960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:45.577960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:45.577960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:45.577960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:45.577960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:45.577960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:45.577960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:45.578849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:45.578849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:45.578849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:45.578849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:45.578849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:45.578849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:45.578849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:45.578849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:45.578849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:45.578849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:45.578849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:45.578849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:45.578849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:45.578849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:45.578849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:45.578849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:45.578849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:45.580159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:45.580159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:45.580159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:45.580159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:45.580159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:45.580159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:45.580159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:45.580159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:45.580159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 431/851] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:45.585160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb5dad-e2ab-46ab-82eb-7394bb39b23a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:45.688992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb5dad-e2ab-46ab-82eb-7394bb39b23a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:45.692208 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:45.729710 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8c66f-5deb-46a2-a480-e0fbcf72454d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:45.730718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8c66f-5deb-46a2-a480-e0fbcf72454d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:45.731205 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8c66f-5deb-46a2-a480-e0fbcf72454d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:45.731685 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8c66f-5deb-46a2-a480-e0fbcf72454d None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:45.733183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8c66f-5deb-46a2-a480-e0fbcf72454d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:45.733700 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8c66f-5deb-46a2-a480-e0fbcf72454d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:45.735356 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad8c66f-5deb-46a2-a480-e0fbcf72454d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:45.748213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 421/852] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:45.756536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cbcb4-c1eb-49dd-b83b-47bc449124af None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:45.862319 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8c66f-5deb-46a2-a480-e0fbcf72454d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:45.866957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cbcb4-c1eb-49dd-b83b-47bc449124af None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:45.869444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:45.905894 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a905b6-e751-45e3-8c7e-34aba00ca2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:45.906509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a905b6-e751-45e3-8c7e-34aba00ca2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:45.906791 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a905b6-e751-45e3-8c7e-34aba00ca2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:45.907065 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a905b6-e751-45e3-8c7e-34aba00ca2d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:45.907802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a905b6-e751-45e3-8c7e-34aba00ca2d2 None admin] RBAC: Adding query filter params (role.id=be620fc7968740269d233c5ace94a563, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=9570eaa112de460cb9e371278bfb300b) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:45.908152 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a905b6-e751-45e3-8c7e-34aba00ca2d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:45.909589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a905b6-e751-45e3-8c7e-34aba00ca2d2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:45.916521 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 432/853] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:43:45 2022] GET /identity/v3/role_assignments?user.id=9570eaa112de460cb9e371278bfb300b&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=be620fc7968740269d233c5ace94a563 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:45.996193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8c66f-5deb-46a2-a480-e0fbcf72454d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:46.035820 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c53ca5-58b7-4cf4-b026-a2f06b08c9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:46.036515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c53ca5-58b7-4cf4-b026-a2f06b08c9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:46.036799 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c53ca5-58b7-4cf4-b026-a2f06b08c9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:46.037074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c53ca5-58b7-4cf4-b026-a2f06b08c9e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:46.049479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c53ca5-58b7-4cf4-b026-a2f06b08c9e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:46.054875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-a2c53ca5-58b7-4cf4-b026-a2f06b08c9e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:46.054875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:46.054875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:46.054875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:46.054875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:46.054875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:46.054875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:46.054875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:46.054875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:46.054875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:46.054875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:46.054875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:46.054875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:46.054875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:46.054875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:46.054875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:46.056287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:46.056287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:46.056287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:46.056287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:46.056287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:46.056287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:46.056287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:46.056287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:46.056287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:46.056287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:46.056287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:46.056287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:46.056287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:46.056287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:46.056287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:46.056287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:46.057126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:46.057126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:46.057126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:46.057126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:46.057126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:46.057126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:46.057126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:46.057126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:46.057126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:46.057126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:46.057126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:43:46.057126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:46.057126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 422/854] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:43:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:46.062445 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a905b6-e751-45e3-8c7e-34aba00ca2d2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:46.184541 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a905b6-e751-45e3-8c7e-34aba00ca2d2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:46.222557 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db9bad1-381e-404e-a3c4-8d0eda60e2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:46.223177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9bad1-381e-404e-a3c4-8d0eda60e2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:46.223458 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9bad1-381e-404e-a3c4-8d0eda60e2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:46.223735 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db9bad1-381e-404e-a3c4-8d0eda60e2c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:46.224430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9bad1-381e-404e-a3c4-8d0eda60e2c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:46.224796 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9bad1-381e-404e-a3c4-8d0eda60e2c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:46.226224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db9bad1-381e-404e-a3c4-8d0eda60e2c7 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:46.234957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 433/855] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Sep 9 20:43:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:46.240267 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c53ca5-58b7-4cf4-b026-a2f06b08c9e7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:46.268582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:46.300774 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7abf5f-07d1-4ef8-affe-5273539a2593 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:46.301107 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7abf5f-07d1-4ef8-affe-5273539a2593 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:46.301331 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7abf5f-07d1-4ef8-affe-5273539a2593 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:46.302900 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 434/856] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:43:46.311020 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9da4c-16e3-433c-a3cb-d29eb4c615f2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:46.311301 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9da4c-16e3-433c-a3cb-d29eb4c615f2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:46.312014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9da4c-16e3-433c-a3cb-d29eb4c615f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:46.332983 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-53d9da4c-16e3-433c-a3cb-d29eb4c615f2 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:46.334340 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-53d9da4c-16e3-433c-a3cb-d29eb4c615f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:46.357299 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c53ca5-58b7-4cf4-b026-a2f06b08c9e7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:46.358974 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:46.404522 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e576afa-74af-4efc-89f1-25a58238df87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:46.405174 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e576afa-74af-4efc-89f1-25a58238df87 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:46.405459 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e576afa-74af-4efc-89f1-25a58238df87 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:46.405787 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e576afa-74af-4efc-89f1-25a58238df87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:46.412233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 435/857] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 20:43:46.417432 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e576afa-74af-4efc-89f1-25a58238df87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:46.418896 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e576afa-74af-4efc-89f1-25a58238df87 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:46.434668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-0e576afa-74af-4efc-89f1-25a58238df87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:46.434668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:46.434668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:46.434668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:46.434668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:46.434668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:46.434668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:46.434668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:46.434668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:46.434668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:46.434668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:46.434668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:46.434668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:46.434668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:46.434668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:46.434668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:46.435889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:46.435889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:46.435889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:46.435889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:46.435889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:46.435889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:46.435889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:46.435889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:46.435889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:46.435889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:46.435889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:46.435889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:46.435889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:46.435889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:46.435889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:46.435889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:46.435889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:46.436796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:46.436796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:46.436796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:46.440407 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 423/858] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:46.441640 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9da4c-16e3-433c-a3cb-d29eb4c615f2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:46.547084 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9da4c-16e3-433c-a3cb-d29eb4c615f2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:46.583505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec89d9a-07ce-491b-89d1-c85c3daf0a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:46.584720 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89d9a-07ce-491b-89d1-c85c3daf0a7f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:46.585069 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89d9a-07ce-491b-89d1-c85c3daf0a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:46.585352 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec89d9a-07ce-491b-89d1-c85c3daf0a7f None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:46.586002 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec89d9a-07ce-491b-89d1-c85c3daf0a7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:46.586306 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec89d9a-07ce-491b-89d1-c85c3daf0a7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:46.587667 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec89d9a-07ce-491b-89d1-c85c3daf0a7f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:46.600281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 436/859] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:46.605476 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e576afa-74af-4efc-89f1-25a58238df87 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:46.687794 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec89d9a-07ce-491b-89d1-c85c3daf0a7f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:46.689676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:46.714231 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:46.717502 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e576afa-74af-4efc-89f1-25a58238df87 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:46.763570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbda48-a2d0-4f1c-9b1f-7b709028efaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:46.764271 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbda48-a2d0-4f1c-9b1f-7b709028efaa None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:46.764556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbda48-a2d0-4f1c-9b1f-7b709028efaa None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:46.764833 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fbda48-a2d0-4f1c-9b1f-7b709028efaa None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:46.776456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbda48-a2d0-4f1c-9b1f-7b709028efaa None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:46.777983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fbda48-a2d0-4f1c-9b1f-7b709028efaa None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:46.793067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-56fbda48-a2d0-4f1c-9b1f-7b709028efaa None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 20:43:46.793067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:46.793067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:46.793067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:46.793067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:46.793067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:46.793067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:46.793067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:46.793067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:46.793067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:46.793067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:46.793067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:46.793067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:46.793067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:46.793067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:46.793067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:46.794088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:46.794088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:46.794088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:46.794088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:46.794088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:46.794088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:46.794088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:46.794088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:46.794088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:46.794088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:46.794088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:46.794088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:46.794088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:46.794088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:46.794088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:46.794088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:46.794088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:46.794088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:46.795585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:46.795585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:46.795585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:46.795585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:46.795585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:46.795585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:46.795585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:46.795585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:46.795585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 20:43:46.795585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:46.799904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 424/860] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Sep 9 20:43:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:46.800805 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbda48-a2d0-4f1c-9b1f-7b709028efaa None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:46.822573 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec89d9a-07ce-491b-89d1-c85c3daf0a7f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:46.866916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a0767-9a33-49c3-90fe-e05a27e43104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:46.867956 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a0767-9a33-49c3-90fe-e05a27e43104 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:46.868530 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a0767-9a33-49c3-90fe-e05a27e43104 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:46.869544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a0767-9a33-49c3-90fe-e05a27e43104 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:46.870592 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a0767-9a33-49c3-90fe-e05a27e43104 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:46.872392 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a0767-9a33-49c3-90fe-e05a27e43104 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:46.883934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-941a0767-9a33-49c3-90fe-e05a27e43104 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 20:43:46.883934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:46.883934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:43:46.883934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:43:46.883934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:43:46.883934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:43:46.883934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:43:46.883934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:46.883934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 20:43:46.883934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:46.883934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:43:46.883934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:46.883934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:46.883934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:46.883934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:46.883934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:46.884972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:46.884972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:46.884972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:46.884972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:46.884972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:46.884972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:46.884972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:46.884972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:43:46.884972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:43:46.884972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:43:46.884972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:43:46.884972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:46.884972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:46.884972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:46.884972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:46.884972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:46.884972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:46.885875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:46.885875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:46.885875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:46.885875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:46.885875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:46.885875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:46.885875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:46.885875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:46.885875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:46.885875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:46.885875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:43:46.885875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:46.885875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 20:43:46.885875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:46.894410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 437/861] 10.222.0.15 () {56 vars in 1132 bytes} [Fri Sep 9 20:43:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:43:46.895739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a0767-9a33-49c3-90fe-e05a27e43104 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:46.937997 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fbda48-a2d0-4f1c-9b1f-7b709028efaa None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:46.987941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb4267-722c-49cc-bc37-a56b282de11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:46.988589 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb4267-722c-49cc-bc37-a56b282de11a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:46.988872 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb4267-722c-49cc-bc37-a56b282de11a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:46.989146 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb4267-722c-49cc-bc37-a56b282de11a None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:46.989952 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb4267-722c-49cc-bc37-a56b282de11a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:46.990275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb4267-722c-49cc-bc37-a56b282de11a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:46.991725 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb4267-722c-49cc-bc37-a56b282de11a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:46.995486 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:47.004943 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:47.020140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 425/862] 10.222.0.15 () {56 vars in 1149 bytes} [Fri Sep 9 20:43:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:47.024563 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb4267-722c-49cc-bc37-a56b282de11a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:47.030471 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a0767-9a33-49c3-90fe-e05a27e43104 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:47.067653 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757248d-e44e-4304-9715-0e6e82856117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:47.068279 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757248d-e44e-4304-9715-0e6e82856117 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:47.068556 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757248d-e44e-4304-9715-0e6e82856117 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:47.068825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757248d-e44e-4304-9715-0e6e82856117 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:47.069449 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757248d-e44e-4304-9715-0e6e82856117 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:47.069853 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757248d-e44e-4304-9715-0e6e82856117 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:47.071214 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757248d-e44e-4304-9715-0e6e82856117 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:47.081814 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 438/863] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Sep 9 20:43:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:47.084572 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757248d-e44e-4304-9715-0e6e82856117 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:47.175049 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb4267-722c-49cc-bc37-a56b282de11a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:47.192816 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757248d-e44e-4304-9715-0e6e82856117 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:47.228591 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf786e-38cb-4d8d-8233-e2601f7f2bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:47.229773 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf786e-38cb-4d8d-8233-e2601f7f2bdd None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:47.230059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf786e-38cb-4d8d-8233-e2601f7f2bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:47.230332 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf786e-38cb-4d8d-8233-e2601f7f2bdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:47.238394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e03aa-4e33-48ba-91c7-b06a3670d1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:47.239345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e03aa-4e33-48ba-91c7-b06a3670d1af None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:47.239817 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e03aa-4e33-48ba-91c7-b06a3670d1af None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:47.240369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e03aa-4e33-48ba-91c7-b06a3670d1af None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:47.241809 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e03aa-4e33-48ba-91c7-b06a3670d1af None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:47.242319 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e03aa-4e33-48ba-91c7-b06a3670d1af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:47.244443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e03aa-4e33-48ba-91c7-b06a3670d1af None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:47.256281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 439/864] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Sep 9 20:43:47 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:47.312350 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:47.319955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf786e-38cb-4d8d-8233-e2601f7f2bdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:47.321484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf786e-38cb-4d8d-8233-e2601f7f2bdd None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:47.453905 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 426/865] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:43:47 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 20:43:47.459619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e03aa-4e33-48ba-91c7-b06a3670d1af None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:47.478811 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:47.567041 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11bc65-e254-43ee-b369-7a781e6588b9 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:47.567712 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11bc65-e254-43ee-b369-7a781e6588b9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:47.568175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11bc65-e254-43ee-b369-7a781e6588b9 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:47.569995 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 427/866] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:43:47.571960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e03aa-4e33-48ba-91c7-b06a3670d1af None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:47.577539 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fbd84-8a4b-4860-bc66-eaddc66ffb20 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:47.577917 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fbd84-8a4b-4860-bc66-eaddc66ffb20 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:47.578307 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fbd84-8a4b-4860-bc66-eaddc66ffb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:47.600251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-902fbd84-8a4b-4860-bc66-eaddc66ffb20 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:47.601768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-902fbd84-8a4b-4860-bc66-eaddc66ffb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:47.613369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2592b-442d-4f18-8b22-4a91f1d51b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:47.614053 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2592b-442d-4f18-8b22-4a91f1d51b66 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:47.614333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2592b-442d-4f18-8b22-4a91f1d51b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:47.614603 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b2592b-442d-4f18-8b22-4a91f1d51b66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:47.629550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2592b-442d-4f18-8b22-4a91f1d51b66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:47.631932 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b2592b-442d-4f18-8b22-4a91f1d51b66 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:47.651443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-61b2592b-442d-4f18-8b22-4a91f1d51b66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:47.651443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:47.651443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:47.651443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:47.651443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:47.651443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:47.651443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:47.651443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:47.651443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:47.651443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:47.651443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:47.651443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:47.651443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:47.651443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:47.651443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:47.651443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:47.652503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:47.652503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:47.652503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:47.652503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:47.652503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:47.652503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:47.652503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:47.652503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:47.652503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:47.652503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:47.652503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:47.652503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:47.652503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:47.652503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:47.652503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:47.652503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:47.652503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:47.653405 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:47.653405 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:47.653405 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:47.653726 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 440/867] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:47.660533 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2592b-442d-4f18-8b22-4a91f1d51b66 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:47.694218 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 428/868] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:43:47.734726 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:47.780826 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b2592b-442d-4f18-8b22-4a91f1d51b66 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:47.826567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fb12c-6b46-457f-bded-661aa3c69800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:47.826968 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fb12c-6b46-457f-bded-661aa3c69800 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:47.827251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fb12c-6b46-457f-bded-661aa3c69800 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:47.827521 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fb12c-6b46-457f-bded-661aa3c69800 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:47.828188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fb12c-6b46-457f-bded-661aa3c69800 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:47.828487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fb12c-6b46-457f-bded-661aa3c69800 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:47.829831 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4fb12c-6b46-457f-bded-661aa3c69800 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:47.843163 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 441/869] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:47.848772 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fbd84-8a4b-4860-bc66-eaddc66ffb20 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:47.876777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:47.961949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fbd84-8a4b-4860-bc66-eaddc66ffb20 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:47.998644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fb12c-6b46-457f-bded-661aa3c69800 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:47.999082 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3609088-4a60-4bb0-aedb-55d33a821929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:47.999724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3609088-4a60-4bb0-aedb-55d33a821929 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:48.000012 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3609088-4a60-4bb0-aedb-55d33a821929 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:48.000300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3609088-4a60-4bb0-aedb-55d33a821929 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:48.009290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3609088-4a60-4bb0-aedb-55d33a821929 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:48.010757 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3609088-4a60-4bb0-aedb-55d33a821929 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:48.026651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-d3609088-4a60-4bb0-aedb-55d33a821929 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:48.026651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:48.026651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:48.026651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:48.026651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:48.026651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:48.026651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:48.026651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:48.026651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:48.026651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:48.026651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:48.026651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:48.026651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:48.026651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:48.026651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:48.027576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:48.027576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:48.027576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:48.027576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:48.027576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:48.027576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:48.027576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:48.027576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:48.027576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:48.027576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:48.027576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:48.027576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:48.027576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:48.027576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:48.027576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:48.027576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:48.027576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:48.032965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:48.032965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:48.032965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:48.032965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:48.032965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:48.032965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:48.032965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:48.032965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:48.032965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 429/870] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:48.034785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3609088-4a60-4bb0-aedb-55d33a821929 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:48.124738 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fb12c-6b46-457f-bded-661aa3c69800 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:48.145140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:48.158062 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:48.171983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3609088-4a60-4bb0-aedb-55d33a821929 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:48.175356 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f97c3-a259-41fc-8bad-5ffd475ffc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:48.176257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f97c3-a259-41fc-8bad-5ffd475ffc7e None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:48.176750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f97c3-a259-41fc-8bad-5ffd475ffc7e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:48.177242 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f97c3-a259-41fc-8bad-5ffd475ffc7e None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:48.178119 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f97c3-a259-41fc-8bad-5ffd475ffc7e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:48.179669 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f97c3-a259-41fc-8bad-5ffd475ffc7e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:48.204178 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 442/871] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Sep 9 20:43:47 2022] POST /identity/v3/services => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:43:48.219973 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc05f18-9ee8-469c-ae67-7f3ca47c6a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:48.220640 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc05f18-9ee8-469c-ae67-7f3ca47c6a04 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:48.220956 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc05f18-9ee8-469c-ae67-7f3ca47c6a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:48.221230 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc05f18-9ee8-469c-ae67-7f3ca47c6a04 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:48.221929 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc05f18-9ee8-469c-ae67-7f3ca47c6a04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:48.222291 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc05f18-9ee8-469c-ae67-7f3ca47c6a04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:48.223778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc05f18-9ee8-469c-ae67-7f3ca47c6a04 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:48.239460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 430/872] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:48.245747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f97c3-a259-41fc-8bad-5ffd475ffc7e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:48.271076 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490f659-2764-45d1-8fa7-86842cd3aa60 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:48.271269 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490f659-2764-45d1-8fa7-86842cd3aa60 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:48.271531 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490f659-2764-45d1-8fa7-86842cd3aa60 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:48.273524 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 431/873] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:43:48.279897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8ea23-f669-467a-b028-e83fa5ef34a8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:48.280268 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8ea23-f669-467a-b028-e83fa5ef34a8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:48.280536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8ea23-f669-467a-b028-e83fa5ef34a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:48.306097 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b0b8ea23-f669-467a-b028-e83fa5ef34a8 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:48.306097 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b0b8ea23-f669-467a-b028-e83fa5ef34a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:48.383592 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f97c3-a259-41fc-8bad-5ffd475ffc7e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:48.393971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 432/874] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:48 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 20:43:48.422905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3250e-ae5a-4642-9cfc-481a111be6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:48.423512 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3250e-ae5a-4642-9cfc-481a111be6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:48.423788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3250e-ae5a-4642-9cfc-481a111be6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:48.424097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3250e-ae5a-4642-9cfc-481a111be6e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:48.424826 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3250e-ae5a-4642-9cfc-481a111be6e0 None admin] RBAC: Adding query filter params (role.id=e3de94d5ee924ea4b638d196d282af55, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=e51ae6959aac49898e75c6786c5dbdf2) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:48.425132 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3250e-ae5a-4642-9cfc-481a111be6e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:48.426550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3250e-ae5a-4642-9cfc-481a111be6e0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:48.432454 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 443/875] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:43:48 2022] GET /identity/v3/role_assignments?user.id=e51ae6959aac49898e75c6786c5dbdf2&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=e3de94d5ee924ea4b638d196d282af55 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:48.660910 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8ea23-f669-467a-b028-e83fa5ef34a8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:48.737734 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:48.771522 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8ea23-f669-467a-b028-e83fa5ef34a8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:48.808308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ec850-c59a-45cc-b09f-fd30016654f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:48.808952 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ec850-c59a-45cc-b09f-fd30016654f7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:48.809229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ec850-c59a-45cc-b09f-fd30016654f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:48.809496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ec850-c59a-45cc-b09f-fd30016654f7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:48.810131 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ec850-c59a-45cc-b09f-fd30016654f7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:48.812031 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ec850-c59a-45cc-b09f-fd30016654f7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:48.821047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-647ec850-c59a-45cc-b09f-fd30016654f7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 20:43:48.821047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:48.821047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:43:48.821047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:43:48.821047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:43:48.821047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:43:48.821047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:43:48.821047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:48.821047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 20:43:48.821047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:48.821047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:43:48.821047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:48.821047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:48.821047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:48.821047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:48.821047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:48.821047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:48.822173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:48.822173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:48.822173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:48.822173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:48.822173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:48.822173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:48.822173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:43:48.822173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:43:48.822173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:43:48.822173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:43:48.822173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:48.822173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:48.822173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:48.822173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:48.822173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:48.822173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:48.823063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:48.823063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:48.823063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:48.823063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:48.823063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:48.823063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:48.823063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:48.823063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:48.823063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:48.823063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:48.823063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:43:48.823063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:48.823063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 20:43:48.823063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:48.823063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 433/876] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Sep 9 20:43:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:48.830814 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3250e-ae5a-4642-9cfc-481a111be6e0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:48.882777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:48.941134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3250e-ae5a-4642-9cfc-481a111be6e0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:48.976597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6c4f4-4499-4a1b-a155-0cdf5c2cf194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:48.977210 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6c4f4-4499-4a1b-a155-0cdf5c2cf194 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:48.977485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6c4f4-4499-4a1b-a155-0cdf5c2cf194 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:48.977752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6c4f4-4499-4a1b-a155-0cdf5c2cf194 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:48.978379 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6c4f4-4499-4a1b-a155-0cdf5c2cf194 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:48.978683 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6c4f4-4499-4a1b-a155-0cdf5c2cf194 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:48.980048 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6c4f4-4499-4a1b-a155-0cdf5c2cf194 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:48.986171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 444/877] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Sep 9 20:43:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:48.991915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ec850-c59a-45cc-b09f-fd30016654f7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:49.101079 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ec850-c59a-45cc-b09f-fd30016654f7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:49.138057 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cac581-7215-4187-8475-526ef64f91d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:49.138697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cac581-7215-4187-8475-526ef64f91d8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:49.138977 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cac581-7215-4187-8475-526ef64f91d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:49.139249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cac581-7215-4187-8475-526ef64f91d8 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:49.139877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cac581-7215-4187-8475-526ef64f91d8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:49.140210 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cac581-7215-4187-8475-526ef64f91d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:49.141571 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cac581-7215-4187-8475-526ef64f91d8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:49.142764 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:49.146951 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 434/878] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Sep 9 20:43:48 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:49.626757 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf7453-8164-446a-adb7-7d8af5f641a7 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:49.626990 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf7453-8164-446a-adb7-7d8af5f641a7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:49.627219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf7453-8164-446a-adb7-7d8af5f641a7 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:49.628888 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 445/879] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:49.634505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee738c1-bf32-4506-913c-561461a6068f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:49.634965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee738c1-bf32-4506-913c-561461a6068f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:49.635064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee738c1-bf32-4506-913c-561461a6068f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:49.655319 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5ee738c1-bf32-4506-913c-561461a6068f None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:49.656558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5ee738c1-bf32-4506-913c-561461a6068f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:49.732102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 435/880] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:49 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 20:43:49.998093 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf7453-8164-446a-adb7-7d8af5f641a7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:50.104052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf7453-8164-446a-adb7-7d8af5f641a7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:50.120231 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:50.143289 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff81ee4-2ee5-4286-8043-56c4d3b58013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:50.143905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff81ee4-2ee5-4286-8043-56c4d3b58013 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:50.144215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff81ee4-2ee5-4286-8043-56c4d3b58013 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:50.144491 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff81ee4-2ee5-4286-8043-56c4d3b58013 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:50.145159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff81ee4-2ee5-4286-8043-56c4d3b58013 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:50.146535 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff81ee4-2ee5-4286-8043-56c4d3b58013 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:50.162677 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 446/881] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Sep 9 20:43:49 2022] POST /identity/v3/services => generated 269 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:43:50.649307 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54d7f4-245b-4371-8545-9094db7da80a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:50.649812 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54d7f4-245b-4371-8545-9094db7da80a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:50.649812 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54d7f4-245b-4371-8545-9094db7da80a None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:50.651642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 436/882] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:50.657241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f4e26-4441-43c6-8242-7597f78a5469 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:50.657528 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f4e26-4441-43c6-8242-7597f78a5469 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:50.657803 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f4e26-4441-43c6-8242-7597f78a5469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:50.676679 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-550f4e26-4441-43c6-8242-7597f78a5469 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:50.678033 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-550f4e26-4441-43c6-8242-7597f78a5469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:50.758558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 447/883] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:43:50.801719 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b9a0a-d853-4f94-bc71-0b4222bc4cb3 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:50.802099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b9a0a-d853-4f94-bc71-0b4222bc4cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:50.802446 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b9a0a-d853-4f94-bc71-0b4222bc4cb3 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:50.804109 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 437/884] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:50.809329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0aa01a-e57f-417f-a657-fbecfe157fa0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:50.809617 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0aa01a-e57f-417f-a657-fbecfe157fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:50.809894 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0aa01a-e57f-417f-a657-fbecfe157fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:50.829369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fa0aa01a-e57f-417f-a657-fbecfe157fa0 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:50.830560 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fa0aa01a-e57f-417f-a657-fbecfe157fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:50.899422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 448/885] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:43:51.030037 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b9a0a-d853-4f94-bc71-0b4222bc4cb3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:51.141549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b9a0a-d853-4f94-bc71-0b4222bc4cb3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:51.170553 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:51.178824 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df4188-9f6b-4430-958b-1af1a150382a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:51.179509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df4188-9f6b-4430-958b-1af1a150382a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:51.179789 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df4188-9f6b-4430-958b-1af1a150382a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:51.180085 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df4188-9f6b-4430-958b-1af1a150382a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:51.180660 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df4188-9f6b-4430-958b-1af1a150382a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:51.182024 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df4188-9f6b-4430-958b-1af1a150382a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:51.186186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0aa01a-e57f-417f-a657-fbecfe157fa0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:51.191596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-46df4188-9f6b-4430-958b-1af1a150382a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 20:43:51.191596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:51.191596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:43:51.191596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:43:51.191596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:43:51.191596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:43:51.191596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:43:51.191596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:51.191596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 20:43:51.191596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:51.191596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:43:51.191596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:51.191596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:51.191596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:51.191596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:51.191596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:51.191596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:51.192659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:51.192659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:51.192659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:51.192659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:51.192659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:51.192659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:51.192659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:43:51.192659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:43:51.192659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:43:51.192659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:43:51.192659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:51.192659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:51.192659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:51.192659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:51.192659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:51.192659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:51.193904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:51.193904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:51.193904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:51.193904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:51.193904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:51.193904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:51.193904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:51.193904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:51.193904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:51.193904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:51.193904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:43:51.193904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:51.193904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 20:43:51.193904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:51.193904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 438/886] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:43:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:43:51.202035 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df4188-9f6b-4430-958b-1af1a150382a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:51.217605 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:51.310431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0aa01a-e57f-417f-a657-fbecfe157fa0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:51.335917 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df4188-9f6b-4430-958b-1af1a150382a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:51.356970 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34588292-a714-4d48-acb5-2f31ab2815f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:51.358407 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588292-a714-4d48-acb5-2f31ab2815f0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:51.358963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588292-a714-4d48-acb5-2f31ab2815f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:51.359390 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588292-a714-4d48-acb5-2f31ab2815f0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:51.373625 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34588292-a714-4d48-acb5-2f31ab2815f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:51.377181 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dba6ca-edc2-47c5-bb7d-a38430599d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:51.377886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dba6ca-edc2-47c5-bb7d-a38430599d6c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:51.378234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dba6ca-edc2-47c5-bb7d-a38430599d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:51.378573 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dba6ca-edc2-47c5-bb7d-a38430599d6c None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:51.379271 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dba6ca-edc2-47c5-bb7d-a38430599d6c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:51.379684 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dba6ca-edc2-47c5-bb7d-a38430599d6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:51.380191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-34588292-a714-4d48-acb5-2f31ab2815f0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 20:43:51.380191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:51.380191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:51.380191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:51.380191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:51.380191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:51.380191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:51.380191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:51.380191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:51.380191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:51.380191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:51.380191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:51.380191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:51.380191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:51.380191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:51.380191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:51.381280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:51.381280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:51.381280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:51.381280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:51.381280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:51.381280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:51.381280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:51.381280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:51.381280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:51.381280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:51.381280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:51.381280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:51.381280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:51.381280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:51.381280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:51.381280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:51.382305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:51.382305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:51.382305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:51.382305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:51.382305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:51.382305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:51.382305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:51.382305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:51.382305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:51.382305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:51.382305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 20:43:51.382305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:51.383091 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dba6ca-edc2-47c5-bb7d-a38430599d6c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:51.384584 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 449/887] 10.222.0.15 () {56 vars in 1120 bytes} [Fri Sep 9 20:43:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:43:51.391585 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34588292-a714-4d48-acb5-2f31ab2815f0 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:51.392502 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 439/888] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:43:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:51.401257 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dba6ca-edc2-47c5-bb7d-a38430599d6c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:51.458880 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:51.499071 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:51.506559 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dba6ca-edc2-47c5-bb7d-a38430599d6c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:51.513267 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34588292-a714-4d48-acb5-2f31ab2815f0 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:51.542740 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cf59b-2140-4226-ac0b-43bfab7d7222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:51.543350 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cf59b-2140-4226-ac0b-43bfab7d7222 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:51.543630 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cf59b-2140-4226-ac0b-43bfab7d7222 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:51.543905 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cf59b-2140-4226-ac0b-43bfab7d7222 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:51.545176 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cf59b-2140-4226-ac0b-43bfab7d7222 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:51.545474 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cf59b-2140-4226-ac0b-43bfab7d7222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:51.546948 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cf59b-2140-4226-ac0b-43bfab7d7222 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:51.551670 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 440/889] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:43:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:51.552858 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f22e2-6cc7-41b1-b930-b775f52a7185 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:51.553144 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f22e2-6cc7-41b1-b930-b775f52a7185 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:51.553420 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f22e2-6cc7-41b1-b930-b775f52a7185 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:51.554574 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0aca8d-89cd-496b-90d7-e9f18882c037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:51.558685 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 441/890] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:51.558685 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f22e2-6cc7-41b1-b930-b775f52a7185 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:51.559550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0aca8d-89cd-496b-90d7-e9f18882c037 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:51.559835 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0aca8d-89cd-496b-90d7-e9f18882c037 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:51.560767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0aca8d-89cd-496b-90d7-e9f18882c037 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:51.561439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0aca8d-89cd-496b-90d7-e9f18882c037 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:51.561741 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0aca8d-89cd-496b-90d7-e9f18882c037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:51.563114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0aca8d-89cd-496b-90d7-e9f18882c037 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:51.576218 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 450/891] 10.222.0.15 () {56 vars in 1115 bytes} [Fri Sep 9 20:43:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:51.576218 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894c408-e21c-4959-8638-df8d5304c509 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:51.576218 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894c408-e21c-4959-8638-df8d5304c509 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:51.576218 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894c408-e21c-4959-8638-df8d5304c509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:51.590838 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8894c408-e21c-4959-8638-df8d5304c509 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:51.592065 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8894c408-e21c-4959-8638-df8d5304c509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:51.662613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 451/892] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:51 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:43:51.663544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894c408-e21c-4959-8638-df8d5304c509 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:51.673666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f22e2-6cc7-41b1-b930-b775f52a7185 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:51.696970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:51.714690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c45a1-08fa-41e0-8eff-5b4e8fda84f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:51.715397 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c45a1-08fa-41e0-8eff-5b4e8fda84f6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:51.715816 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c45a1-08fa-41e0-8eff-5b4e8fda84f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:51.716220 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c45a1-08fa-41e0-8eff-5b4e8fda84f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:51.717291 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c45a1-08fa-41e0-8eff-5b4e8fda84f6 None admin] RBAC: Adding query filter params (interface=public, service_id=fba63d093b1e4060b881272c0b994e77, region_id=RegionOne) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:51.717473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c45a1-08fa-41e0-8eff-5b4e8fda84f6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:51.719060 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c45a1-08fa-41e0-8eff-5b4e8fda84f6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:51.732531 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 442/893] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Sep 9 20:43:51 2022] GET /identity/v3/endpoints?service_id=fba63d093b1e4060b881272c0b994e77&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:51.733986 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c45a1-08fa-41e0-8eff-5b4e8fda84f6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:51.769585 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:51.800911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894c408-e21c-4959-8638-df8d5304c509 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:51.846211 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c45a1-08fa-41e0-8eff-5b4e8fda84f6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:51.850472 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1911905-ad4f-41ff-8439-10aaab9e5c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:51.851335 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1911905-ad4f-41ff-8439-10aaab9e5c7b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:51.851810 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1911905-ad4f-41ff-8439-10aaab9e5c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:51.852310 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1911905-ad4f-41ff-8439-10aaab9e5c7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:51.866675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1911905-ad4f-41ff-8439-10aaab9e5c7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:51.869056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1911905-ad4f-41ff-8439-10aaab9e5c7b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:51.882482 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689a3b0-b456-4b3d-aef2-67e3d0e46311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:51.883296 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689a3b0-b456-4b3d-aef2-67e3d0e46311 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:51.883677 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689a3b0-b456-4b3d-aef2-67e3d0e46311 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:51.884081 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689a3b0-b456-4b3d-aef2-67e3d0e46311 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:51.884787 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689a3b0-b456-4b3d-aef2-67e3d0e46311 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:51.886379 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689a3b0-b456-4b3d-aef2-67e3d0e46311 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:51.890672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d1911905-ad4f-41ff-8439-10aaab9e5c7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:51.890672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:51.890672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:51.890672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:51.890672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:51.890672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:51.890672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:51.890672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:51.890672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:51.890672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:51.890672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:51.890672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:51.890672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:51.890672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:51.890672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:51.890672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:51.891802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:51.891802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:51.891802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:51.891802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:51.891802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:51.891802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:51.891802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:51.891802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:51.891802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:51.891802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:51.891802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:51.891802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:51.891802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:51.891802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:51.891802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:51.891802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:51.891802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:51.892933 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:51.892933 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:51.892933 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:51.894624 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 452/894] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:51.900206 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 443/895] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Sep 9 20:43:51 2022] GET /identity/v3/services => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:43:51.902546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1911905-ad4f-41ff-8439-10aaab9e5c7b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:51.929726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689a3b0-b456-4b3d-aef2-67e3d0e46311 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:51.994282 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:52.036520 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1911905-ad4f-41ff-8439-10aaab9e5c7b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:52.069459 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689a3b0-b456-4b3d-aef2-67e3d0e46311 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:52.081870 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:52.088409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526c993-a628-4028-bf01-93efeec2d59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:52.089378 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526c993-a628-4028-bf01-93efeec2d59f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:52.089854 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526c993-a628-4028-bf01-93efeec2d59f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:52.090424 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526c993-a628-4028-bf01-93efeec2d59f None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:52.091434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526c993-a628-4028-bf01-93efeec2d59f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:52.091746 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526c993-a628-4028-bf01-93efeec2d59f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:52.093489 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526c993-a628-4028-bf01-93efeec2d59f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:52.108452 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 453/896] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:52.115044 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526c993-a628-4028-bf01-93efeec2d59f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:52.115214 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8e971-fc77-4e04-bbcf-7dbadef697d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:52.115847 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8e971-fc77-4e04-bbcf-7dbadef697d2 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:52.116267 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8e971-fc77-4e04-bbcf-7dbadef697d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:52.116643 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8e971-fc77-4e04-bbcf-7dbadef697d2 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:52.117301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8e971-fc77-4e04-bbcf-7dbadef697d2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:52.119453 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f8e971-fc77-4e04-bbcf-7dbadef697d2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:52.137390 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 444/897] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Sep 9 20:43:51 2022] POST /identity/v3/services => generated 241 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:43:52.243956 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526c993-a628-4028-bf01-93efeec2d59f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:52.290853 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab4bf2-cdf4-4f6f-9f61-248e6050227e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:52.291436 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab4bf2-cdf4-4f6f-9f61-248e6050227e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:52.291716 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab4bf2-cdf4-4f6f-9f61-248e6050227e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:52.291996 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab4bf2-cdf4-4f6f-9f61-248e6050227e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:52.301039 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab4bf2-cdf4-4f6f-9f61-248e6050227e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:52.302518 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab4bf2-cdf4-4f6f-9f61-248e6050227e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:52.317498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-feab4bf2-cdf4-4f6f-9f61-248e6050227e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 20:43:52.317498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:52.317498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:52.317498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:52.317498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:52.317498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:52.317498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:52.317498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:52.317498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:52.317498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:52.317498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:52.317498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:52.317498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:52.317498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:52.317498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:52.317498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:52.318546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:52.318546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:52.318546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:52.318546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:52.318546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:52.318546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:52.318546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:52.318546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:52.318546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:52.318546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:52.318546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:52.318546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:52.318546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:52.318546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:52.318546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:52.318546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:52.318546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:52.318546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:52.319485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:52.319485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:52.319485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:52.319485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:52.319485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:52.319485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:52.319485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:52.319485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:52.319485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 20:43:52.319485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:52.319485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 454/898] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Sep 9 20:43:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:52.325120 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8e971-fc77-4e04-bbcf-7dbadef697d2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:52.446386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362246b-9da4-4a4c-b9cb-ee5b7587f5fa None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:52.446740 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362246b-9da4-4a4c-b9cb-ee5b7587f5fa None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:52.446937 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362246b-9da4-4a4c-b9cb-ee5b7587f5fa None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:52.448573 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 455/899] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:43:52.449975 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f8e971-fc77-4e04-bbcf-7dbadef697d2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:52.457411 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f85d0e-3da1-4e93-a57e-50e4c8bef568 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:52.457770 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f85d0e-3da1-4e93-a57e-50e4c8bef568 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:52.458154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f85d0e-3da1-4e93-a57e-50e4c8bef568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:52.464615 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:52.481353 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-49f85d0e-3da1-4e93-a57e-50e4c8bef568 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:52.483170 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-49f85d0e-3da1-4e93-a57e-50e4c8bef568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:52.492626 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb34d6-98ec-47dd-93f7-1b1a98d1085c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:52.493247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb34d6-98ec-47dd-93f7-1b1a98d1085c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:52.493530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb34d6-98ec-47dd-93f7-1b1a98d1085c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:52.493803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb34d6-98ec-47dd-93f7-1b1a98d1085c None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:52.494599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb34d6-98ec-47dd-93f7-1b1a98d1085c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:52.494904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb34d6-98ec-47dd-93f7-1b1a98d1085c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:52.496428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb34d6-98ec-47dd-93f7-1b1a98d1085c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:52.520581 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 445/900] 10.222.0.15 () {56 vars in 1149 bytes} [Fri Sep 9 20:43:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:52.524660 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb34d6-98ec-47dd-93f7-1b1a98d1085c None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:52.536316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:52.572175 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 456/901] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:43:52.653556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb34d6-98ec-47dd-93f7-1b1a98d1085c None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:52.691273 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc507197-9e12-4de4-b382-f324490abb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:52.691911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc507197-9e12-4de4-b382-f324490abb21 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:52.692216 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc507197-9e12-4de4-b382-f324490abb21 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:52.692494 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc507197-9e12-4de4-b382-f324490abb21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:52.728848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:52.766192 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc507197-9e12-4de4-b382-f324490abb21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:52.767658 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc507197-9e12-4de4-b382-f324490abb21 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:52.870459 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 446/902] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:43:52 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 20:43:52.874310 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f85d0e-3da1-4e93-a57e-50e4c8bef568 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:52.877129 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc507197-9e12-4de4-b382-f324490abb21 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:52.956486 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:52.990403 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f85d0e-3da1-4e93-a57e-50e4c8bef568 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:52.992258 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc507197-9e12-4de4-b382-f324490abb21 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:53.038192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82da56-d837-4e7d-aa20-f485a1d32f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:53.039234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82da56-d837-4e7d-aa20-f485a1d32f6d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:53.039515 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82da56-d837-4e7d-aa20-f485a1d32f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:53.039790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82da56-d837-4e7d-aa20-f485a1d32f6d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:53.040412 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82da56-d837-4e7d-aa20-f485a1d32f6d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:53.041775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82da56-d837-4e7d-aa20-f485a1d32f6d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:53.043589 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527bac8-ee22-4e8a-9c41-bb184205604e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:53.044524 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527bac8-ee22-4e8a-9c41-bb184205604e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:53.045023 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527bac8-ee22-4e8a-9c41-bb184205604e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:53.045512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527bac8-ee22-4e8a-9c41-bb184205604e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:53.051038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ac82da56-d837-4e7d-aa20-f485a1d32f6d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 20:43:53.051038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:53.051038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:43:53.051038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:43:53.051038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:43:53.051038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:43:53.051038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:43:53.051038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:53.051038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 20:43:53.051038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:53.051038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:43:53.051038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:53.051038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:53.051038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:53.051038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:53.051038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:53.051957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:53.051957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:53.051957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:53.051957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:53.051957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:53.051957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:53.051957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:53.051957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:43:53.051957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:43:53.051957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:43:53.051957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:43:53.051957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:53.051957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:53.051957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:53.051957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:53.051957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:53.051957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:53.052868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:53.052868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:53.052868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:53.052868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:53.052868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:53.052868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:53.052868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:53.052868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:53.052868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:53.052868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:53.052868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:43:53.052868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:53.052868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 20:43:53.052868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:53.052868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 457/903] 10.222.0.15 () {56 vars in 1132 bytes} [Fri Sep 9 20:43:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:53.059298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82da56-d837-4e7d-aa20-f485a1d32f6d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:53.064075 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527bac8-ee22-4e8a-9c41-bb184205604e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:53.066450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527bac8-ee22-4e8a-9c41-bb184205604e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:53.086167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-3527bac8-ee22-4e8a-9c41-bb184205604e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:53.086167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:53.086167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:53.086167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:53.086167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:53.086167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:53.086167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:53.086167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:53.086167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:53.086167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:53.086167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:53.086167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:53.086167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:53.086167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:53.086167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:53.086167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:53.087140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:53.087140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:53.087140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:53.087140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:53.087140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:53.087140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:53.087140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:53.087140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:53.087140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:53.087140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:53.087140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:53.087140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:53.087140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:53.087140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:53.087140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:53.087140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:53.087140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:53.088039 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:53.088039 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:53.088039 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:53.092071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 447/904] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:53.094414 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527bac8-ee22-4e8a-9c41-bb184205604e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:53.116897 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:53.191000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82da56-d837-4e7d-aa20-f485a1d32f6d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:53.207066 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527bac8-ee22-4e8a-9c41-bb184205604e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:53.226222 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:53.234795 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ce17b-3bb8-4be9-8f86-3d1785ade5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:53.235662 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ce17b-3bb8-4be9-8f86-3d1785ade5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:53.236196 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ce17b-3bb8-4be9-8f86-3d1785ade5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:53.236696 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ce17b-3bb8-4be9-8f86-3d1785ade5f6 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:53.237546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ce17b-3bb8-4be9-8f86-3d1785ade5f6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:53.238061 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ce17b-3bb8-4be9-8f86-3d1785ade5f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:53.239737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ce17b-3bb8-4be9-8f86-3d1785ade5f6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:53.244909 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d6e1c-7824-4308-a566-2f4a1cfb62be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:53.245518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d6e1c-7824-4308-a566-2f4a1cfb62be None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:53.245796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d6e1c-7824-4308-a566-2f4a1cfb62be None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:53.246067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d6e1c-7824-4308-a566-2f4a1cfb62be None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:53.246703 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d6e1c-7824-4308-a566-2f4a1cfb62be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:53.247007 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d6e1c-7824-4308-a566-2f4a1cfb62be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:53.248175 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 458/905] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Sep 9 20:43:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:53.252977 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d6e1c-7824-4308-a566-2f4a1cfb62be None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:53.253619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ce17b-3bb8-4be9-8f86-3d1785ade5f6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:53.270466 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 448/906] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:53.273290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d6e1c-7824-4308-a566-2f4a1cfb62be None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:53.386369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ce17b-3bb8-4be9-8f86-3d1785ade5f6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:53.396011 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:53.417387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d6e1c-7824-4308-a566-2f4a1cfb62be None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:53.427857 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d49ce-6496-4003-92c5-6c1dab507f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:53.428695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d49ce-6496-4003-92c5-6c1dab507f0c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:53.429039 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d49ce-6496-4003-92c5-6c1dab507f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:53.429383 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d49ce-6496-4003-92c5-6c1dab507f0c None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:53.430077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d49ce-6496-4003-92c5-6c1dab507f0c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:53.430449 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d49ce-6496-4003-92c5-6c1dab507f0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:53.432024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d49ce-6496-4003-92c5-6c1dab507f0c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:53.440132 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 459/907] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Sep 9 20:43:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:53.444642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d49ce-6496-4003-92c5-6c1dab507f0c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:53.469442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1f435-9eb1-466a-93b3-160abe978942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:53.470233 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1f435-9eb1-466a-93b3-160abe978942 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:53.470580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1f435-9eb1-466a-93b3-160abe978942 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:53.470918 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1f435-9eb1-466a-93b3-160abe978942 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:53.478484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1f435-9eb1-466a-93b3-160abe978942 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:53.480313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1f435-9eb1-466a-93b3-160abe978942 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:53.492611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-2ae1f435-9eb1-466a-93b3-160abe978942 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:53.492611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:53.492611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:53.492611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:53.492611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:53.492611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:53.492611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:53.492611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:53.492611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:53.492611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:53.492611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:53.492611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:53.492611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:53.492611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:53.492611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:53.493556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:53.493556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:53.493556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:53.493556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:53.493556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:53.493556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:53.493556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:53.493556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:53.493556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:53.493556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:53.493556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:53.493556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:53.493556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:53.493556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:53.493556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:53.493556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:53.493556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:53.494510 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:53.494510 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:53.494510 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:53.494510 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:53.494510 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:53.494510 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:53.494510 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:53.494510 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:53.494510 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 449/908] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:53.500900 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1f435-9eb1-466a-93b3-160abe978942 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:53.552382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:53.565052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d49ce-6496-4003-92c5-6c1dab507f0c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:53.610790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfaeaf-32bd-4c74-8cc3-ca31c1f13482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:53.611888 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfaeaf-32bd-4c74-8cc3-ca31c1f13482 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:53.612278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfaeaf-32bd-4c74-8cc3-ca31c1f13482 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:53.612622 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfaeaf-32bd-4c74-8cc3-ca31c1f13482 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:53.613390 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfaeaf-32bd-4c74-8cc3-ca31c1f13482 None admin] RBAC: Adding query filter params (interface=public, service_id=1788856f6d214d3ebc462f511b4dfd0d, region_id=RegionOne) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:53.613769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfaeaf-32bd-4c74-8cc3-ca31c1f13482 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:53.615224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfaeaf-32bd-4c74-8cc3-ca31c1f13482 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:53.624136 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 460/909] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Sep 9 20:43:53 2022] GET /identity/v3/endpoints?service_id=1788856f6d214d3ebc462f511b4dfd0d&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:53.629196 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfaeaf-32bd-4c74-8cc3-ca31c1f13482 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:53.635357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1f435-9eb1-466a-93b3-160abe978942 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:53.671385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8906fe-45d3-44c5-ab82-5049e05e39ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:53.672064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8906fe-45d3-44c5-ab82-5049e05e39ac None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:53.672351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8906fe-45d3-44c5-ab82-5049e05e39ac None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:53.672701 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8906fe-45d3-44c5-ab82-5049e05e39ac None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:53.673312 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8906fe-45d3-44c5-ab82-5049e05e39ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:53.673619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8906fe-45d3-44c5-ab82-5049e05e39ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:53.675102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8906fe-45d3-44c5-ab82-5049e05e39ac None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:53.678133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:53.694246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 450/910] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:53.695201 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8906fe-45d3-44c5-ab82-5049e05e39ac None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:53.769724 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfaeaf-32bd-4c74-8cc3-ca31c1f13482 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:53.801458 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:53.805788 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8906fe-45d3-44c5-ab82-5049e05e39ac None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:53.819329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd88e8-3147-49bc-af08-a810b6156930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:53.820513 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd88e8-3147-49bc-af08-a810b6156930 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:53.820955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd88e8-3147-49bc-af08-a810b6156930 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:53.821378 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd88e8-3147-49bc-af08-a810b6156930 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:53.822391 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd88e8-3147-49bc-af08-a810b6156930 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:53.824721 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd88e8-3147-49bc-af08-a810b6156930 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:53.840546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 461/911] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Sep 9 20:43:53 2022] GET /identity/v3/services => generated 1497 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:43:53.853863 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8a6c1-46d4-45fc-8da8-2596d2e56a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:53.854497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8a6c1-46d4-45fc-8da8-2596d2e56a07 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:53.854781 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8a6c1-46d4-45fc-8da8-2596d2e56a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:53.855058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8a6c1-46d4-45fc-8da8-2596d2e56a07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:53.856012 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8a6c1-46d4-45fc-8da8-2596d2e56a07 None admin] RBAC: Adding query filter params (role.id=5e8e8a438e704946842357d01ab848a8, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=e51ae6959aac49898e75c6786c5dbdf2) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:53.856384 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8a6c1-46d4-45fc-8da8-2596d2e56a07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:53.858534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8a6c1-46d4-45fc-8da8-2596d2e56a07 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:53.865644 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 451/912] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:43:53 2022] GET /identity/v3/role_assignments?user.id=e51ae6959aac49898e75c6786c5dbdf2&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=5e8e8a438e704946842357d01ab848a8 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:54.211795 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45890b47-df0a-446a-b514-860af92d6e80 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:54.212220 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45890b47-df0a-446a-b514-860af92d6e80 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:54.212414 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45890b47-df0a-446a-b514-860af92d6e80 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:54.213961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 462/913] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:54.219373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acf161-7325-4f7b-b52a-a76a8d423f29 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:54.219665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acf161-7325-4f7b-b52a-a76a8d423f29 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:54.219942 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acf161-7325-4f7b-b52a-a76a8d423f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:54.239474 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-51acf161-7325-4f7b-b52a-a76a8d423f29 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:54.240705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-51acf161-7325-4f7b-b52a-a76a8d423f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:54.315153 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 452/914] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:43:54.442673 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422a81e-b8de-492a-a20f-e634944b7988 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:54.443217 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422a81e-b8de-492a-a20f-e634944b7988 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:54.443217 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422a81e-b8de-492a-a20f-e634944b7988 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:54.444843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 463/915] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:54.450038 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccc87c-6983-438d-8c9d-d68792ea6c95 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:54.450330 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccc87c-6983-438d-8c9d-d68792ea6c95 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:54.450779 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccc87c-6983-438d-8c9d-d68792ea6c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:54.469714 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-78ccc87c-6983-438d-8c9d-d68792ea6c95 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:54.470839 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-78ccc87c-6983-438d-8c9d-d68792ea6c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:54.544126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 453/916] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 20:43:54.600281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422a81e-b8de-492a-a20f-e634944b7988 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:54.703936 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:54.709288 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422a81e-b8de-492a-a20f-e634944b7988 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:54.744833 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50c5eb-c39c-4f81-9508-0309909c2f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:54.745702 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50c5eb-c39c-4f81-9508-0309909c2f94 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:54.746140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50c5eb-c39c-4f81-9508-0309909c2f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:54.746587 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50c5eb-c39c-4f81-9508-0309909c2f94 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:54.747344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50c5eb-c39c-4f81-9508-0309909c2f94 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:54.749183 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50c5eb-c39c-4f81-9508-0309909c2f94 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:54.758205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-df50c5eb-c39c-4f81-9508-0309909c2f94 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 20:43:54.758205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:54.758205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:43:54.758205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:43:54.758205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:43:54.758205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:43:54.758205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:43:54.758205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:54.758205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 20:43:54.758205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:54.758205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:43:54.758205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:54.758205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:54.758205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:54.758205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:54.758205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:54.758205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:54.759386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:54.759386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:54.759386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:54.759386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:54.759386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:54.759386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:54.759386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:43:54.759386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:43:54.759386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:43:54.759386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:43:54.759386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:54.759386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:54.759386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:54.759386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:54.759386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:54.759386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:54.760540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:54.760540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:54.760540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:54.760540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:54.760540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:54.760540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:54.760540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:54.760540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:54.760540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:54.760540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:54.760540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:43:54.760540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:54.760540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 09 20:43:54.760540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:54.762827 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 464/917] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:43:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:54.769953 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccc87c-6983-438d-8c9d-d68792ea6c95 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:54.798059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:54.813207 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50c5eb-c39c-4f81-9508-0309909c2f94 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:54.903575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccc87c-6983-438d-8c9d-d68792ea6c95 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:54.935501 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50c5eb-c39c-4f81-9508-0309909c2f94 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:54.947387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efa6b6-22e2-4e53-81e9-589cbdaa3ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:54.948548 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efa6b6-22e2-4e53-81e9-589cbdaa3ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:54.949278 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efa6b6-22e2-4e53-81e9-589cbdaa3ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:54.949720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efa6b6-22e2-4e53-81e9-589cbdaa3ea5 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:54.951025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efa6b6-22e2-4e53-81e9-589cbdaa3ea5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:54.951641 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efa6b6-22e2-4e53-81e9-589cbdaa3ea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:54.953869 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efa6b6-22e2-4e53-81e9-589cbdaa3ea5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:54.959968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 454/918] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:43:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:54.964982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efa6b6-22e2-4e53-81e9-589cbdaa3ea5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:54.974585 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64587e4-b76f-40b8-a0bd-66b87c88dd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:54.975329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64587e4-b76f-40b8-a0bd-66b87c88dd8c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:54.975704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64587e4-b76f-40b8-a0bd-66b87c88dd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:54.976119 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64587e4-b76f-40b8-a0bd-66b87c88dd8c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:54.976810 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64587e4-b76f-40b8-a0bd-66b87c88dd8c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:54.978254 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64587e4-b76f-40b8-a0bd-66b87c88dd8c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:54.988113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a64587e4-b76f-40b8-a0bd-66b87c88dd8c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 20:43:54.988113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:54.988113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:43:54.988113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:43:54.988113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:43:54.988113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:43:54.988113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:43:54.988113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:54.988113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 20:43:54.988113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:54.988113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:43:54.988113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:54.988113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:54.988113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:54.988113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:54.988113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:54.988113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:54.989305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:54.989305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:54.989305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:54.989305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:54.989305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:54.989305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:54.989305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:43:54.989305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:43:54.989305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:43:54.989305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:43:54.989305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:54.989305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:54.989305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:54.989305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:54.989305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:54.989305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:54.990316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:54.990316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:54.990316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:54.990316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:54.990316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:54.990316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:54.990316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:54.990316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:54.990316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:54.990316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:54.990316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:43:54.990316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:54.990316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 20:43:54.990316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:54.996431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 465/919] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Sep 9 20:43:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:43:54.998640 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64587e4-b76f-40b8-a0bd-66b87c88dd8c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:55.031681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:55.083026 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:55.103116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efa6b6-22e2-4e53-81e9-589cbdaa3ea5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:55.117606 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64587e4-b76f-40b8-a0bd-66b87c88dd8c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:55.142215 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa55f6-7f5b-429e-a8fe-1430779a1fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:55.142940 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa55f6-7f5b-429e-a8fe-1430779a1fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:55.143287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa55f6-7f5b-429e-a8fe-1430779a1fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:55.143652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa55f6-7f5b-429e-a8fe-1430779a1fb1 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:55.144393 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa55f6-7f5b-429e-a8fe-1430779a1fb1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:55.144764 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa55f6-7f5b-429e-a8fe-1430779a1fb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:55.146213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa55f6-7f5b-429e-a8fe-1430779a1fb1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:55.152264 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 455/920] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Sep 9 20:43:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:55.154782 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7de21-8380-4551-942a-de35932bb16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:55.155397 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7de21-8380-4551-942a-de35932bb16e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:55.155675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7de21-8380-4551-942a-de35932bb16e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:55.155948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7de21-8380-4551-942a-de35932bb16e None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:55.156614 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7de21-8380-4551-942a-de35932bb16e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:55.156915 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7de21-8380-4551-942a-de35932bb16e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:55.158360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7de21-8380-4551-942a-de35932bb16e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:55.158690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa55f6-7f5b-429e-a8fe-1430779a1fb1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:55.168383 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 466/921] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Sep 9 20:43:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:55.170546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7de21-8380-4551-942a-de35932bb16e None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:55.270588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:55.281551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7de21-8380-4551-942a-de35932bb16e None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:55.314884 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa55f6-7f5b-429e-a8fe-1430779a1fb1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:55.322559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55dbb26-37aa-4195-854a-49c89117e9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:55.323222 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55dbb26-37aa-4195-854a-49c89117e9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:55.323509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55dbb26-37aa-4195-854a-49c89117e9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:55.323786 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55dbb26-37aa-4195-854a-49c89117e9c1 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:55.324465 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55dbb26-37aa-4195-854a-49c89117e9c1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:55.324776 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55dbb26-37aa-4195-854a-49c89117e9c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:55.326811 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55dbb26-37aa-4195-854a-49c89117e9c1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:55.336392 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 467/922] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Sep 9 20:43:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:55.338333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55dbb26-37aa-4195-854a-49c89117e9c1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:55.356848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e302efe-5431-4f63-92ef-7d4c522fe2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:55.357966 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e302efe-5431-4f63-92ef-7d4c522fe2e5 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:55.358452 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e302efe-5431-4f63-92ef-7d4c522fe2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:55.358975 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e302efe-5431-4f63-92ef-7d4c522fe2e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:55.359860 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e302efe-5431-4f63-92ef-7d4c522fe2e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:55.361566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e302efe-5431-4f63-92ef-7d4c522fe2e5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:55.383822 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 456/923] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:43:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:43:55.459584 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55dbb26-37aa-4195-854a-49c89117e9c1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:55.505196 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a01d95-9800-43ab-8bb8-8e8fdb0f960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:55.506219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a01d95-9800-43ab-8bb8-8e8fdb0f960e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:55.506701 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a01d95-9800-43ab-8bb8-8e8fdb0f960e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:55.507174 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a01d95-9800-43ab-8bb8-8e8fdb0f960e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:55.508116 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a01d95-9800-43ab-8bb8-8e8fdb0f960e None admin] RBAC: Adding query filter params (interface=public, service_id=0701746e865a4d768671fcbd656c4dee, region_id=RegionOne) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:55.508631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a01d95-9800-43ab-8bb8-8e8fdb0f960e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:55.510305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a01d95-9800-43ab-8bb8-8e8fdb0f960e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:55.517605 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 468/924] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Sep 9 20:43:55 2022] GET /identity/v3/endpoints?service_id=0701746e865a4d768671fcbd656c4dee&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:55.528195 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e302efe-5431-4f63-92ef-7d4c522fe2e5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:55.538405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:55.676890 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e302efe-5431-4f63-92ef-7d4c522fe2e5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:55.715667 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c2dd5-244c-4237-97ff-77a8329e3aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:55.716886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c2dd5-244c-4237-97ff-77a8329e3aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:55.717397 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c2dd5-244c-4237-97ff-77a8329e3aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:55.717782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c2dd5-244c-4237-97ff-77a8329e3aa5 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:55.718400 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c2dd5-244c-4237-97ff-77a8329e3aa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:55.719854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c2dd5-244c-4237-97ff-77a8329e3aa5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:55.728868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 457/925] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Sep 9 20:43:55 2022] GET /identity/v3/services => generated 1497 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:43:56.135085 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77233d13-cf0a-423b-b808-cd51f985754a None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:56.135504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77233d13-cf0a-423b-b808-cd51f985754a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:56.135685 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77233d13-cf0a-423b-b808-cd51f985754a None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:56.137273 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 469/926] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:56.142761 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbf98f-a82d-4044-8d2f-d5db292b4948 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:56.143220 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbf98f-a82d-4044-8d2f-d5db292b4948 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:56.143305 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbf98f-a82d-4044-8d2f-d5db292b4948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:56.162754 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d8cbf98f-a82d-4044-8d2f-d5db292b4948 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:56.163968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d8cbf98f-a82d-4044-8d2f-d5db292b4948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:56.202850 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964904e-cb41-4f61-9c84-08fdaedb8109 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:56.202850 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964904e-cb41-4f61-9c84-08fdaedb8109 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:56.203104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964904e-cb41-4f61-9c84-08fdaedb8109 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:56.204628 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 470/927] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:43:56.209840 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eba435-6df0-4ce1-a86e-9a134b72c3ea None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:56.210009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eba435-6df0-4ce1-a86e-9a134b72c3ea None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:56.210241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eba435-6df0-4ce1-a86e-9a134b72c3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:56.230318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-32eba435-6df0-4ce1-a86e-9a134b72c3ea None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:56.231531 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-32eba435-6df0-4ce1-a86e-9a134b72c3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:56.241961 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:56.247229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 458/928] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:43:56.247627 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:56.309532 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 471/929] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 20:43:56.524665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbf98f-a82d-4044-8d2f-d5db292b4948 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:56.596036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eba435-6df0-4ce1-a86e-9a134b72c3ea None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:56.648692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbf98f-a82d-4044-8d2f-d5db292b4948 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:56.685609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c4188-ae7a-47ac-9cac-857a89120cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:56.686645 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c4188-ae7a-47ac-9cac-857a89120cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:56.687134 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c4188-ae7a-47ac-9cac-857a89120cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:56.687634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c4188-ae7a-47ac-9cac-857a89120cf1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:56.688493 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c4188-ae7a-47ac-9cac-857a89120cf1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:56.690169 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c4188-ae7a-47ac-9cac-857a89120cf1 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:56.701671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-725c4188-ae7a-47ac-9cac-857a89120cf1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 20:43:56.701671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:56.701671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:43:56.701671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:43:56.701671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:43:56.701671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:43:56.701671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:43:56.701671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:56.701671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 20:43:56.701671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:56.701671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:43:56.701671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:56.701671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:56.701671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:56.701671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:56.701671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:56.702627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:56.702627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:56.702627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:56.702627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:56.702627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:56.702627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:56.702627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:56.702627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:43:56.702627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:43:56.702627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:43:56.702627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:43:56.702627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:56.702627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:56.702627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:56.702627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:56.702627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:56.702627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:56.703523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:56.703523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:56.703523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:56.703523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:56.703523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:56.703523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:56.703523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:56.703523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:56.703523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:56.703523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:56.703523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:43:56.703523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:56.703523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 09 20:43:56.703523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:56.710876 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 459/930] 10.222.0.15 () {56 vars in 1132 bytes} [Fri Sep 9 20:43:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:56.711958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c4188-ae7a-47ac-9cac-857a89120cf1 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:56.717482 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eba435-6df0-4ce1-a86e-9a134b72c3ea None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:56.759512 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2492b8-510c-444d-b606-052610aae061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:56.760708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2492b8-510c-444d-b606-052610aae061 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:56.761009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2492b8-510c-444d-b606-052610aae061 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:56.761262 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2492b8-510c-444d-b606-052610aae061 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:56.774245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2492b8-510c-444d-b606-052610aae061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:43:56.781439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-fd2492b8-510c-444d-b606-052610aae061 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 20:43:56.781439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:56.781439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:56.781439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:56.781439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:56.781439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:56.781439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:56.781439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:56.781439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:56.781439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:56.781439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:56.781439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:56.781439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:43:56.781439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:43:56.781439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:43:56.781439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:43:56.782345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:43:56.782345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:43:56.782345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:43:56.782345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:43:56.782345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:56.782345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:56.782345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:56.782345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:56.782345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:56.782345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:56.782345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:56.782345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:56.782345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:56.782345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:56.782345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:56.782345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:56.783203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:56.783203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:56.783203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:56.783203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:56.783203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:43:56.783203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:43:56.783203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:43:56.783203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:43:56.783203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:43:56.783203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:43:56.783203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 20:43:56.783203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:56.787635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 472/931] 10.222.0.15 () {56 vars in 1120 bytes} [Fri Sep 9 20:43:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:56.789149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:56.789263 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2492b8-510c-444d-b606-052610aae061 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:56.796347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:56.834655 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c4188-ae7a-47ac-9cac-857a89120cf1 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:56.871638 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e55f4-e6a3-4ea0-90fb-c99da7199855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:56.873321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e55f4-e6a3-4ea0-90fb-c99da7199855 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:56.874075 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e55f4-e6a3-4ea0-90fb-c99da7199855 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:56.874554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e55f4-e6a3-4ea0-90fb-c99da7199855 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:56.875383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e55f4-e6a3-4ea0-90fb-c99da7199855 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:56.875893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e55f4-e6a3-4ea0-90fb-c99da7199855 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:56.877722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e55f4-e6a3-4ea0-90fb-c99da7199855 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:56.887755 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 460/932] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Sep 9 20:43:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:56.889744 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e55f4-e6a3-4ea0-90fb-c99da7199855 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:56.911312 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2492b8-510c-444d-b606-052610aae061 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:56.952073 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf1f1d-61f8-491c-9f35-1a3108d6be15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:56.953131 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf1f1d-61f8-491c-9f35-1a3108d6be15 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:56.953419 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf1f1d-61f8-491c-9f35-1a3108d6be15 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:56.953695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf1f1d-61f8-491c-9f35-1a3108d6be15 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:56.954713 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf1f1d-61f8-491c-9f35-1a3108d6be15 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:56.955023 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf1f1d-61f8-491c-9f35-1a3108d6be15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:56.956550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf1f1d-61f8-491c-9f35-1a3108d6be15 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:56.972297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 473/933] 10.222.0.15 () {56 vars in 1115 bytes} [Fri Sep 9 20:43:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:56.974138 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf1f1d-61f8-491c-9f35-1a3108d6be15 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:57.006905 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e55f4-e6a3-4ea0-90fb-c99da7199855 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:57.046834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:57.056088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:57.061738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29269098-7c65-4de2-8439-794433af82e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:57.063246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29269098-7c65-4de2-8439-794433af82e2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:57.063546 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29269098-7c65-4de2-8439-794433af82e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:57.063828 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29269098-7c65-4de2-8439-794433af82e2 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:57.064544 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29269098-7c65-4de2-8439-794433af82e2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:57.064854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29269098-7c65-4de2-8439-794433af82e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:57.066240 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29269098-7c65-4de2-8439-794433af82e2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:57.072902 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 461/934] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Sep 9 20:43:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:57.078691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29269098-7c65-4de2-8439-794433af82e2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:57.100048 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf1f1d-61f8-491c-9f35-1a3108d6be15 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:57.137018 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7446c97-03d6-44f8-aa4e-e84c34943900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:57.137651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7446c97-03d6-44f8-aa4e-e84c34943900 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:57.138463 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7446c97-03d6-44f8-aa4e-e84c34943900 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:57.138738 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7446c97-03d6-44f8-aa4e-e84c34943900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:57.151711 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7446c97-03d6-44f8-aa4e-e84c34943900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:57.153293 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7446c97-03d6-44f8-aa4e-e84c34943900 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:57.171544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-a7446c97-03d6-44f8-aa4e-e84c34943900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:57.171544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:57.171544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:57.171544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:57.171544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:57.171544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:57.171544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:57.171544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:57.171544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:57.171544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:57.171544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:57.171544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:57.171544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:57.171544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:57.171544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:57.171544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:57.172644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:57.172644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:57.172644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:57.172644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:57.172644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:57.172644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:57.172644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:57.172644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:57.172644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:57.172644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:57.172644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:57.172644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:57.172644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:57.172644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:57.172644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:57.172644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:57.172644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:57.173532 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:57.173532 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:57.173532 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:57.177450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 474/935] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:57.178589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7446c97-03d6-44f8-aa4e-e84c34943900 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:57.194535 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29269098-7c65-4de2-8439-794433af82e2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:57.233108 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526c825-85c9-443b-af1b-d51a30f52942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:57.234068 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526c825-85c9-443b-af1b-d51a30f52942 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:57.234555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526c825-85c9-443b-af1b-d51a30f52942 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:57.235051 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526c825-85c9-443b-af1b-d51a30f52942 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:57.236017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526c825-85c9-443b-af1b-d51a30f52942 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:57.237770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526c825-85c9-443b-af1b-d51a30f52942 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:57.264337 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 462/936] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:43:57 2022] POST /identity/v3/endpoints => generated 347 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:43:57.296468 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7446c97-03d6-44f8-aa4e-e84c34943900 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:57.316889 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:57.344292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee5a24-478d-4b46-b422-4e1953dedef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:57.344924 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee5a24-478d-4b46-b422-4e1953dedef2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:57.345258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee5a24-478d-4b46-b422-4e1953dedef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:57.345534 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee5a24-478d-4b46-b422-4e1953dedef2 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:57.346193 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee5a24-478d-4b46-b422-4e1953dedef2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:57.346496 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee5a24-478d-4b46-b422-4e1953dedef2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:57.347941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee5a24-478d-4b46-b422-4e1953dedef2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:57.364659 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 475/937] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:57.370495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526c825-85c9-443b-af1b-d51a30f52942 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:57.432671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:57.494989 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526c825-85c9-443b-af1b-d51a30f52942 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:57.532111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f02d1b-7e4b-4936-a742-f4979de7fdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:57.532763 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f02d1b-7e4b-4936-a742-f4979de7fdcb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:57.533050 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f02d1b-7e4b-4936-a742-f4979de7fdcb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:57.533330 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f02d1b-7e4b-4936-a742-f4979de7fdcb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:57.541618 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f02d1b-7e4b-4936-a742-f4979de7fdcb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:57.543095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f02d1b-7e4b-4936-a742-f4979de7fdcb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:57.555557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-55f02d1b-7e4b-4936-a742-f4979de7fdcb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 20:43:57.555557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:57.555557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:57.555557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:57.555557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:57.555557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:57.555557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:57.555557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:57.555557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:57.555557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:57.555557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:57.555557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:57.555557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:43:57.555557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:43:57.555557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:43:57.555557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:43:57.556680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:57.556680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:57.556680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:43:57.556680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:57.556680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:43:57.556680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:43:57.556680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:57.556680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:57.556680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:57.556680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:57.556680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:57.556680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:57.556680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:57.556680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:57.556680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:57.556680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:57.556680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:57.556680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:57.557609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:57.557609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:57.557609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:43:57.557609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:43:57.557609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:43:57.557609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:43:57.557609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:43:57.557609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:43:57.557609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 20:43:57.557609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:57.557609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 463/938] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Sep 9 20:43:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:57.565102 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee5a24-478d-4b46-b422-4e1953dedef2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:57.676591 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee5a24-478d-4b46-b422-4e1953dedef2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:57.715259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a9c044-ad0f-43be-a5f4-f4c7a41dd937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:57.716430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9c044-ad0f-43be-a5f4-f4c7a41dd937 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:57.717226 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9c044-ad0f-43be-a5f4-f4c7a41dd937 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:57.717943 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a9c044-ad0f-43be-a5f4-f4c7a41dd937 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:57.719477 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a9c044-ad0f-43be-a5f4-f4c7a41dd937 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:57.720202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a9c044-ad0f-43be-a5f4-f4c7a41dd937 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:57.721851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a9c044-ad0f-43be-a5f4-f4c7a41dd937 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:57.742428 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 476/939] 10.222.0.15 () {56 vars in 1149 bytes} [Fri Sep 9 20:43:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:57.749016 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f02d1b-7e4b-4936-a742-f4979de7fdcb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:57.868872 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f02d1b-7e4b-4936-a742-f4979de7fdcb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:57.879728 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:57.897867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ea2aa-b325-4b17-8889-8d707ceb2db0 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:57.898190 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ea2aa-b325-4b17-8889-8d707ceb2db0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:57.898432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ea2aa-b325-4b17-8889-8d707ceb2db0 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:57.899886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 477/940] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:43:57.916366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a79c00-23bf-460f-9cc8-1bc5df2a3872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:57.916366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a79c00-23bf-460f-9cc8-1bc5df2a3872 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:57.916366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a79c00-23bf-460f-9cc8-1bc5df2a3872 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:57.916366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a79c00-23bf-460f-9cc8-1bc5df2a3872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:57.918202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3b84b-1f98-4687-801e-dab6f9f12b74 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:57.918490 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3b84b-1f98-4687-801e-dab6f9f12b74 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:57.918765 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3b84b-1f98-4687-801e-dab6f9f12b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:57.931852 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a79c00-23bf-460f-9cc8-1bc5df2a3872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:57.934161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a79c00-23bf-460f-9cc8-1bc5df2a3872 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:57.937367 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-25a3b84b-1f98-4687-801e-dab6f9f12b74 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:57.938586 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-25a3b84b-1f98-4687-801e-dab6f9f12b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:57.957159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-14a79c00-23bf-460f-9cc8-1bc5df2a3872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:57.957159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:57.957159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:57.957159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:57.957159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:57.957159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:57.957159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:57.957159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:57.957159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:57.957159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:57.957159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:57.957159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:57.957159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:43:57.957159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:43:57.957159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:43:57.957159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:43:57.958186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:57.958186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:57.958186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:57.958186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:57.958186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:57.958186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:57.958186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:57.958186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:57.958186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:57.958186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:57.958186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:57.958186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:57.958186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:57.958186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:57.958186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:57.958186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:57.958186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:43:57.959072 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:43:57.959072 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:43:57.959072 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:57.962108 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 464/941] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:57.968947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a79c00-23bf-460f-9cc8-1bc5df2a3872 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:57.972016 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:58.024287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 478/942] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 20:43:58.065863 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57dec8-fed2-4196-81ec-ffeb6946f2b0 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:58.066205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57dec8-fed2-4196-81ec-ffeb6946f2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:58.066408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57dec8-fed2-4196-81ec-ffeb6946f2b0 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:58.068017 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 479/943] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:43:58.073168 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1f555-bc42-4894-9909-54bd1d6e2c83 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:58.073448 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1f555-bc42-4894-9909-54bd1d6e2c83 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:58.073717 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1f555-bc42-4894-9909-54bd1d6e2c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:58.080450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a79c00-23bf-460f-9cc8-1bc5df2a3872 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:58.093054 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-26b1f555-bc42-4894-9909-54bd1d6e2c83 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:58.094244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-26b1f555-bc42-4894-9909-54bd1d6e2c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:58.117381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaf914-1f4e-4f36-8b4b-f8ccbbee1b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:58.118139 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaf914-1f4e-4f36-8b4b-f8ccbbee1b52 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:58.118525 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaf914-1f4e-4f36-8b4b-f8ccbbee1b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:58.118811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaf914-1f4e-4f36-8b4b-f8ccbbee1b52 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:58.119681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcaf914-1f4e-4f36-8b4b-f8ccbbee1b52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:58.119944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcaf914-1f4e-4f36-8b4b-f8ccbbee1b52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:58.121461 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcaf914-1f4e-4f36-8b4b-f8ccbbee1b52 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:58.139834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 465/944] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:43:58.141009 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaf914-1f4e-4f36-8b4b-f8ccbbee1b52 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:58.167169 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 480/945] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:43:58.167721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:58.255064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaf914-1f4e-4f36-8b4b-f8ccbbee1b52 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:58.300583 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83976bb0-bba8-4b3b-b9db-a32268e5b809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:58.301281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83976bb0-bba8-4b3b-b9db-a32268e5b809 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:58.301565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83976bb0-bba8-4b3b-b9db-a32268e5b809 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:58.301837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83976bb0-bba8-4b3b-b9db-a32268e5b809 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:58.307392 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1f555-bc42-4894-9909-54bd1d6e2c83 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:58.308934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83976bb0-bba8-4b3b-b9db-a32268e5b809 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:58.310445 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83976bb0-bba8-4b3b-b9db-a32268e5b809 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:58.323624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-83976bb0-bba8-4b3b-b9db-a32268e5b809 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:58.323624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:58.323624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:58.323624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:58.323624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:58.323624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:58.323624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:58.323624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:58.323624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:58.323624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:58.323624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:58.323624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:58.323624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:58.323624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:58.323624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:58.324557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:58.324557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:58.324557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:58.324557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:58.324557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:58.324557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:58.324557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:58.324557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:58.324557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:58.324557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:58.324557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:58.324557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:58.324557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:58.324557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:58.324557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:58.324557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:58.324557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:58.325451 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:58.325451 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:58.325451 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:58.325451 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:58.325451 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:58.325451 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:58.325451 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:58.325451 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:58.325451 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 466/946] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:43:58.332060 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83976bb0-bba8-4b3b-b9db-a32268e5b809 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:58.413244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:58.424398 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1f555-bc42-4894-9909-54bd1d6e2c83 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:58.441464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:58.465172 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8bfdc-90d5-4393-9280-575086abb9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:58.465799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8bfdc-90d5-4393-9280-575086abb9e5 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:58.466136 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8bfdc-90d5-4393-9280-575086abb9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:58.466372 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8bfdc-90d5-4393-9280-575086abb9e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:58.467021 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8bfdc-90d5-4393-9280-575086abb9e5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:58.468473 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8bfdc-90d5-4393-9280-575086abb9e5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:58.469777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83976bb0-bba8-4b3b-b9db-a32268e5b809 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:58.471050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: WARNING keystone.server.flask.common [None req-18e8bfdc-90d5-4393-9280-575086abb9e5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 09 20:43:58.492535 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.sql.core [None req-18e8bfdc-90d5-4393-9280-575086abb9e5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 20:43:58.492535 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 20:43:58.492535 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [parameters: {'id': 'dbeee13800f34f6ba626cd575924a26c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 20:43:58.492535 dv-cinder-831247-28-smb devstack@keystone.service[81397]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81397) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 20:43:58.508011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b7983-2140-4e81-8cc9-a9fbc502cda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:58.508655 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b7983-2140-4e81-8cc9-a9fbc502cda5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:58.508939 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b7983-2140-4e81-8cc9-a9fbc502cda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:58.509214 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b7983-2140-4e81-8cc9-a9fbc502cda5 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:58.509905 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b7983-2140-4e81-8cc9-a9fbc502cda5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:58.510217 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b7983-2140-4e81-8cc9-a9fbc502cda5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:58.510707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-18e8bfdc-90d5-4393-9280-575086abb9e5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dbeee13800f34f6ba626cd575924a26c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dbeee13800f34f6ba626cd575924a26c. Sep 09 20:43:58.510707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:58.510707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 20:43:58.510707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 20:43:58.510707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 20:43:58.510707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 20:43:58.510707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 20:43:58.510707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 20:43:58.510707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 20:43:58.510707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application conn.query(q) Sep 09 20:43:58.510707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 20:43:58.510707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 20:43:58.510707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 20:43:58.511474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result.read() Sep 09 20:43:58.511474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 20:43:58.511474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 20:43:58.511474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 20:43:58.511474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 20:43:58.511474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 20:43:58.511474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 20:43:58.511474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 20:43:58.511474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 20:43:58.511474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 20:43:58.511474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:58.511474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 20:43:58.511474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:58.511474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:58.511474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 20:43:58.511474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 20:43:58.511474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 09 20:43:58.511474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 09 20:43:58.512737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 20:43:58.512737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application next(self.gen) Sep 09 20:43:58.512737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 20:43:58.512737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application yield resource Sep 09 20:43:58.512737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 20:43:58.512737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application next(self.gen) Sep 09 20:43:58.512737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 20:43:58.512737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 20:43:58.512737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 20:43:58.512737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 20:43:58.512737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 20:43:58.512737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise self.value Sep 09 20:43:58.512737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 20:43:58.512737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 20:43:58.512737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 20:43:58.512737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application session.commit() Sep 09 20:43:58.512737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 20:43:58.514752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 20:43:58.514752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 20:43:58.514752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 20:43:58.514752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 20:43:58.514752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.session.flush() Sep 09 20:43:58.514752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 20:43:58.514752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 20:43:58.514752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 20:43:58.514752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 20:43:58.514752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 20:43:58.514752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application compat.raise_( Sep 09 20:43:58.514752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 20:43:58.514752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception Sep 09 20:43:58.514752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 20:43:58.514752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 20:43:58.514752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 20:43:58.514752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 20:43:58.516618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 20:43:58.516618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 20:43:58.516618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 20:43:58.516618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 20:43:58.516618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 09 20:43:58.516618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 09 20:43:58.516618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 20:43:58.516618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 20:43:58.516618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 20:43:58.516618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 20:43:58.516618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 20:43:58.516618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 20:43:58.516618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 20:43:58.516618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 20:43:58.516618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 20:43:58.518777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 20:43:58.518777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 20:43:58.518777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception Sep 09 20:43:58.518777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 20:43:58.518777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 20:43:58.518777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 20:43:58.518777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 20:43:58.518777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 20:43:58.518777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 20:43:58.518777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 20:43:58.518777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application conn.query(q) Sep 09 20:43:58.518777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 20:43:58.518777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 20:43:58.518777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 20:43:58.518777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application result.read() Sep 09 20:43:58.518777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 20:43:58.518777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 20:43:58.521000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 20:43:58.521000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 20:43:58.521000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 20:43:58.521000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 20:43:58.521000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 20:43:58.521000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 20:43:58.521000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 09 20:43:58.521000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 09 20:43:58.521000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [parameters: {'id': 'dbeee13800f34f6ba626cd575924a26c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 09 20:43:58.521000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 20:43:58.521000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:58.521000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:43:58.521000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:58.521000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:58.521000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 09 20:43:58.523927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 09 20:43:58.523927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 20:43:58.523927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 20:43:58.523927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 09 20:43:58.523927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:58.523927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:43:58.523927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:58.523927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:58.523927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:58.523927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:58.523927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:58.523927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:58.523927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:58.523927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:58.523927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:58.523927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:58.523927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:58.526452 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:58.526452 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 09 20:43:58.526452 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 09 20:43:58.526452 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:58.526452 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:58.526452 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 09 20:43:58.526452 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 09 20:43:58.526452 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dbeee13800f34f6ba626cd575924a26c. Sep 09 20:43:58.526452 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:58.527586 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b7983-2140-4e81-8cc9-a9fbc502cda5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:58.527730 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 481/947] 10.222.0.15 () {60 vars in 1140 bytes} [Fri Sep 9 20:43:58 2022] POST /identity/v3/projects => generated 262 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:43:58.527730 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8bfdc-90d5-4393-9280-575086abb9e5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:58.536031 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 467/948] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:43:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:58.536031 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b7983-2140-4e81-8cc9-a9fbc502cda5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:58.629666 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8bfdc-90d5-4393-9280-575086abb9e5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:58.640552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b7983-2140-4e81-8cc9-a9fbc502cda5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:58.667041 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2cd1c-5367-4f38-8c49-effd15f0473f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:58.667606 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2cd1c-5367-4f38-8c49-effd15f0473f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:58.667890 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2cd1c-5367-4f38-8c49-effd15f0473f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:58.668480 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2cd1c-5367-4f38-8c49-effd15f0473f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:58.668850 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2cd1c-5367-4f38-8c49-effd15f0473f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:58.670974 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2cd1c-5367-4f38-8c49-effd15f0473f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:58.677154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386d06d-071a-4a73-afcd-2e53f8a8bd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:58.677782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386d06d-071a-4a73-afcd-2e53f8a8bd93 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:58.678059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386d06d-071a-4a73-afcd-2e53f8a8bd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:58.678329 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386d06d-071a-4a73-afcd-2e53f8a8bd93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:58.680114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-67a2cd1c-5367-4f38-8c49-effd15f0473f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 20:43:58.680114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:58.680114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:43:58.680114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:43:58.680114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:43:58.680114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:43:58.680114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:43:58.680114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:58.680114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 20:43:58.680114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:58.680114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:43:58.680114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:58.680114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:58.680114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:58.680114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:58.680114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:58.680114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:58.681486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:58.681486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:58.681486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:58.681486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:58.681486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:58.681486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:58.681486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:43:58.681486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:43:58.681486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:43:58.681486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:43:58.681486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:58.681486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:58.681486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:58.681486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:58.681486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:58.681486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:58.682325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:58.682325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:58.682325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:58.682325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:58.682325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:58.682325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:58.682325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:58.682325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:58.682325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:58.682325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:58.682325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:43:58.682325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:43:58.682325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 20:43:58.682325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:43:58.682325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 482/949] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Sep 9 20:43:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:58.683141 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2cd1c-5367-4f38-8c49-effd15f0473f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:58.692012 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386d06d-071a-4a73-afcd-2e53f8a8bd93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:58.693711 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386d06d-071a-4a73-afcd-2e53f8a8bd93 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:58.696492 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:58.698543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:58.707074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-5386d06d-071a-4a73-afcd-2e53f8a8bd93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:58.707074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:43:58.707074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:43:58.707074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:43:58.707074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:43:58.707074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:43:58.707074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:43:58.707074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:43:58.707074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:43:58.707074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:43:58.707074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:43:58.707074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:43:58.707074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:43:58.707074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:43:58.707074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:43:58.707968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:43:58.707968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:43:58.707968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:43:58.707968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:43:58.707968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:43:58.707968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:43:58.707968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:43:58.707968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:43:58.707968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:43:58.707968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:43:58.707968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:43:58.707968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:43:58.707968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:43:58.707968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:43:58.707968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:43:58.707968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:43:58.707968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:43:58.708927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:43:58.708927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:43:58.708927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:43:58.708927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:43:58.708927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:43:58.708927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:43:58.708927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:43:58.708927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:43:58.708927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 468/950] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:43:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:43:58.709420 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386d06d-071a-4a73-afcd-2e53f8a8bd93 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:58.794571 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2cd1c-5367-4f38-8c49-effd15f0473f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:58.818830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386d06d-071a-4a73-afcd-2e53f8a8bd93 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:58.828597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afd60b-f100-44ca-b8ce-ca9980fd062f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:58.829257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afd60b-f100-44ca-b8ce-ca9980fd062f None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:58.829538 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afd60b-f100-44ca-b8ce-ca9980fd062f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:58.829812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afd60b-f100-44ca-b8ce-ca9980fd062f None admin] PATH_INFO: `/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/e51ae6959aac49898e75c6786c5dbdf2/roles/5e8e8a438e704946842357d01ab848a8` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:58.832150 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afd60b-f100-44ca-b8ce-ca9980fd062f None admin] RBAC: Authorizing `identity:create_grant(project_id=a57df41195d240fe8f28ac49bfd37921, user_id=e51ae6959aac49898e75c6786c5dbdf2, role_id=5e8e8a438e704946842357d01ab848a8)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:58.833576 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afd60b-f100-44ca-b8ce-ca9980fd062f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:58.849556 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 483/951] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:43:58 2022] PUT /identity/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/e51ae6959aac49898e75c6786c5dbdf2/roles/5e8e8a438e704946842357d01ab848a8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:43:58.850360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afd60b-f100-44ca-b8ce-ca9980fd062f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:58.864132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5c53d-07c5-4524-9bbd-b1009e426bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:58.865296 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5c53d-07c5-4524-9bbd-b1009e426bba None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:58.865851 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5c53d-07c5-4524-9bbd-b1009e426bba None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:58.866190 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5c53d-07c5-4524-9bbd-b1009e426bba None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:58.866929 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5c53d-07c5-4524-9bbd-b1009e426bba None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:58.867300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5c53d-07c5-4524-9bbd-b1009e426bba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:58.868861 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea5c53d-07c5-4524-9bbd-b1009e426bba None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:58.880335 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 469/952] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Sep 9 20:43:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:58.881548 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5c53d-07c5-4524-9bbd-b1009e426bba None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:58.955059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:58.961776 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:58.993955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afd60b-f100-44ca-b8ce-ca9980fd062f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:59.003414 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5c53d-07c5-4524-9bbd-b1009e426bba None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:59.034930 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009eeadf-e475-4994-ab12-873b570ca8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:59.035576 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eeadf-e475-4994-ab12-873b570ca8cc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:59.035856 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eeadf-e475-4994-ab12-873b570ca8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:59.036163 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009eeadf-e475-4994-ab12-873b570ca8cc None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:59.036846 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009eeadf-e475-4994-ab12-873b570ca8cc None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:59.037152 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009eeadf-e475-4994-ab12-873b570ca8cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:59.038607 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009eeadf-e475-4994-ab12-873b570ca8cc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:59.046143 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742a804-58a0-4388-92c0-b6f9ba87c0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:59.047019 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742a804-58a0-4388-92c0-b6f9ba87c0af None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:59.047480 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742a804-58a0-4388-92c0-b6f9ba87c0af None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:59.047925 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742a804-58a0-4388-92c0-b6f9ba87c0af None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:59.048725 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742a804-58a0-4388-92c0-b6f9ba87c0af None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:43:59.049164 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742a804-58a0-4388-92c0-b6f9ba87c0af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:59.050761 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742a804-58a0-4388-92c0-b6f9ba87c0af None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:59.056626 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 470/953] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Sep 9 20:43:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:59.062666 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 484/954] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Sep 9 20:43:58 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:43:59.065390 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742a804-58a0-4388-92c0-b6f9ba87c0af None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:43:59.184090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742a804-58a0-4388-92c0-b6f9ba87c0af None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:43:59.215545 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:43:59.225493 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039af16-bdf2-457b-9891-fd99b17e741d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:43:59.226118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039af16-bdf2-457b-9891-fd99b17e741d None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:59.226470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039af16-bdf2-457b-9891-fd99b17e741d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:59.226817 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039af16-bdf2-457b-9891-fd99b17e741d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:59.227558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039af16-bdf2-457b-9891-fd99b17e741d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:43:59.229003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039af16-bdf2-457b-9891-fd99b17e741d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:43:59.252625 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 471/955] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:43:59 2022] POST /identity/v3/endpoints => generated 349 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:43:59.615685 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc3864-5b54-43e6-8070-f33b54228582 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:59.616052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc3864-5b54-43e6-8070-f33b54228582 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:59.616314 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc3864-5b54-43e6-8070-f33b54228582 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:59.617921 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 485/956] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:43:59.624394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9b2ac-3dcd-4256-8980-5b37a29b52c3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:43:59.624854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9b2ac-3dcd-4256-8980-5b37a29b52c3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:43:59.624929 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9b2ac-3dcd-4256-8980-5b37a29b52c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:43:59.644405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-28f9b2ac-3dcd-4256-8980-5b37a29b52c3 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:43:59.645614 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-28f9b2ac-3dcd-4256-8980-5b37a29b52c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:43:59.726316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 472/957] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:43:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:00.003011 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc3864-5b54-43e6-8070-f33b54228582 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:00.114231 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc3864-5b54-43e6-8070-f33b54228582 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:00.148536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:00.149994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cebbc-f178-4de6-84a7-5342f728c30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:00.150634 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cebbc-f178-4de6-84a7-5342f728c30c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:00.151170 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cebbc-f178-4de6-84a7-5342f728c30c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:00.151444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cebbc-f178-4de6-84a7-5342f728c30c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:00.152052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cebbc-f178-4de6-84a7-5342f728c30c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:00.153774 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cebbc-f178-4de6-84a7-5342f728c30c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:00.163232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-908cebbc-f178-4de6-84a7-5342f728c30c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 20:44:00.163232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:00.163232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:44:00.163232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:44:00.163232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:44:00.163232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:44:00.163232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:44:00.163232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:44:00.163232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 20:44:00.163232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:00.163232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:44:00.163232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:00.163232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:00.163232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:00.163232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:00.163232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:00.163232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:00.164630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:00.164630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:00.164630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:00.164630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:00.164630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:00.164630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:00.164630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:44:00.164630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:44:00.164630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:44:00.164630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:44:00.164630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:00.164630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:00.164630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:00.164630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:00.164630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:00.164630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:00.165747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:00.165747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:00.165747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:00.165747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:00.165747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:00.165747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:00.165747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:00.165747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:00.165747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:00.165747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:00.165747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:44:00.165747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:44:00.165747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 20:44:00.165747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:00.168728 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 486/958] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:44:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:44:00.175416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9b2ac-3dcd-4256-8980-5b37a29b52c3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:00.281651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9b2ac-3dcd-4256-8980-5b37a29b52c3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:00.312369 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:00.317774 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f1abd-22fa-41b9-b5e4-b038d9e6cde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:00.318642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f1abd-22fa-41b9-b5e4-b038d9e6cde6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:00.319405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f1abd-22fa-41b9-b5e4-b038d9e6cde6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:00.319756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f1abd-22fa-41b9-b5e4-b038d9e6cde6 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:00.320483 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f1abd-22fa-41b9-b5e4-b038d9e6cde6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:00.321280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f1abd-22fa-41b9-b5e4-b038d9e6cde6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:00.322736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f1abd-22fa-41b9-b5e4-b038d9e6cde6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:00.328077 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 473/959] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Sep 9 20:44:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:00.333514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cebbc-f178-4de6-84a7-5342f728c30c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:00.436888 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cebbc-f178-4de6-84a7-5342f728c30c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:00.476270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a3862-a3fa-47b0-8aa1-9cf0805b9055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:00.476969 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a3862-a3fa-47b0-8aa1-9cf0805b9055 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:00.477313 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a3862-a3fa-47b0-8aa1-9cf0805b9055 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:00.477650 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a3862-a3fa-47b0-8aa1-9cf0805b9055 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:00.478344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a3862-a3fa-47b0-8aa1-9cf0805b9055 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:00.478711 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a3862-a3fa-47b0-8aa1-9cf0805b9055 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:00.480168 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a3862-a3fa-47b0-8aa1-9cf0805b9055 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:00.486403 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 487/960] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Sep 9 20:44:00 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:01.181018 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cc676-02dd-450d-a3b7-a6f261b2a0af None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:01.182027 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cc676-02dd-450d-a3b7-a6f261b2a0af None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:01.182532 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474cc676-02dd-450d-a3b7-a6f261b2a0af None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:01.184360 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 474/961] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:01.190315 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff322960-8173-47f4-95a0-7118c0b60d2d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:01.190741 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff322960-8173-47f4-95a0-7118c0b60d2d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:01.190934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff322960-8173-47f4-95a0-7118c0b60d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:01.210022 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ff322960-8173-47f4-95a0-7118c0b60d2d None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:01.211539 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ff322960-8173-47f4-95a0-7118c0b60d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:01.271673 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:01.286091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 488/962] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:01.401077 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249d25b-ee6a-42f2-9f54-5b9b2377b141 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:01.401735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249d25b-ee6a-42f2-9f54-5b9b2377b141 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:01.402256 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249d25b-ee6a-42f2-9f54-5b9b2377b141 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:01.404967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 475/963] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:01.410721 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a87141-a002-4713-98cf-1a104a18d302 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:01.411020 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a87141-a002-4713-98cf-1a104a18d302 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:01.411354 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a87141-a002-4713-98cf-1a104a18d302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:01.430810 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a9a87141-a002-4713-98cf-1a104a18d302 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:01.432068 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a9a87141-a002-4713-98cf-1a104a18d302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:01.500015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 489/964] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:01.514472 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8ef75-e948-4b39-82c0-e3e9048e5b64 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:01.514748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8ef75-e948-4b39-82c0-e3e9048e5b64 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:01.515079 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8ef75-e948-4b39-82c0-e3e9048e5b64 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:01.516574 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 476/965] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:01.521703 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063713fe-6779-4f04-87b0-1b4f609ef0f3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:01.521992 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063713fe-6779-4f04-87b0-1b4f609ef0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:01.522261 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063713fe-6779-4f04-87b0-1b4f609ef0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:01.541180 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-063713fe-6779-4f04-87b0-1b4f609ef0f3 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:01.542364 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-063713fe-6779-4f04-87b0-1b4f609ef0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:01.563807 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8ef75-e948-4b39-82c0-e3e9048e5b64 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:01.618159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 490/966] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:01.680479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8ef75-e948-4b39-82c0-e3e9048e5b64 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:01.717923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba50ab4-7be4-4f03-96f6-b72eb66dc68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:01.718882 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba50ab4-7be4-4f03-96f6-b72eb66dc68f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:01.719359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba50ab4-7be4-4f03-96f6-b72eb66dc68f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:01.719828 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba50ab4-7be4-4f03-96f6-b72eb66dc68f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:01.730848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba50ab4-7be4-4f03-96f6-b72eb66dc68f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:44:01.736162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-0ba50ab4-7be4-4f03-96f6-b72eb66dc68f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 20:44:01.736162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:01.736162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:01.736162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:01.736162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:01.736162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:01.736162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:01.736162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:01.736162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:01.736162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:01.736162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:01.736162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:01.736162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:44:01.736162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:44:01.736162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:44:01.736162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:44:01.737117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:44:01.737117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:44:01.737117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:44:01.737117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:44:01.737117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:01.737117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:01.737117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:01.737117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:01.737117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:01.737117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:01.737117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:01.737117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:01.737117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:01.737117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:01.737117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:01.737117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:01.737944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:01.737944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:01.737944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:01.737944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:01.737944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:44:01.737944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:44:01.737944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:44:01.737944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:44:01.737944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:44:01.737944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:44:01.737944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 20:44:01.737944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:01.737944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 477/967] 10.222.0.15 () {56 vars in 1120 bytes} [Fri Sep 9 20:44:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:44:01.743149 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063713fe-6779-4f04-87b0-1b4f609ef0f3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:01.784558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba50ab4-7be4-4f03-96f6-b72eb66dc68f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:01.811083 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:01.828676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:01.886064 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063713fe-6779-4f04-87b0-1b4f609ef0f3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:01.904525 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba50ab4-7be4-4f03-96f6-b72eb66dc68f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:01.922221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a67b1-09ec-4361-9b40-1912763addf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:01.923027 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a67b1-09ec-4361-9b40-1912763addf4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:01.923302 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a67b1-09ec-4361-9b40-1912763addf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:01.923572 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a67b1-09ec-4361-9b40-1912763addf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:01.924263 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a67b1-09ec-4361-9b40-1912763addf4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:01.924566 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a67b1-09ec-4361-9b40-1912763addf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:01.925921 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a67b1-09ec-4361-9b40-1912763addf4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:01.934082 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 491/968] 10.222.0.15 () {56 vars in 1115 bytes} [Fri Sep 9 20:44:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:01.935295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a67b1-09ec-4361-9b40-1912763addf4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:01.945088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54522bb2-7136-4c86-b792-834cd6a5545f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:01.945710 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54522bb2-7136-4c86-b792-834cd6a5545f None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:01.945992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54522bb2-7136-4c86-b792-834cd6a5545f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:01.946270 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54522bb2-7136-4c86-b792-834cd6a5545f None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:01.946924 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54522bb2-7136-4c86-b792-834cd6a5545f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:01.948408 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54522bb2-7136-4c86-b792-834cd6a5545f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:01.951622 dv-cinder-831247-28-smb devstack@keystone.service[81398]: WARNING keystone.server.flask.common [None req-54522bb2-7136-4c86-b792-834cd6a5545f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 09 20:44:01.964113 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.sql.core [None req-54522bb2-7136-4c86-b792-834cd6a5545f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 20:44:01.964113 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 20:44:01.964113 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [parameters: {'user_id': '56a194bb6abd4b9d9459c78da177fd53', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 20:44:01.964113 dv-cinder-831247-28-smb devstack@keystone.service[81398]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81398) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 09 20:44:01.972301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-54522bb2-7136-4c86-b792-834cd6a5545f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 20:44:01.972301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:01.972301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 20:44:01.972301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 20:44:01.972301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 20:44:01.972301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 20:44:01.972301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 20:44:01.972301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 20:44:01.972301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 20:44:01.972301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application conn.query(q) Sep 09 20:44:01.972301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 20:44:01.972301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 20:44:01.972301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 20:44:01.972301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result.read() Sep 09 20:44:01.972301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 20:44:01.973154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 20:44:01.973154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 20:44:01.973154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 20:44:01.973154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 20:44:01.973154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 20:44:01.973154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 20:44:01.973154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 20:44:01.973154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 20:44:01.973154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:01.973154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 09 20:44:01.973154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:01.973154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:01.973154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 09 20:44:01.973154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 09 20:44:01.973154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 09 20:44:01.973154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 09 20:44:01.973154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 20:44:01.973154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application next(self.gen) Sep 09 20:44:01.974099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 09 20:44:01.974099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application yield resource Sep 09 20:44:01.974099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 09 20:44:01.974099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application next(self.gen) Sep 09 20:44:01.974099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 09 20:44:01.974099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.session.rollback() Sep 09 20:44:01.974099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 09 20:44:01.974099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.force_reraise() Sep 09 20:44:01.974099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 09 20:44:01.974099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise self.value Sep 09 20:44:01.974099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 09 20:44:01.974099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 09 20:44:01.974099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 09 20:44:01.974099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application session.commit() Sep 09 20:44:01.974099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 09 20:44:01.974099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 09 20:44:01.974099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 09 20:44:01.974982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._prepare_impl() Sep 09 20:44:01.974982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 09 20:44:01.974982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.session.flush() Sep 09 20:44:01.974982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 09 20:44:01.974982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._flush(objects) Sep 09 20:44:01.974982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 09 20:44:01.974982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 09 20:44:01.974982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 09 20:44:01.974982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application compat.raise_( Sep 09 20:44:01.974982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 20:44:01.974982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception Sep 09 20:44:01.974982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 09 20:44:01.974982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application flush_context.execute() Sep 09 20:44:01.974982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 09 20:44:01.974982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rec.execute(self) Sep 09 20:44:01.974982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 09 20:44:01.974982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 09 20:44:01.975897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 09 20:44:01.975897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 09 20:44:01.975897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 09 20:44:01.975897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 09 20:44:01.975897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 09 20:44:01.975897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 09 20:44:01.975897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 09 20:44:01.975897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 09 20:44:01.975897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 09 20:44:01.975897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 09 20:44:01.975897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 09 20:44:01.975897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 09 20:44:01.975897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 09 20:44:01.975897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 09 20:44:01.975897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 09 20:44:01.975897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception Sep 09 20:44:01.976791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 09 20:44:01.976791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 09 20:44:01.976791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 09 20:44:01.976791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 09 20:44:01.976791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 09 20:44:01.976791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result = self._query(query) Sep 09 20:44:01.976791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 09 20:44:01.976791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application conn.query(q) Sep 09 20:44:01.976791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 09 20:44:01.976791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 09 20:44:01.976791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 09 20:44:01.976791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application result.read() Sep 09 20:44:01.976791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 09 20:44:01.976791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 09 20:44:01.976791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 09 20:44:01.976791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 09 20:44:01.977722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 09 20:44:01.977722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 09 20:44:01.977722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 09 20:44:01.977722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 09 20:44:01.977722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 09 20:44:01.977722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 09 20:44:01.977722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [parameters: {'user_id': '56a194bb6abd4b9d9459c78da177fd53', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 09 20:44:01.977722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 09 20:44:01.977722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:01.977722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:44:01.977722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:01.977722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:01.977722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:01.977722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:01.977722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:01.979944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:01.979944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:01.979944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:01.979944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:01.979944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:01.979944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:01.979944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:01.979944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 09 20:44:01.979944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 09 20:44:01.979944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:01.979944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:01.979944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:44:01.979944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:44:01.979944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:44:01.979944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:44:01.979944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 09 20:44:01.979944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 09 20:44:01.981118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 09 20:44:01.981118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 09 20:44:01.981118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 09 20:44:01.981118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 09 20:44:01.981118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 09 20:44:01.981118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:01.981118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 478/969] 10.222.0.15 () {60 vars in 1131 bytes} [Fri Sep 9 20:44:01 2022] POST /identity/v3/users => generated 160 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:44:01.981118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54522bb2-7136-4c86-b792-834cd6a5545f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:02.050552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a67b1-09ec-4361-9b40-1912763addf4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:02.066953 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:02.081912 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:02.089566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54522bb2-7136-4c86-b792-834cd6a5545f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:02.093518 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4c075-25fe-4cc5-b366-8710a6924b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:02.094156 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4c075-25fe-4cc5-b366-8710a6924b73 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:02.094434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4c075-25fe-4cc5-b366-8710a6924b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:02.094707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4c075-25fe-4cc5-b366-8710a6924b73 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:02.095293 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4c075-25fe-4cc5-b366-8710a6924b73 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:02.096708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4c075-25fe-4cc5-b366-8710a6924b73 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:02.106892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-43d4c075-25fe-4cc5-b366-8710a6924b73 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 20:44:02.106892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:02.106892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:44:02.106892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:44:02.106892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:44:02.106892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:44:02.106892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:44:02.106892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:44:02.106892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 20:44:02.106892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:02.106892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:44:02.106892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:02.106892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:02.106892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:02.106892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:02.106892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:02.106892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:02.107902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:02.107902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:02.107902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:02.107902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:02.107902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:02.107902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:02.107902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:44:02.107902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:44:02.107902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:44:02.107902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:44:02.107902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:02.107902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:02.107902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:02.107902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:02.107902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:02.107902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:02.108769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:02.108769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:02.108769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:02.108769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:02.108769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:02.108769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:02.108769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:02.108769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:02.108769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:02.108769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:02.108769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:44:02.108769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:44:02.108769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 20:44:02.108769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:02.108769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 492/970] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Sep 9 20:44:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:44:02.109568 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4c075-25fe-4cc5-b366-8710a6924b73 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:02.130577 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05fe94-88f7-43ab-9431-0e5027fc28b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:02.131213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05fe94-88f7-43ab-9431-0e5027fc28b2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:02.131491 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05fe94-88f7-43ab-9431-0e5027fc28b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:02.131758 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05fe94-88f7-43ab-9431-0e5027fc28b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:02.142746 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05fe94-88f7-43ab-9431-0e5027fc28b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:02.144535 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff05fe94-88f7-43ab-9431-0e5027fc28b2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:02.159422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ff05fe94-88f7-43ab-9431-0e5027fc28b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:44:02.159422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:02.159422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:02.159422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:02.159422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:02.159422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:02.159422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:02.159422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:02.159422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:02.159422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:02.159422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:02.159422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:02.159422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:44:02.159422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:44:02.159422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:44:02.159422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:44:02.160528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:02.160528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:02.160528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:02.160528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:02.160528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:02.160528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:02.160528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:02.160528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:02.160528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:02.160528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:02.160528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:02.160528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:02.160528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:02.160528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:02.160528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:02.160528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:02.160528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:44:02.161425 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:44:02.161425 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:44:02.161425 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:02.161425 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 479/971] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:44:02.161674 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05fe94-88f7-43ab-9431-0e5027fc28b2 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:02.226789 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4c075-25fe-4cc5-b366-8710a6924b73 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:02.264021 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55df5cb-8161-428f-970d-bed5598450f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:02.264740 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55df5cb-8161-428f-970d-bed5598450f4 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:02.265017 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55df5cb-8161-428f-970d-bed5598450f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:02.265296 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55df5cb-8161-428f-970d-bed5598450f4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:02.271923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff05fe94-88f7-43ab-9431-0e5027fc28b2 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:02.272570 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55df5cb-8161-428f-970d-bed5598450f4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:02.274011 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55df5cb-8161-428f-970d-bed5598450f4 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:02.289052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-b55df5cb-8161-428f-970d-bed5598450f4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 20:44:02.289052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:02.289052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:02.289052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:02.289052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:02.289052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:02.289052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:02.289052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:02.289052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:02.289052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:02.289052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:02.289052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:02.289052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:44:02.289052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:44:02.289052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:44:02.289052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:44:02.290221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:02.290221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:02.290221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:44:02.290221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:44:02.290221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:44:02.290221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:44:02.290221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:02.290221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:02.290221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:02.290221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:02.290221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:02.290221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:02.290221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:02.290221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:02.290221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:02.290221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:02.290221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:02.290221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:02.291225 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:02.291225 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:02.291225 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:44:02.291225 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:44:02.291225 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:44:02.291225 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:44:02.291225 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:44:02.291225 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:44:02.291225 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 09 20:44:02.291225 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:02.291225 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 493/972] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:44:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:44:02.291225 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55df5cb-8161-428f-970d-bed5598450f4 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:02.323325 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218e054-1610-405f-90d0-4126366b62ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:02.323930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218e054-1610-405f-90d0-4126366b62ba None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:02.324433 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218e054-1610-405f-90d0-4126366b62ba None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:02.324542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218e054-1610-405f-90d0-4126366b62ba None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:02.325119 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218e054-1610-405f-90d0-4126366b62ba None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:02.325956 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218e054-1610-405f-90d0-4126366b62ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:02.327319 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218e054-1610-405f-90d0-4126366b62ba None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:02.333581 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:02.335577 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 480/973] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Sep 9 20:44:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:02.336502 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218e054-1610-405f-90d0-4126366b62ba None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:02.353211 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:02.409546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55df5cb-8161-428f-970d-bed5598450f4 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:02.445423 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94248b-5d7a-4224-96c1-128ed7894808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:02.446132 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94248b-5d7a-4224-96c1-128ed7894808 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:02.446468 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94248b-5d7a-4224-96c1-128ed7894808 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:02.446741 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94248b-5d7a-4224-96c1-128ed7894808 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:02.447433 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94248b-5d7a-4224-96c1-128ed7894808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:02.447741 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218e054-1610-405f-90d0-4126366b62ba None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:02.447843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94248b-5d7a-4224-96c1-128ed7894808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:02.449139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94248b-5d7a-4224-96c1-128ed7894808 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:02.467089 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 494/974] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:02.467966 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94248b-5d7a-4224-96c1-128ed7894808 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:02.485290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28255aae-601d-4a86-966f-9b342e87a3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:02.486140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28255aae-601d-4a86-966f-9b342e87a3cc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:02.486422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28255aae-601d-4a86-966f-9b342e87a3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:02.486692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28255aae-601d-4a86-966f-9b342e87a3cc None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:02.487385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28255aae-601d-4a86-966f-9b342e87a3cc None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:02.487682 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28255aae-601d-4a86-966f-9b342e87a3cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:02.489165 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28255aae-601d-4a86-966f-9b342e87a3cc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:02.526306 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 481/975] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Sep 9 20:44:02 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:02.527141 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28255aae-601d-4a86-966f-9b342e87a3cc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:02.594909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:02.604243 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94248b-5d7a-4224-96c1-128ed7894808 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:02.615679 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:02.651838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28255aae-601d-4a86-966f-9b342e87a3cc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:02.662781 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b956eee-ccaf-4695-9d44-861af14fb8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:02.664221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b956eee-ccaf-4695-9d44-861af14fb8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:02.664522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b956eee-ccaf-4695-9d44-861af14fb8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:02.664798 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b956eee-ccaf-4695-9d44-861af14fb8a6 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:02.665452 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b956eee-ccaf-4695-9d44-861af14fb8a6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:02.665756 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b956eee-ccaf-4695-9d44-861af14fb8a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:02.667149 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b956eee-ccaf-4695-9d44-861af14fb8a6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:02.678612 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 495/976] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Sep 9 20:44:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:02.679668 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b956eee-ccaf-4695-9d44-861af14fb8a6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:02.706942 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3ae76-b283-40e3-ad45-26067065f95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:02.707620 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3ae76-b283-40e3-ad45-26067065f95d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:02.707915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3ae76-b283-40e3-ad45-26067065f95d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:02.708227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3ae76-b283-40e3-ad45-26067065f95d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:02.717421 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3ae76-b283-40e3-ad45-26067065f95d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:02.718902 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3ae76-b283-40e3-ad45-26067065f95d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:02.731133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-05d3ae76-b283-40e3-ad45-26067065f95d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 20:44:02.731133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:02.731133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:02.731133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:02.731133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:02.731133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:02.731133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:02.731133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:02.731133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:02.731133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:02.731133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:02.731133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:02.731133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:44:02.731133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:44:02.731133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:44:02.731133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:44:02.733509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:02.733509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:02.733509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:44:02.733509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:44:02.733509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:44:02.733509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:44:02.733509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:02.733509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:02.733509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:02.733509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:02.733509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:02.733509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:02.733509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:02.733509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:02.733509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:02.733509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:02.733509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:02.733509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:02.734439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:02.734439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:02.734439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:44:02.734439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:44:02.734439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:44:02.734439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:44:02.734439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:44:02.734439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:44:02.734439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 09 20:44:02.734439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:02.734439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 482/977] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Sep 9 20:44:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:44:02.734439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac4075-3858-4828-8f39-dceb289fb1dd None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:02.735097 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac4075-3858-4828-8f39-dceb289fb1dd None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:02.735097 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac4075-3858-4828-8f39-dceb289fb1dd None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:02.737054 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 483/978] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:02.743270 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea1112-9df9-4eb1-be6d-ee1f12d1b7cd None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:02.743547 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea1112-9df9-4eb1-be6d-ee1f12d1b7cd None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:02.743824 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea1112-9df9-4eb1-be6d-ee1f12d1b7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:02.766959 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f5ea1112-9df9-4eb1-be6d-ee1f12d1b7cd None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:02.768554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f5ea1112-9df9-4eb1-be6d-ee1f12d1b7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:02.812969 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b956eee-ccaf-4695-9d44-861af14fb8a6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:02.847693 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 484/979] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 20:44:02.848609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea1112-9df9-4eb1-be6d-ee1f12d1b7cd None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:02.850814 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a292052-b40b-4382-9a2e-fab3d556b057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:02.851425 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a292052-b40b-4382-9a2e-fab3d556b057 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:02.851700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a292052-b40b-4382-9a2e-fab3d556b057 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:02.851969 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a292052-b40b-4382-9a2e-fab3d556b057 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:02.852702 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a292052-b40b-4382-9a2e-fab3d556b057 None admin] RBAC: Adding query filter params (interface=admin, service_id=0701746e865a4d768671fcbd656c4dee, region_id=RegionOne) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:02.853012 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a292052-b40b-4382-9a2e-fab3d556b057 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:02.854377 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a292052-b40b-4382-9a2e-fab3d556b057 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:02.860027 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 496/980] 10.222.0.15 () {56 vars in 1249 bytes} [Fri Sep 9 20:44:02 2022] GET /identity/v3/endpoints?service_id=0701746e865a4d768671fcbd656c4dee&interface=admin®ion_id=RegionOne => generated 193 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:02.865371 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a292052-b40b-4382-9a2e-fab3d556b057 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:02.892446 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:02.913345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:02.956487 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea1112-9df9-4eb1-be6d-ee1f12d1b7cd None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:02.978079 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a292052-b40b-4382-9a2e-fab3d556b057 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:02.994154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb41fe8-ab6d-4623-8a09-26fec1c5f1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:02.994696 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb41fe8-ab6d-4623-8a09-26fec1c5f1be None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:02.995047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb41fe8-ab6d-4623-8a09-26fec1c5f1be None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:02.995234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb41fe8-ab6d-4623-8a09-26fec1c5f1be None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:02.995953 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb41fe8-ab6d-4623-8a09-26fec1c5f1be None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:02.996469 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb41fe8-ab6d-4623-8a09-26fec1c5f1be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:02.998998 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb41fe8-ab6d-4623-8a09-26fec1c5f1be None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:03.013674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985d620-16d1-4093-816f-19acb73088ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:03.014286 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985d620-16d1-4093-816f-19acb73088ec None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:03.014559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985d620-16d1-4093-816f-19acb73088ec None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:03.014834 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c985d620-16d1-4093-816f-19acb73088ec None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:03.015438 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985d620-16d1-4093-816f-19acb73088ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:03.016820 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c985d620-16d1-4093-816f-19acb73088ec None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:03.018035 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 485/981] 10.222.0.15 () {56 vars in 1149 bytes} [Fri Sep 9 20:44:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:03.023416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb41fe8-ab6d-4623-8a09-26fec1c5f1be None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:03.028033 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 497/982] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Sep 9 20:44:02 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:44:03.125473 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985d620-16d1-4093-816f-19acb73088ec None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:03.139860 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb41fe8-ab6d-4623-8a09-26fec1c5f1be None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:03.161135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:03.180326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d4a95-8e59-4f16-a49d-b557eac16582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:03.180957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d4a95-8e59-4f16-a49d-b557eac16582 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:03.181238 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d4a95-8e59-4f16-a49d-b557eac16582 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:03.181509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d4a95-8e59-4f16-a49d-b557eac16582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:03.229717 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:03.243238 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c985d620-16d1-4093-816f-19acb73088ec None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:03.261094 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d4a95-8e59-4f16-a49d-b557eac16582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:03.262480 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d4a95-8e59-4f16-a49d-b557eac16582 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:03.279454 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c12beb-18ba-4e9d-a831-3e6b4d63b1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:03.280108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c12beb-18ba-4e9d-a831-3e6b4d63b1fc None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:03.280385 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c12beb-18ba-4e9d-a831-3e6b4d63b1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:03.280658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c12beb-18ba-4e9d-a831-3e6b4d63b1fc None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:03.281300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c12beb-18ba-4e9d-a831-3e6b4d63b1fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:03.282652 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c12beb-18ba-4e9d-a831-3e6b4d63b1fc None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:03.300827 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 498/983] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Sep 9 20:44:03 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:44:03.392856 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 486/984] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:44:03 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 20:44:03.398496 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c12beb-18ba-4e9d-a831-3e6b4d63b1fc None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:03.520157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c12beb-18ba-4e9d-a831-3e6b4d63b1fc None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:03.554950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57708c20-36c4-48bf-be0c-1d1b2b16145d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:03.555588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57708c20-36c4-48bf-be0c-1d1b2b16145d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:03.555863 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57708c20-36c4-48bf-be0c-1d1b2b16145d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:03.556202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57708c20-36c4-48bf-be0c-1d1b2b16145d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:03.566991 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57708c20-36c4-48bf-be0c-1d1b2b16145d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:03.568476 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57708c20-36c4-48bf-be0c-1d1b2b16145d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:03.571036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:03.585804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-57708c20-36c4-48bf-be0c-1d1b2b16145d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:44:03.585804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:03.585804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:03.585804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:03.585804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:03.585804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:03.585804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:03.585804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:03.585804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:03.585804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:03.585804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:03.585804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:03.585804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:44:03.585804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:44:03.585804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:44:03.585804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:44:03.586771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:03.586771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:03.586771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:03.586771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:03.586771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:03.586771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:03.586771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:03.586771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:03.586771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:03.586771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:03.586771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:03.586771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:03.586771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:03.586771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:03.586771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:03.586771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:03.586771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:44:03.587643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:44:03.587643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:44:03.587643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:03.587643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 499/985] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:44:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:44:03.595169 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d4a95-8e59-4f16-a49d-b557eac16582 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:03.613151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:03.697211 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d4a95-8e59-4f16-a49d-b557eac16582 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:03.732198 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b479955-2264-4503-90cb-5cf4b70a0a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:03.733134 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b479955-2264-4503-90cb-5cf4b70a0a27 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:03.733509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b479955-2264-4503-90cb-5cf4b70a0a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:03.733787 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b479955-2264-4503-90cb-5cf4b70a0a27 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:03.734400 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b479955-2264-4503-90cb-5cf4b70a0a27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:03.734697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b479955-2264-4503-90cb-5cf4b70a0a27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:03.736086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b479955-2264-4503-90cb-5cf4b70a0a27 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:03.748364 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 487/986] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:03.753776 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57708c20-36c4-48bf-be0c-1d1b2b16145d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:03.859928 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57708c20-36c4-48bf-be0c-1d1b2b16145d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:03.893353 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacf2f8-d2a3-4337-87a9-41ba3b54240a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:03.893982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacf2f8-d2a3-4337-87a9-41ba3b54240a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:03.894255 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacf2f8-d2a3-4337-87a9-41ba3b54240a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:03.894524 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeacf2f8-d2a3-4337-87a9-41ba3b54240a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:03.901499 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacf2f8-d2a3-4337-87a9-41ba3b54240a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:03.902927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeacf2f8-d2a3-4337-87a9-41ba3b54240a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:03.914105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-aeacf2f8-d2a3-4337-87a9-41ba3b54240a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:44:03.914105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:03.914105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:03.914105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:03.914105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:03.914105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:03.914105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:03.914105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:03.914105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:03.914105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:03.914105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:03.914105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:03.914105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:44:03.914105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:44:03.914105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:44:03.915004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:44:03.915004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:03.915004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:03.915004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:03.915004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:03.915004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:03.915004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:03.915004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:03.915004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:03.915004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:03.915004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:03.915004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:03.915004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:03.915004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:03.915004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:03.915004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:03.915004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:03.915878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:44:03.915878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:44:03.915878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:44:03.915878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:44:03.915878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:44:03.915878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:44:03.915878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:44:03.915878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:03.920315 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 500/987] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:44:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:44:03.921658 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b479955-2264-4503-90cb-5cf4b70a0a27 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:04.003157 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:04.026639 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b479955-2264-4503-90cb-5cf4b70a0a27 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:04.061801 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e1485-3483-4ee8-a462-dc14d6d2b728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:04.062509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e1485-3483-4ee8-a462-dc14d6d2b728 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:04.062791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e1485-3483-4ee8-a462-dc14d6d2b728 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:04.063064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e1485-3483-4ee8-a462-dc14d6d2b728 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:04.063747 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e1485-3483-4ee8-a462-dc14d6d2b728 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:04.064083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e1485-3483-4ee8-a462-dc14d6d2b728 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:04.065525 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e1485-3483-4ee8-a462-dc14d6d2b728 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:04.083524 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 488/988] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:44:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:04.084694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacf2f8-d2a3-4337-87a9-41ba3b54240a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:04.142663 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:04.188221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeacf2f8-d2a3-4337-87a9-41ba3b54240a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:04.221438 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562da3e-0e4c-4a08-9a47-8f7c98941a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:04.222041 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562da3e-0e4c-4a08-9a47-8f7c98941a7a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:04.222315 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562da3e-0e4c-4a08-9a47-8f7c98941a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:04.222585 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562da3e-0e4c-4a08-9a47-8f7c98941a7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:04.223306 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562da3e-0e4c-4a08-9a47-8f7c98941a7a None admin] RBAC: Adding query filter params (role.id=5e8e8a438e704946842357d01ab848a8, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=e51ae6959aac49898e75c6786c5dbdf2) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:04.223610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562da3e-0e4c-4a08-9a47-8f7c98941a7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:04.225077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562da3e-0e4c-4a08-9a47-8f7c98941a7a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:04.240030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 501/989] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:44:04 2022] GET /identity/v3/role_assignments?user.id=e51ae6959aac49898e75c6786c5dbdf2&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=5e8e8a438e704946842357d01ab848a8 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:05.233652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b079dfe-11d4-4838-a600-b4d23888c597 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:05.234173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b079dfe-11d4-4838-a600-b4d23888c597 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:05.234251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b079dfe-11d4-4838-a600-b4d23888c597 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:05.235569 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 489/990] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:05.240814 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e05b29-bb5f-4150-96fe-f3bf722bd051 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:05.241207 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e05b29-bb5f-4150-96fe-f3bf722bd051 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:05.241368 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e05b29-bb5f-4150-96fe-f3bf722bd051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:05.259630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a6e05b29-bb5f-4150-96fe-f3bf722bd051 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:05.260843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a6e05b29-bb5f-4150-96fe-f3bf722bd051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:05.332023 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 502/991] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:05.530913 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f5390-1622-476f-b352-fba28f84e798 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:05.531115 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f5390-1622-476f-b352-fba28f84e798 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:05.531377 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f5390-1622-476f-b352-fba28f84e798 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:05.532881 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 490/992] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:05.537938 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412fd27-b3ff-4379-938b-e62920219fb1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:05.538227 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412fd27-b3ff-4379-938b-e62920219fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:05.538685 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412fd27-b3ff-4379-938b-e62920219fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:05.557356 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6412fd27-b3ff-4379-938b-e62920219fb1 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:05.558552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6412fd27-b3ff-4379-938b-e62920219fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:05.602973 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f5390-1622-476f-b352-fba28f84e798 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:05.607371 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:05.629531 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 503/993] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:05.709112 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f5390-1622-476f-b352-fba28f84e798 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:05.743507 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256412d-d82c-4a9e-9efb-2a09c4493f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:05.744181 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256412d-d82c-4a9e-9efb-2a09c4493f0b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:05.744467 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256412d-d82c-4a9e-9efb-2a09c4493f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:05.744743 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256412d-d82c-4a9e-9efb-2a09c4493f0b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:05.745323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256412d-d82c-4a9e-9efb-2a09c4493f0b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:05.746690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256412d-d82c-4a9e-9efb-2a09c4493f0b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:05.755536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-1256412d-d82c-4a9e-9efb-2a09c4493f0b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 20:44:05.755536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:05.755536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:44:05.755536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:44:05.755536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:44:05.755536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:44:05.755536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:44:05.755536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:44:05.755536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 20:44:05.755536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:05.755536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:44:05.755536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:05.755536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:05.755536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:05.755536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:05.755536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:05.755536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:05.756564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:05.756564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:05.756564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:05.756564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:05.756564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:05.756564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:05.756564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:44:05.756564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:44:05.756564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:44:05.756564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:44:05.756564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:05.756564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:05.756564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:05.756564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:05.756564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:05.756564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:05.757481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:05.757481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:05.757481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:05.757481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:05.757481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:05.757481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:05.757481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:05.757481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:05.757481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:05.757481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:05.757481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:44:05.757481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:44:05.757481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 09 20:44:05.757481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:05.757481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 491/994] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Sep 9 20:44:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:44:05.762562 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412fd27-b3ff-4379-938b-e62920219fb1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:05.866492 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412fd27-b3ff-4379-938b-e62920219fb1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:05.901029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf4ecd-47b4-4d13-abf5-a8d638cf402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:05.901636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf4ecd-47b4-4d13-abf5-a8d638cf402b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:05.901907 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf4ecd-47b4-4d13-abf5-a8d638cf402b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:05.902172 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf4ecd-47b4-4d13-abf5-a8d638cf402b None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:05.902944 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf4ecd-47b4-4d13-abf5-a8d638cf402b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:05.903291 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf4ecd-47b4-4d13-abf5-a8d638cf402b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:05.903856 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256412d-d82c-4a9e-9efb-2a09c4493f0b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:05.904814 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf4ecd-47b4-4d13-abf5-a8d638cf402b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:05.906739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:05.914722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 504/995] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Sep 9 20:44:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:05.916204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf4ecd-47b4-4d13-abf5-a8d638cf402b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:05.966254 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:06.019493 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256412d-d82c-4a9e-9efb-2a09c4493f0b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:06.025171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf4ecd-47b4-4d13-abf5-a8d638cf402b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:06.057797 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3e6ca-7669-4310-8625-7e32eb947fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:06.058442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3e6ca-7669-4310-8625-7e32eb947fbf None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:06.058722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3e6ca-7669-4310-8625-7e32eb947fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:06.059008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c3e6ca-7669-4310-8625-7e32eb947fbf None admin] PATH_INFO: `/v3/services/compute` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:06.060257 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3e6ca-7669-4310-8625-7e32eb947fbf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:06.061664 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c3e6ca-7669-4310-8625-7e32eb947fbf None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:06.062722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f9163-16be-45a2-b4f9-3d1e850b7756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:06.063555 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f9163-16be-45a2-b4f9-3d1e850b7756 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:06.064105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f9163-16be-45a2-b4f9-3d1e850b7756 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:06.064601 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f9163-16be-45a2-b4f9-3d1e850b7756 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:06.065446 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f9163-16be-45a2-b4f9-3d1e850b7756 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:06.065900 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f9163-16be-45a2-b4f9-3d1e850b7756 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:06.067403 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f9163-16be-45a2-b4f9-3d1e850b7756 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:06.070621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-86c3e6ca-7669-4310-8625-7e32eb947fbf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 20:44:06.070621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:06.070621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:44:06.070621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:44:06.070621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:44:06.070621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:44:06.070621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:44:06.070621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:44:06.070621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 20:44:06.070621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:06.070621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:44:06.070621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:06.070621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:06.070621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:06.070621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:06.070621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:06.070621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:06.071838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:06.071838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:06.071838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:06.071838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:06.071838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:06.071838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:06.071838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:44:06.071838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:44:06.071838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:44:06.071838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:44:06.071838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:06.071838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:06.071838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:06.071838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:06.071838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:06.071838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:06.072739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:06.072739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:06.072739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:06.072739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:06.072739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:06.072739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:06.072739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:06.072739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:06.072739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:06.072739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:06.072739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:44:06.072739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:44:06.072739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 20:44:06.072739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:06.072739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 492/996] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:44:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:44:06.077575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3e6ca-7669-4310-8625-7e32eb947fbf None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:06.078137 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 505/997] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Sep 9 20:44:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:06.083429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f9163-16be-45a2-b4f9-3d1e850b7756 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:06.147866 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:06.186452 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c3e6ca-7669-4310-8625-7e32eb947fbf None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:06.200024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f9163-16be-45a2-b4f9-3d1e850b7756 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:06.210138 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:06.226981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fcfdd-2adf-45b7-a32a-64689a44c7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:06.227619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fcfdd-2adf-45b7-a32a-64689a44c7bb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:06.227860 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fcfdd-2adf-45b7-a32a-64689a44c7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:06.228158 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fcfdd-2adf-45b7-a32a-64689a44c7bb None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:06.228776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fcfdd-2adf-45b7-a32a-64689a44c7bb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:06.229074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fcfdd-2adf-45b7-a32a-64689a44c7bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:06.230431 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fcfdd-2adf-45b7-a32a-64689a44c7bb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:06.235441 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 493/998] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Sep 9 20:44:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:06.240750 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fcfdd-2adf-45b7-a32a-64689a44c7bb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:06.242311 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835604c-4482-4979-9eb1-f8d50ef6e3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:06.242928 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835604c-4482-4979-9eb1-f8d50ef6e3fa None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:06.243213 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835604c-4482-4979-9eb1-f8d50ef6e3fa None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:06.243488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835604c-4482-4979-9eb1-f8d50ef6e3fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:06.244191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835604c-4482-4979-9eb1-f8d50ef6e3fa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:06.245561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835604c-4482-4979-9eb1-f8d50ef6e3fa None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:06.264192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 506/999] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:44:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:44:06.364194 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fcfdd-2adf-45b7-a32a-64689a44c7bb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:06.396066 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:06.411872 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26e887-6e15-499a-93ab-4cf63eafb016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:06.412560 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26e887-6e15-499a-93ab-4cf63eafb016 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:06.412842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26e887-6e15-499a-93ab-4cf63eafb016 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:06.413117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26e887-6e15-499a-93ab-4cf63eafb016 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:06.413763 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26e887-6e15-499a-93ab-4cf63eafb016 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:06.414067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26e887-6e15-499a-93ab-4cf63eafb016 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:06.415482 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26e887-6e15-499a-93ab-4cf63eafb016 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:06.426485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 494/1000] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Sep 9 20:44:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:06.427748 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835604c-4482-4979-9eb1-f8d50ef6e3fa None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:06.444134 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f57b0-1639-49a9-a31b-6887a8cd8fa2 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:06.444466 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f57b0-1639-49a9-a31b-6887a8cd8fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:06.444692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2f57b0-1639-49a9-a31b-6887a8cd8fa2 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:06.446021 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 495/1001] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:44:06.451741 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7d0ab-9397-4c7f-bf80-2aba457b7841 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:06.452108 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7d0ab-9397-4c7f-bf80-2aba457b7841 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:06.452384 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7d0ab-9397-4c7f-bf80-2aba457b7841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:06.473027 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6ff7d0ab-9397-4c7f-bf80-2aba457b7841 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:06.474584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6ff7d0ab-9397-4c7f-bf80-2aba457b7841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:06.545657 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835604c-4482-4979-9eb1-f8d50ef6e3fa None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:06.546296 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 496/1002] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:06 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:06.580321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad2f54-9dc3-4dbe-b93e-83cd533fdd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:06.580932 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad2f54-9dc3-4dbe-b93e-83cd533fdd06 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:06.581211 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad2f54-9dc3-4dbe-b93e-83cd533fdd06 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:06.581480 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad2f54-9dc3-4dbe-b93e-83cd533fdd06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:06.582171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad2f54-9dc3-4dbe-b93e-83cd533fdd06 None admin] RBAC: Adding query filter params (interface=public, service_id=b6852b4a47124ff4bbc5c60bd2f96f0f, region_id=RegionOne) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:06.582475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad2f54-9dc3-4dbe-b93e-83cd533fdd06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:06.583834 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad2f54-9dc3-4dbe-b93e-83cd533fdd06 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:06.588943 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 507/1003] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Sep 9 20:44:06 2022] GET /identity/v3/endpoints?service_id=b6852b4a47124ff4bbc5c60bd2f96f0f&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:06.595163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7d0ab-9397-4c7f-bf80-2aba457b7841 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:06.701046 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7d0ab-9397-4c7f-bf80-2aba457b7841 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:06.721823 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:06.737061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dceeba-d91e-46db-829a-e5758d78aa22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:06.737684 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dceeba-d91e-46db-829a-e5758d78aa22 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:06.737964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dceeba-d91e-46db-829a-e5758d78aa22 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:06.738237 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dceeba-d91e-46db-829a-e5758d78aa22 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:06.738852 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dceeba-d91e-46db-829a-e5758d78aa22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:06.740243 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dceeba-d91e-46db-829a-e5758d78aa22 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:06.752188 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 497/1004] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Sep 9 20:44:06 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:44:06.817021 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad2f54-9dc3-4dbe-b93e-83cd533fdd06 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:06.852913 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:06.931183 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad2f54-9dc3-4dbe-b93e-83cd533fdd06 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:06.968497 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fe7ba-f51b-4fd0-b157-f7feffa839c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:06.969050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fe7ba-f51b-4fd0-b157-f7feffa839c1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:06.969329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fe7ba-f51b-4fd0-b157-f7feffa839c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:06.969599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fe7ba-f51b-4fd0-b157-f7feffa839c1 None admin] PATH_INFO: `/v3/services/image` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:06.970186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37fe7ba-f51b-4fd0-b157-f7feffa839c1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:06.971558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37fe7ba-f51b-4fd0-b157-f7feffa839c1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:06.980437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c37fe7ba-f51b-4fd0-b157-f7feffa839c1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 20:44:06.980437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:06.980437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:44:06.980437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:44:06.980437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:44:06.980437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:44:06.980437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:44:06.980437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:44:06.980437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 20:44:06.980437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:06.980437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:44:06.980437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:06.980437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:06.980437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:06.980437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:06.980437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:06.980437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:06.981931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:06.981931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:06.981931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:06.981931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:06.981931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:06.981931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:06.981931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:44:06.981931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:44:06.981931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:44:06.981931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:44:06.981931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:06.981931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:06.981931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:06.981931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:06.981931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:06.981931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:06.982961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:06.982961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:06.982961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:06.982961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:06.982961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:06.982961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:06.982961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:06.982961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:06.982961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:06.982961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:06.982961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:44:06.982961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:44:06.982961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 20:44:06.982961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:06.982961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 508/1005] 10.222.0.15 () {56 vars in 1105 bytes} [Fri Sep 9 20:44:06 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:44:06.988304 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dceeba-d91e-46db-829a-e5758d78aa22 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:07.093097 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dceeba-d91e-46db-829a-e5758d78aa22 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:07.128620 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c63b2-bd15-4b46-b597-d2abdaad1175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:07.129233 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c63b2-bd15-4b46-b597-d2abdaad1175 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:07.129558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c63b2-bd15-4b46-b597-d2abdaad1175 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:07.129837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c63b2-bd15-4b46-b597-d2abdaad1175 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:07.130456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c63b2-bd15-4b46-b597-d2abdaad1175 None admin] RBAC: Adding query filter params (name=image) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:07.130759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c63b2-bd15-4b46-b597-d2abdaad1175 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:07.132158 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c63b2-bd15-4b46-b597-d2abdaad1175 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:07.141832 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 498/1006] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:44:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:07.143176 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fe7ba-f51b-4fd0-b157-f7feffa839c1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:07.240614 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:07.246347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fe7ba-f51b-4fd0-b157-f7feffa839c1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:07.280835 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ea156-0d9d-4d2a-a21b-42bd30db86dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:07.281445 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ea156-0d9d-4d2a-a21b-42bd30db86dd None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:07.281723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ea156-0d9d-4d2a-a21b-42bd30db86dd None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:07.281994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ea156-0d9d-4d2a-a21b-42bd30db86dd None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:07.282623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ea156-0d9d-4d2a-a21b-42bd30db86dd None admin] RBAC: Adding query filter params (type=image) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:07.282937 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ea156-0d9d-4d2a-a21b-42bd30db86dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:07.286470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ea156-0d9d-4d2a-a21b-42bd30db86dd None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:07.292473 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 509/1007] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:44:07 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:08.485652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bd3fb-ab4e-4806-a13e-4c765c719e13 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:08.486151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bd3fb-ab4e-4806-a13e-4c765c719e13 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:08.486230 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bd3fb-ab4e-4806-a13e-4c765c719e13 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:08.487711 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 499/1008] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:08.492803 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c0475-1fdb-4146-9c66-a32b0a54eebe None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:08.493213 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c0475-1fdb-4146-9c66-a32b0a54eebe None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:08.493376 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c0475-1fdb-4146-9c66-a32b0a54eebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:08.511632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c83c0475-1fdb-4146-9c66-a32b0a54eebe None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:08.513413 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c83c0475-1fdb-4146-9c66-a32b0a54eebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:08.584219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 510/1009] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:08 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:08.850882 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bd3fb-ab4e-4806-a13e-4c765c719e13 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:08.902124 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:08.947698 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa00bc-ef21-499a-900d-e607df905d0b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:08.948027 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa00bc-ef21-499a-900d-e607df905d0b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:08.948279 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa00bc-ef21-499a-900d-e607df905d0b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:08.949740 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 511/1010] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:08.955077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1e002-b886-4b06-aeb8-6b1457320c32 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:08.955358 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1e002-b886-4b06-aeb8-6b1457320c32 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:08.955632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1e002-b886-4b06-aeb8-6b1457320c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:08.958727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bd3fb-ab4e-4806-a13e-4c765c719e13 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:08.973070 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5fb1e002-b886-4b06-aeb8-6b1457320c32 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:08.974257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5fb1e002-b886-4b06-aeb8-6b1457320c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:08.996587 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69bd29-ac70-4660-8dee-ee022d01a14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:08.998146 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69bd29-ac70-4660-8dee-ee022d01a14f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:08.998734 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69bd29-ac70-4660-8dee-ee022d01a14f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:08.999014 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69bd29-ac70-4660-8dee-ee022d01a14f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:09.000175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69bd29-ac70-4660-8dee-ee022d01a14f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:09.001839 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69bd29-ac70-4660-8dee-ee022d01a14f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:09.003567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 500/1011] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:44:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:09.009107 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69bd29-ac70-4660-8dee-ee022d01a14f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:09.043745 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 512/1012] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:08 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 20:44:09.114740 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69bd29-ac70-4660-8dee-ee022d01a14f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:09.132035 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:09.151436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bae4cc-8a6c-4bfc-b738-bae5911430ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:09.152073 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bae4cc-8a6c-4bfc-b738-bae5911430ad None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:09.152353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bae4cc-8a6c-4bfc-b738-bae5911430ad None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:09.152621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bae4cc-8a6c-4bfc-b738-bae5911430ad None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:09.153931 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bae4cc-8a6c-4bfc-b738-bae5911430ad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:09.155357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bae4cc-8a6c-4bfc-b738-bae5911430ad None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:09.188024 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 501/1013] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Sep 9 20:44:09 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:44:09.317107 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1e002-b886-4b06-aeb8-6b1457320c32 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:09.340443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:09.431830 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb1e002-b886-4b06-aeb8-6b1457320c32 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:09.466133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864edd12-560b-4e58-b849-95ea4529f6db None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:09.466491 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864edd12-560b-4e58-b849-95ea4529f6db None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:09.466765 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864edd12-560b-4e58-b849-95ea4529f6db None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:09.468171 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 502/1014] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:09.468300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dbf7f-f345-4967-9e40-a617b5183a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:09.468948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dbf7f-f345-4967-9e40-a617b5183a26 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:09.469236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dbf7f-f345-4967-9e40-a617b5183a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:09.469511 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5dbf7f-f345-4967-9e40-a617b5183a26 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:09.470101 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5dbf7f-f345-4967-9e40-a617b5183a26 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:09.471477 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5dbf7f-f345-4967-9e40-a617b5183a26 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:09.473428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b07f7-8822-46a0-b2d4-75cfec4b4386 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:09.473716 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b07f7-8822-46a0-b2d4-75cfec4b4386 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:09.473994 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b07f7-8822-46a0-b2d4-75cfec4b4386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:09.480504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-0f5dbf7f-f345-4967-9e40-a617b5183a26 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 20:44:09.480504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:09.480504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:44:09.480504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:44:09.480504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:44:09.480504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:44:09.480504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:44:09.480504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:44:09.480504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 20:44:09.480504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:09.480504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:44:09.480504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:09.480504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:09.480504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:09.480504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:09.480504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:09.480504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:09.482179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:09.482179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:09.482179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:09.482179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:09.482179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:09.482179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:09.482179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:44:09.482179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:44:09.482179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:44:09.482179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:44:09.482179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:09.482179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:09.482179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:09.482179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:09.482179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:09.482179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:09.483278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:09.483278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:09.483278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:09.483278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:09.483278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:09.483278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:09.483278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:09.483278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:09.483278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:09.483278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:09.483278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:44:09.483278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:44:09.483278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 09 20:44:09.483278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:09.483278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 513/1015] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:44:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:44:09.487918 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dbf7f-f345-4967-9e40-a617b5183a26 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:09.493228 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d67b07f7-8822-46a0-b2d4-75cfec4b4386 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:09.494431 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d67b07f7-8822-46a0-b2d4-75cfec4b4386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:09.565079 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 503/1016] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:09 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 20:44:09.580646 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:09.598033 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5dbf7f-f345-4967-9e40-a617b5183a26 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:09.632852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d5332-8e44-4ae8-b755-f9a097370768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:09.633440 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d5332-8e44-4ae8-b755-f9a097370768 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:09.633716 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d5332-8e44-4ae8-b755-f9a097370768 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:09.633986 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d5332-8e44-4ae8-b755-f9a097370768 None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:09.634611 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d5332-8e44-4ae8-b755-f9a097370768 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:09.634910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d5332-8e44-4ae8-b755-f9a097370768 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:09.636286 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d5332-8e44-4ae8-b755-f9a097370768 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:09.646441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 514/1017] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Sep 9 20:44:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:09.647609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b07f7-8822-46a0-b2d4-75cfec4b4386 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:09.748829 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:09.753490 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b07f7-8822-46a0-b2d4-75cfec4b4386 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:09.789952 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31467d1-59a3-4c1c-ace7-1a8944704666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:09.790568 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31467d1-59a3-4c1c-ace7-1a8944704666 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:09.790848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31467d1-59a3-4c1c-ace7-1a8944704666 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:09.791123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31467d1-59a3-4c1c-ace7-1a8944704666 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:09.791747 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31467d1-59a3-4c1c-ace7-1a8944704666 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:09.792078 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31467d1-59a3-4c1c-ace7-1a8944704666 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:09.793454 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31467d1-59a3-4c1c-ace7-1a8944704666 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:09.803773 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 504/1018] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Sep 9 20:44:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:09.804924 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d5332-8e44-4ae8-b755-f9a097370768 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:09.831555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31467d1-59a3-4c1c-ace7-1a8944704666 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:09.910582 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d5332-8e44-4ae8-b755-f9a097370768 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:09.937790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31467d1-59a3-4c1c-ace7-1a8944704666 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:09.946541 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b51b3e-4e93-4467-8a33-c1f8668db399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:09.947245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b51b3e-4e93-4467-8a33-c1f8668db399 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:09.947489 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b51b3e-4e93-4467-8a33-c1f8668db399 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:09.947765 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b51b3e-4e93-4467-8a33-c1f8668db399 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:09.948474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b51b3e-4e93-4467-8a33-c1f8668db399 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:09.949836 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b51b3e-4e93-4467-8a33-c1f8668db399 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:09.971874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 515/1019] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:44:09 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:44:09.987652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5d866-a9e0-493b-9946-d47d735a16a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:09.988338 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5d866-a9e0-493b-9946-d47d735a16a4 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:09.988619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5d866-a9e0-493b-9946-d47d735a16a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:09.988889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5d866-a9e0-493b-9946-d47d735a16a4 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:09.989564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5d866-a9e0-493b-9946-d47d735a16a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:09.990992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5d866-a9e0-493b-9946-d47d735a16a4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:10.008445 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 505/1020] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Sep 9 20:44:09 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:44:11.444128 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b252ef8-34ce-4c5e-a1c7-c5b713d64eb2 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:11.444662 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b252ef8-34ce-4c5e-a1c7-c5b713d64eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:11.444662 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b252ef8-34ce-4c5e-a1c7-c5b713d64eb2 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:11.446063 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 516/1021] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:11.451792 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b2b81-4581-4904-942e-d865c730f2a9 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:11.452197 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b2b81-4581-4904-942e-d865c730f2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:11.452378 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b2b81-4581-4904-942e-d865c730f2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:11.471096 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7a8b2b81-4581-4904-942e-d865c730f2a9 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:11.472325 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7a8b2b81-4581-4904-942e-d865c730f2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:11.486021 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:11.548865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 506/1022] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:11.816966 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b252ef8-34ce-4c5e-a1c7-c5b713d64eb2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:11.820919 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:11.923867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b252ef8-34ce-4c5e-a1c7-c5b713d64eb2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:11.958978 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9385cc6-938d-4920-b2ab-faa30abcd440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:11.959627 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9385cc6-938d-4920-b2ab-faa30abcd440 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:11.959891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9385cc6-938d-4920-b2ab-faa30abcd440 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:11.960189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9385cc6-938d-4920-b2ab-faa30abcd440 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:11.961313 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9385cc6-938d-4920-b2ab-faa30abcd440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:11.962745 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9385cc6-938d-4920-b2ab-faa30abcd440 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:11.964539 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 517/1023] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:44:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:11.970162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b2b81-4581-4904-942e-d865c730f2a9 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:12.071194 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b2b81-4581-4904-942e-d865c730f2a9 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:12.110469 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28d04e-9b95-4fb7-8f5c-e832538d7118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:12.111102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28d04e-9b95-4fb7-8f5c-e832538d7118 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:12.111383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28d04e-9b95-4fb7-8f5c-e832538d7118 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:12.111657 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28d04e-9b95-4fb7-8f5c-e832538d7118 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:12.112363 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28d04e-9b95-4fb7-8f5c-e832538d7118 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:12.113837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28d04e-9b95-4fb7-8f5c-e832538d7118 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:12.132268 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:12.138017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 507/1024] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Sep 9 20:44:11 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:44:12.205875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55133d-0ae7-4f57-9c99-6473d9c5c4da None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:12.206237 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55133d-0ae7-4f57-9c99-6473d9c5c4da None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:12.206441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55133d-0ae7-4f57-9c99-6473d9c5c4da None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:12.208042 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 518/1025] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:12.213772 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192c146-90b8-4417-9a6f-190f586fe3b4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:12.214057 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192c146-90b8-4417-9a6f-190f586fe3b4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:12.214333 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192c146-90b8-4417-9a6f-190f586fe3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:12.235404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6192c146-90b8-4417-9a6f-190f586fe3b4 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:12.236660 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6192c146-90b8-4417-9a6f-190f586fe3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:12.296570 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be275d-ec33-4b2b-ba0b-6ed062114940 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:12.296874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be275d-ec33-4b2b-ba0b-6ed062114940 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:12.297153 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be275d-ec33-4b2b-ba0b-6ed062114940 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:12.298522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 519/1026] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:44:12.304120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77e941-7b2b-4da8-8bf5-a49a24764750 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:12.304411 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77e941-7b2b-4da8-8bf5-a49a24764750 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:12.304695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77e941-7b2b-4da8-8bf5-a49a24764750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:12.321775 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 508/1027] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:12.330033 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8e77e941-7b2b-4da8-8bf5-a49a24764750 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:12.331424 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8e77e941-7b2b-4da8-8bf5-a49a24764750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:12.405373 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 520/1028] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 20:44:12.590997 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192c146-90b8-4417-9a6f-190f586fe3b4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:12.679491 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77e941-7b2b-4da8-8bf5-a49a24764750 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:12.681682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:12.692689 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192c146-90b8-4417-9a6f-190f586fe3b4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:12.723559 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:12.731898 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefa250-3877-4bee-b779-8d49469e0deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:12.732575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefa250-3877-4bee-b779-8d49469e0deb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:12.732851 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefa250-3877-4bee-b779-8d49469e0deb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:12.733129 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefa250-3877-4bee-b779-8d49469e0deb None admin] PATH_INFO: `/v3/services/image` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:12.733710 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefa250-3877-4bee-b779-8d49469e0deb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:12.735092 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefa250-3877-4bee-b779-8d49469e0deb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:12.743877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-8cefa250-3877-4bee-b779-8d49469e0deb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 20:44:12.743877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:12.743877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:44:12.743877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:44:12.743877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:44:12.743877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:44:12.743877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:44:12.743877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:44:12.743877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 20:44:12.743877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:12.743877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:44:12.743877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:12.743877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:12.743877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:12.743877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:12.743877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:12.743877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:12.744974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:12.744974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:12.744974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:12.744974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:12.744974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:12.744974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:12.744974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:44:12.744974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:44:12.744974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:44:12.744974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:44:12.744974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:12.744974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:12.744974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:12.744974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:12.744974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:12.744974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:12.745796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:12.745796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:12.745796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:12.745796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:12.745796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:12.745796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:12.745796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:12.745796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:12.745796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:12.745796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:12.745796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:44:12.745796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:44:12.745796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 20:44:12.745796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:12.745796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 509/1029] 10.222.0.15 () {56 vars in 1105 bytes} [Fri Sep 9 20:44:12 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:44:12.751557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefa250-3877-4bee-b779-8d49469e0deb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:12.794552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77e941-7b2b-4da8-8bf5-a49a24764750 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:12.831288 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7d415-352f-44fc-bdb2-42451f21e921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:12.831911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7d415-352f-44fc-bdb2-42451f21e921 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:12.832218 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7d415-352f-44fc-bdb2-42451f21e921 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:12.832480 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d7d415-352f-44fc-bdb2-42451f21e921 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:12.842964 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d7d415-352f-44fc-bdb2-42451f21e921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:44:12.847670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-09d7d415-352f-44fc-bdb2-42451f21e921 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 20:44:12.847670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:12.847670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:12.847670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:12.847670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:12.847670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:12.847670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:12.847670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:12.847670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:12.847670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:12.847670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:12.847670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:12.847670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:44:12.847670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:44:12.847670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:44:12.847670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:44:12.848805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:44:12.848805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:44:12.848805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:44:12.848805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:44:12.848805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:12.848805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:12.848805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:12.848805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:12.848805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:12.848805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:12.848805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:12.848805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:12.848805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:12.848805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:12.848805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:12.848805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:12.849842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:12.849842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:12.849842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:12.849842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:12.849842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:44:12.849842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:44:12.849842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:44:12.849842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:44:12.849842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:44:12.849842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:44:12.849842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 20:44:12.849842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:12.849842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 521/1030] 10.222.0.15 () {56 vars in 1120 bytes} [Fri Sep 9 20:44:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:44:12.854495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7d415-352f-44fc-bdb2-42451f21e921 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:12.863017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefa250-3877-4bee-b779-8d49469e0deb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:12.900077 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf8aff-cc6e-43d6-ad12-25d45af175d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:12.901221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf8aff-cc6e-43d6-ad12-25d45af175d5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:12.901764 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf8aff-cc6e-43d6-ad12-25d45af175d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:12.902221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf8aff-cc6e-43d6-ad12-25d45af175d5 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:12.903948 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf8aff-cc6e-43d6-ad12-25d45af175d5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:12.904433 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf8aff-cc6e-43d6-ad12-25d45af175d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:12.906198 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf8aff-cc6e-43d6-ad12-25d45af175d5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:12.911869 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 510/1031] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:44:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:12.917119 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf8aff-cc6e-43d6-ad12-25d45af175d5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:12.922362 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:12.963206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d7d415-352f-44fc-bdb2-42451f21e921 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:12.983838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:13.000042 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5970cec-24a4-4619-8dc4-ad97077bc526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:13.000655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5970cec-24a4-4619-8dc4-ad97077bc526 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:13.000929 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5970cec-24a4-4619-8dc4-ad97077bc526 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:13.001194 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5970cec-24a4-4619-8dc4-ad97077bc526 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:13.001848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5970cec-24a4-4619-8dc4-ad97077bc526 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:13.002146 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5970cec-24a4-4619-8dc4-ad97077bc526 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:13.003498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5970cec-24a4-4619-8dc4-ad97077bc526 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:13.012035 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 522/1032] 10.222.0.15 () {56 vars in 1115 bytes} [Fri Sep 9 20:44:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:13.017133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5970cec-24a4-4619-8dc4-ad97077bc526 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:13.034327 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf8aff-cc6e-43d6-ad12-25d45af175d5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:13.069037 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689b3fb-802a-4e4f-8804-58639b777193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:13.069648 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689b3fb-802a-4e4f-8804-58639b777193 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:13.069926 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689b3fb-802a-4e4f-8804-58639b777193 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:13.070191 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689b3fb-802a-4e4f-8804-58639b777193 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:13.070804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689b3fb-802a-4e4f-8804-58639b777193 None admin] RBAC: Adding query filter params (type=image) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:13.071101 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689b3fb-802a-4e4f-8804-58639b777193 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:13.072511 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689b3fb-802a-4e4f-8804-58639b777193 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:13.080016 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 511/1033] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:44:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:13.083030 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689b3fb-802a-4e4f-8804-58639b777193 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:13.129952 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5970cec-24a4-4619-8dc4-ad97077bc526 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:13.156183 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:13.170385 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182518c2-c426-4114-91df-5035ed363c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:13.171017 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182518c2-c426-4114-91df-5035ed363c68 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:13.171291 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182518c2-c426-4114-91df-5035ed363c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:13.171560 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182518c2-c426-4114-91df-5035ed363c68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:13.182350 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182518c2-c426-4114-91df-5035ed363c68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:13.183797 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182518c2-c426-4114-91df-5035ed363c68 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:13.193034 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689b3fb-802a-4e4f-8804-58639b777193 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:13.198191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-182518c2-c426-4114-91df-5035ed363c68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:44:13.198191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:13.198191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:13.198191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:13.198191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:13.198191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:13.198191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:13.198191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:13.198191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:13.198191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:13.198191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:13.198191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:13.198191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:44:13.198191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:44:13.198191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:44:13.198191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:44:13.199108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:13.199108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:13.199108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:13.199108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:13.199108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:13.199108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:13.199108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:13.199108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:13.199108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:13.199108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:13.199108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:13.199108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:13.199108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:13.199108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:13.199108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:13.199108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:13.199108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:44:13.200084 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:44:13.200084 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:44:13.200084 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:13.204336 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 523/1034] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:44:13.205101 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182518c2-c426-4114-91df-5035ed363c68 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:13.217305 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:13.229726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9053f-7687-4e49-adeb-8c760378d902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:13.230345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9053f-7687-4e49-adeb-8c760378d902 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:13.230630 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9053f-7687-4e49-adeb-8c760378d902 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:13.230904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9053f-7687-4e49-adeb-8c760378d902 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:13.232411 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9053f-7687-4e49-adeb-8c760378d902 None admin] RBAC: Adding query filter params (interface=public, service_id=7f45cfb258dc472786aaa56c1e1a5201, region_id=RegionOne) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:13.232730 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9053f-7687-4e49-adeb-8c760378d902 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:13.234121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9053f-7687-4e49-adeb-8c760378d902 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:13.239255 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 512/1035] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Sep 9 20:44:13 2022] GET /identity/v3/endpoints?service_id=7f45cfb258dc472786aaa56c1e1a5201&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:13.244741 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9053f-7687-4e49-adeb-8c760378d902 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:13.316815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182518c2-c426-4114-91df-5035ed363c68 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:13.352072 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8c4ee-061e-4b4d-ab46-0b1650577561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:13.352685 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8c4ee-061e-4b4d-ab46-0b1650577561 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:13.352956 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8c4ee-061e-4b4d-ab46-0b1650577561 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:13.353226 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8c4ee-061e-4b4d-ab46-0b1650577561 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:13.353866 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8c4ee-061e-4b4d-ab46-0b1650577561 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:13.354166 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8c4ee-061e-4b4d-ab46-0b1650577561 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:13.355865 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8c4ee-061e-4b4d-ab46-0b1650577561 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:13.361258 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9053f-7687-4e49-adeb-8c760378d902 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:13.374330 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 524/1036] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:13.375149 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8c4ee-061e-4b4d-ab46-0b1650577561 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:13.396736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d93edd-576a-4427-9fb7-5b2ebe2dfc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:13.397270 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d93edd-576a-4427-9fb7-5b2ebe2dfc7d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:13.397549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d93edd-576a-4427-9fb7-5b2ebe2dfc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:13.397818 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d93edd-576a-4427-9fb7-5b2ebe2dfc7d None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:13.398828 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d93edd-576a-4427-9fb7-5b2ebe2dfc7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:13.400384 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d93edd-576a-4427-9fb7-5b2ebe2dfc7d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:13.407452 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 513/1037] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Sep 9 20:44:13 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:44:13.413914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:13.490695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8c4ee-061e-4b4d-ab46-0b1650577561 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:13.527745 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3e731-a833-4530-873c-45c278084c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:13.528617 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3e731-a833-4530-873c-45c278084c00 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:13.528939 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3e731-a833-4530-873c-45c278084c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:13.529255 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3e731-a833-4530-873c-45c278084c00 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:13.537487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3e731-a833-4530-873c-45c278084c00 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:13.538955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd3e731-a833-4530-873c-45c278084c00 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:13.552651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-bcd3e731-a833-4530-873c-45c278084c00 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 20:44:13.552651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:13.552651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:13.552651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:13.552651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:13.552651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:13.552651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:13.552651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:13.552651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:13.552651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:13.552651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:13.552651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:13.552651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:44:13.552651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:44:13.552651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:44:13.552651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:44:13.553704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:13.553704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:13.553704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:44:13.553704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:44:13.553704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:44:13.553704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:44:13.553704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:13.553704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:13.553704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:13.553704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:13.553704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:13.553704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:13.553704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:13.553704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:13.553704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:13.553704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:13.553704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:13.553704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:13.554759 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:13.554759 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:13.554759 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:44:13.554759 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:44:13.554759 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:44:13.554759 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:44:13.554759 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:44:13.554759 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:44:13.554759 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 20:44:13.554759 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:13.556324 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 525/1038] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Sep 9 20:44:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:44:13.560511 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d93edd-576a-4427-9fb7-5b2ebe2dfc7d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:13.620370 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:13.667061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d93edd-576a-4427-9fb7-5b2ebe2dfc7d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:13.701726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db935a-3391-40a3-a34e-cfc0429ab383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:13.702354 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db935a-3391-40a3-a34e-cfc0429ab383 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:13.702620 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db935a-3391-40a3-a34e-cfc0429ab383 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:13.702893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db935a-3391-40a3-a34e-cfc0429ab383 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:13.703614 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db935a-3391-40a3-a34e-cfc0429ab383 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:13.703919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db935a-3391-40a3-a34e-cfc0429ab383 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:13.705385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db935a-3391-40a3-a34e-cfc0429ab383 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:13.723553 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 514/1039] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Sep 9 20:44:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:13.729434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3e731-a833-4530-873c-45c278084c00 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:13.829467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:13.836631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3e731-a833-4530-873c-45c278084c00 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:13.871670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82a469-b8b0-43f8-9e81-4ccad6cab17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:13.872918 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82a469-b8b0-43f8-9e81-4ccad6cab17a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:13.873192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82a469-b8b0-43f8-9e81-4ccad6cab17a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:13.873468 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82a469-b8b0-43f8-9e81-4ccad6cab17a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:13.944402 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82a469-b8b0-43f8-9e81-4ccad6cab17a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:13.945844 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82a469-b8b0-43f8-9e81-4ccad6cab17a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:14.038214 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:14.050499 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 526/1040] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:44:13 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 20:44:14.052215 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db935a-3391-40a3-a34e-cfc0429ab383 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:14.154417 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db935a-3391-40a3-a34e-cfc0429ab383 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:14.164210 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:14.191043 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eaebcd-6ea4-41b4-9614-b206751ec67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:14.191678 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaebcd-6ea4-41b4-9614-b206751ec67d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:14.191952 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaebcd-6ea4-41b4-9614-b206751ec67d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:14.192245 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eaebcd-6ea4-41b4-9614-b206751ec67d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:14.203262 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eaebcd-6ea4-41b4-9614-b206751ec67d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:14.204678 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eaebcd-6ea4-41b4-9614-b206751ec67d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:14.219611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-08eaebcd-6ea4-41b4-9614-b206751ec67d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:44:14.219611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:14.219611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:14.219611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:14.219611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:14.219611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:14.219611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:14.219611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:14.219611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:14.219611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:14.219611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:14.219611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:14.219611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:44:14.219611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:44:14.219611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:44:14.219611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:44:14.220621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:14.220621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:14.220621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:14.220621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:14.220621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:14.220621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:14.220621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:14.220621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:14.220621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:14.220621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:14.220621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:14.220621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:14.220621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:14.220621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:14.220621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:14.220621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:14.220621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:44:14.221509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:44:14.221509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:44:14.221509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:14.224309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 515/1041] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:44:14.226356 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82a469-b8b0-43f8-9e81-4ccad6cab17a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:14.343479 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82a469-b8b0-43f8-9e81-4ccad6cab17a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:14.378743 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbcd20-6eb1-4bde-98df-26a15cd5d683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:14.379347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbcd20-6eb1-4bde-98df-26a15cd5d683 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:14.379625 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbcd20-6eb1-4bde-98df-26a15cd5d683 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:14.379904 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbcd20-6eb1-4bde-98df-26a15cd5d683 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:14.381065 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbcd20-6eb1-4bde-98df-26a15cd5d683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:14.381065 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbcd20-6eb1-4bde-98df-26a15cd5d683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:14.383490 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbcd20-6eb1-4bde-98df-26a15cd5d683 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:14.399557 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 527/1042] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:14.401114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eaebcd-6ea4-41b4-9614-b206751ec67d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:14.413779 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17d7be-c6ef-42e6-b831-5920badd4b7c None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:14.414071 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17d7be-c6ef-42e6-b831-5920badd4b7c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:14.414345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17d7be-c6ef-42e6-b831-5920badd4b7c None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:14.415801 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 528/1043] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:44:14.421146 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9141f65-db2d-456b-a11b-c634a82584d8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:14.421430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9141f65-db2d-456b-a11b-c634a82584d8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:14.421715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9141f65-db2d-456b-a11b-c634a82584d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:14.440527 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a9141f65-db2d-456b-a11b-c634a82584d8 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:14.441723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a9141f65-db2d-456b-a11b-c634a82584d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:14.497528 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:14.509845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eaebcd-6ea4-41b4-9614-b206751ec67d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:14.516548 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 529/1044] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 20:44:14.548134 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22341c-d4a9-4a7f-9d22-e9e84a7043c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:14.548770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22341c-d4a9-4a7f-9d22-e9e84a7043c6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:14.549047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22341c-d4a9-4a7f-9d22-e9e84a7043c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:14.549315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22341c-d4a9-4a7f-9d22-e9e84a7043c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:14.556131 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22341c-d4a9-4a7f-9d22-e9e84a7043c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:14.557658 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22341c-d4a9-4a7f-9d22-e9e84a7043c6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:14.568919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-fe22341c-d4a9-4a7f-9d22-e9e84a7043c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:44:14.568919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:14.568919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:14.568919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:14.568919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:14.568919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:14.568919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:14.568919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:14.568919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:14.568919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:14.568919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:14.568919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:14.568919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:44:14.568919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:44:14.568919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:44:14.569804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:44:14.569804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:14.569804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:14.569804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:14.569804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:14.569804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:14.569804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:14.569804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:14.569804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:14.569804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:14.569804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:14.569804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:14.569804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:14.569804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:14.569804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:14.569804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:14.569804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:14.570738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:44:14.570738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:44:14.570738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:44:14.570738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:44:14.570738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:44:14.570738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:44:14.570738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:44:14.570738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:14.571711 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 516/1045] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:44:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:44:14.576493 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9141f65-db2d-456b-a11b-c634a82584d8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:14.680334 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9141f65-db2d-456b-a11b-c634a82584d8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:14.716093 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7570c44-320a-4dbd-8f21-b20beda243b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:14.716695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7570c44-320a-4dbd-8f21-b20beda243b2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:14.716974 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7570c44-320a-4dbd-8f21-b20beda243b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:14.717247 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7570c44-320a-4dbd-8f21-b20beda243b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:14.717942 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7570c44-320a-4dbd-8f21-b20beda243b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:14.718249 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7570c44-320a-4dbd-8f21-b20beda243b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:14.719676 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7570c44-320a-4dbd-8f21-b20beda243b2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:14.736511 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 530/1046] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:44:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:14.737654 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22341c-d4a9-4a7f-9d22-e9e84a7043c6 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:14.760572 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:14.790840 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7570c44-320a-4dbd-8f21-b20beda243b2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:14.842730 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:14.850060 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22341c-d4a9-4a7f-9d22-e9e84a7043c6 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:14.885851 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c69cd5-941b-4885-adee-35d1b082d5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:14.886457 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c69cd5-941b-4885-adee-35d1b082d5ff None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:14.886732 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c69cd5-941b-4885-adee-35d1b082d5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:14.886996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c69cd5-941b-4885-adee-35d1b082d5ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:14.887840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c69cd5-941b-4885-adee-35d1b082d5ff None admin] RBAC: Adding query filter params (role.id=5e8e8a438e704946842357d01ab848a8, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=dc210376e57a41e6b3812110db249099) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:14.888175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c69cd5-941b-4885-adee-35d1b082d5ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:14.889603 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c69cd5-941b-4885-adee-35d1b082d5ff None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:14.895061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 517/1047] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:44:14 2022] GET /identity/v3/role_assignments?user.id=dc210376e57a41e6b3812110db249099&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=5e8e8a438e704946842357d01ab848a8 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:14.904963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7570c44-320a-4dbd-8f21-b20beda243b2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:14.944540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1d43e-56be-49ea-80c2-1a03e9840639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:14.945191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1d43e-56be-49ea-80c2-1a03e9840639 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:14.945468 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1d43e-56be-49ea-80c2-1a03e9840639 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:14.945739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1d43e-56be-49ea-80c2-1a03e9840639 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:14.960135 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1d43e-56be-49ea-80c2-1a03e9840639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:44:14.964994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f0e1d43e-56be-49ea-80c2-1a03e9840639 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:44:14.964994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:14.964994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:14.964994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:14.964994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:14.964994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:14.964994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:14.964994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:14.964994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:14.964994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:14.964994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:14.964994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:14.964994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:44:14.964994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:44:14.964994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:44:14.964994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:44:14.966553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:44:14.966553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:44:14.966553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:44:14.966553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:44:14.966553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:14.966553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:14.966553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:14.966553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:14.966553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:14.966553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:14.966553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:14.966553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:14.966553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:14.966553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:14.966553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:14.966553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:14.967399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:14.967399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:14.967399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:14.967399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:14.967399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:44:14.967399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:44:14.967399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:44:14.967399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:44:14.967399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:44:14.967399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:44:14.967399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:44:14.967399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:14.972035 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 531/1048] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:44:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:44:14.973473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c69cd5-941b-4885-adee-35d1b082d5ff None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:15.070909 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:15.088407 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c69cd5-941b-4885-adee-35d1b082d5ff None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:15.125126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163efbd8-e58f-4fd1-abae-9185ad2e28d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:15.125909 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163efbd8-e58f-4fd1-abae-9185ad2e28d9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:15.126290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163efbd8-e58f-4fd1-abae-9185ad2e28d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:15.126661 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163efbd8-e58f-4fd1-abae-9185ad2e28d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:15.127422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163efbd8-e58f-4fd1-abae-9185ad2e28d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:15.127826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163efbd8-e58f-4fd1-abae-9185ad2e28d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:15.129320 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163efbd8-e58f-4fd1-abae-9185ad2e28d9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:15.142947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 518/1049] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:44:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:15.144456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1d43e-56be-49ea-80c2-1a03e9840639 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:15.249294 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1d43e-56be-49ea-80c2-1a03e9840639 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:15.256867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:15.289752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb90384-b313-4670-93e5-ba1f64c13a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:15.290396 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb90384-b313-4670-93e5-ba1f64c13a11 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:15.290677 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb90384-b313-4670-93e5-ba1f64c13a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:15.290952 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb90384-b313-4670-93e5-ba1f64c13a11 None admin] PATH_INFO: `/v3/users/65f8f39f1ab64e419305f5b1c07f9701` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:15.307370 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb90384-b313-4670-93e5-ba1f64c13a11 None admin] RBAC: Authorizing `identity:get_user(user_id=65f8f39f1ab64e419305f5b1c07f9701)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:15.308863 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb90384-b313-4670-93e5-ba1f64c13a11 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:15.311678 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 532/1050] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:44:15 2022] GET /identity/v3/users/65f8f39f1ab64e419305f5b1c07f9701 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:15.317347 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163efbd8-e58f-4fd1-abae-9185ad2e28d9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:15.423926 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163efbd8-e58f-4fd1-abae-9185ad2e28d9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:15.457921 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b20f0-2faf-4370-a4de-c43db50ed4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:15.458589 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b20f0-2faf-4370-a4de-c43db50ed4f3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:15.458878 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b20f0-2faf-4370-a4de-c43db50ed4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:15.459155 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b20f0-2faf-4370-a4de-c43db50ed4f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:15.475246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:15.535083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b20f0-2faf-4370-a4de-c43db50ed4f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:15.536594 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b20f0-2faf-4370-a4de-c43db50ed4f3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:15.623425 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554994f0-0c6d-4bd5-90fe-7454b0ab974b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:15.623771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554994f0-0c6d-4bd5-90fe-7454b0ab974b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:15.623975 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554994f0-0c6d-4bd5-90fe-7454b0ab974b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:15.625498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 533/1051] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:44:15.630295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a550a64-5a69-4475-a044-f59ecdc39678 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:15.630584 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a550a64-5a69-4475-a044-f59ecdc39678 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:15.630865 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a550a64-5a69-4475-a044-f59ecdc39678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:15.644152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 519/1052] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:44:15 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 20:44:15.645321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b20f0-2faf-4370-a4de-c43db50ed4f3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:15.651360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5a550a64-5a69-4475-a044-f59ecdc39678 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:15.652597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5a550a64-5a69-4475-a044-f59ecdc39678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:15.695168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:15.724036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 534/1053] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:15 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 20:44:15.752081 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b20f0-2faf-4370-a4de-c43db50ed4f3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:15.789845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3d136-dbd8-48a0-814a-a870948544f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:15.790485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3d136-dbd8-48a0-814a-a870948544f0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:15.790767 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3d136-dbd8-48a0-814a-a870948544f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:15.791043 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3d136-dbd8-48a0-814a-a870948544f0 None admin] PATH_INFO: `/v3/projects/e740f1759ab84ca8a0e744ef97d0ba5a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:15.792187 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3d136-dbd8-48a0-814a-a870948544f0 None admin] RBAC: Authorizing `identity:get_project(project_id=e740f1759ab84ca8a0e744ef97d0ba5a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:15.793660 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3d136-dbd8-48a0-814a-a870948544f0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:15.800682 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 520/1054] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:44:15 2022] GET /identity/v3/projects/e740f1759ab84ca8a0e744ef97d0ba5a => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:15.801547 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a550a64-5a69-4475-a044-f59ecdc39678 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:15.897161 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:15.905611 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a550a64-5a69-4475-a044-f59ecdc39678 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:15.939785 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3520341-973e-4fb0-a7d3-9df57391892f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:15.940461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3520341-973e-4fb0-a7d3-9df57391892f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:15.940737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3520341-973e-4fb0-a7d3-9df57391892f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:15.941005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3520341-973e-4fb0-a7d3-9df57391892f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:15.941716 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3520341-973e-4fb0-a7d3-9df57391892f None admin] RBAC: Adding query filter params (role.id=be620fc7968740269d233c5ace94a563, scope.project.id=e740f1759ab84ca8a0e744ef97d0ba5a, user.id=65f8f39f1ab64e419305f5b1c07f9701) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:15.942023 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3520341-973e-4fb0-a7d3-9df57391892f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:15.943434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3520341-973e-4fb0-a7d3-9df57391892f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:15.952425 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 535/1055] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:44:15 2022] GET /identity/v3/role_assignments?user.id=65f8f39f1ab64e419305f5b1c07f9701&scope.project.id=e740f1759ab84ca8a0e744ef97d0ba5a&role.id=be620fc7968740269d233c5ace94a563 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:15.997906 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3d136-dbd8-48a0-814a-a870948544f0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:16.114726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3d136-dbd8-48a0-814a-a870948544f0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:16.131072 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:16.153558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d6fa7-9da6-46cc-8102-63acda868c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:16.154201 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d6fa7-9da6-46cc-8102-63acda868c3f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:16.154487 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d6fa7-9da6-46cc-8102-63acda868c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:16.154763 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d6fa7-9da6-46cc-8102-63acda868c3f None admin] PATH_INFO: `/v3/services/image` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:16.155347 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d6fa7-9da6-46cc-8102-63acda868c3f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:16.156802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d6fa7-9da6-46cc-8102-63acda868c3f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:16.165883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-323d6fa7-9da6-46cc-8102-63acda868c3f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 20:44:16.165883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:16.165883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:44:16.165883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:44:16.165883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:44:16.165883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:44:16.165883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:44:16.165883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:44:16.165883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 20:44:16.165883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:16.165883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:44:16.165883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:16.165883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:16.165883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:16.165883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:16.165883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:16.165883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:16.166891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:16.166891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:16.166891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:16.166891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:16.166891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:16.166891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:16.166891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:44:16.166891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:44:16.166891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:44:16.166891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:44:16.166891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:16.166891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:16.166891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:16.166891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:16.166891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:16.166891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:16.167726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:16.167726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:16.167726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:16.167726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:16.167726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:16.167726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:16.167726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:16.167726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:16.167726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:16.167726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:16.167726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:44:16.167726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:44:16.167726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 09 20:44:16.167726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:16.167726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 521/1056] 10.222.0.15 () {56 vars in 1105 bytes} [Fri Sep 9 20:44:15 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:44:16.173433 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3520341-973e-4fb0-a7d3-9df57391892f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:16.274456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3520341-973e-4fb0-a7d3-9df57391892f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:16.316699 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a4c13-f59d-4654-8c3a-deff4a1a92bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:16.317446 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a4c13-f59d-4654-8c3a-deff4a1a92bb None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:16.317826 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a4c13-f59d-4654-8c3a-deff4a1a92bb None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:16.318200 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a4c13-f59d-4654-8c3a-deff4a1a92bb None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:16.318933 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a4c13-f59d-4654-8c3a-deff4a1a92bb None admin] RBAC: Adding query filter params (name=image) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:16.319338 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a4c13-f59d-4654-8c3a-deff4a1a92bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:16.320876 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a4c13-f59d-4654-8c3a-deff4a1a92bb None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:16.326382 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 536/1057] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:44:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:16.331833 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d6fa7-9da6-46cc-8102-63acda868c3f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:16.438265 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d6fa7-9da6-46cc-8102-63acda868c3f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:16.472935 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fcb64-514c-4e5d-bfaf-906ad031c37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:16.473550 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fcb64-514c-4e5d-bfaf-906ad031c37e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:16.473832 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fcb64-514c-4e5d-bfaf-906ad031c37e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:16.474109 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fcb64-514c-4e5d-bfaf-906ad031c37e None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:16.474729 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fcb64-514c-4e5d-bfaf-906ad031c37e None admin] RBAC: Adding query filter params (type=image) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:16.475031 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fcb64-514c-4e5d-bfaf-906ad031c37e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:16.476438 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fcb64-514c-4e5d-bfaf-906ad031c37e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:16.486652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 522/1058] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:44:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:16.488263 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a4c13-f59d-4654-8c3a-deff4a1a92bb None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:16.514371 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:16.594880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a4c13-f59d-4654-8c3a-deff4a1a92bb None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:16.628373 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485423a-9d60-44b1-99c9-95c645e19b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:16.628985 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485423a-9d60-44b1-99c9-95c645e19b6d None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:16.629263 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485423a-9d60-44b1-99c9-95c645e19b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:16.629535 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485423a-9d60-44b1-99c9-95c645e19b6d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:16.630201 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485423a-9d60-44b1-99c9-95c645e19b6d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:16.631556 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485423a-9d60-44b1-99c9-95c645e19b6d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:16.654523 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 537/1059] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:44:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:44:17.060250 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a984111-9285-4064-9a35-ed3ef3cf83f3 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:17.060790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a984111-9285-4064-9a35-ed3ef3cf83f3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:17.060790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a984111-9285-4064-9a35-ed3ef3cf83f3 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:17.062174 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 523/1060] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:17.067422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82670c-6815-4998-baf6-876a47cfcde8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:17.067798 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82670c-6815-4998-baf6-876a47cfcde8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:17.067977 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d82670c-6815-4998-baf6-876a47cfcde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:17.086140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1d82670c-6815-4998-baf6-876a47cfcde8 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:17.087341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1d82670c-6815-4998-baf6-876a47cfcde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:17.162707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 538/1061] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:17.435532 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a984111-9285-4064-9a35-ed3ef3cf83f3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:17.483595 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:17.544289 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a984111-9285-4064-9a35-ed3ef3cf83f3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:17.581307 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0afad-1d3e-40e5-97a2-e62b564f9ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:17.581954 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0afad-1d3e-40e5-97a2-e62b564f9ad8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:17.582238 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0afad-1d3e-40e5-97a2-e62b564f9ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:17.582513 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0afad-1d3e-40e5-97a2-e62b564f9ad8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:17.594031 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0afad-1d3e-40e5-97a2-e62b564f9ad8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:44:17.598802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-68c0afad-1d3e-40e5-97a2-e62b564f9ad8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 20:44:17.598802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:17.598802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:17.598802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:17.598802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:17.598802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:17.598802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:17.598802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:17.598802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:17.598802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:17.598802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:17.598802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:17.598802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:44:17.598802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:44:17.598802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:44:17.598802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:44:17.599731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:44:17.599731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:44:17.599731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:44:17.599731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:44:17.599731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:17.599731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:17.599731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:17.599731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:17.599731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:17.599731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:17.599731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:17.599731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:17.599731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:17.599731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:17.599731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:17.599731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:17.600986 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:17.600986 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:17.600986 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:17.600986 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:17.600986 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:44:17.600986 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:44:17.600986 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:44:17.600986 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:44:17.600986 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:44:17.600986 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:44:17.600986 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 20:44:17.600986 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:17.604066 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 524/1062] 10.222.0.15 () {56 vars in 1120 bytes} [Fri Sep 9 20:44:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:44:17.606280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82670c-6815-4998-baf6-876a47cfcde8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:17.609398 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:17.707496 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d82670c-6815-4998-baf6-876a47cfcde8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:17.741476 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146a6cc-7da5-4871-ba04-eff66d82b05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:17.742083 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146a6cc-7da5-4871-ba04-eff66d82b05f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:17.742361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146a6cc-7da5-4871-ba04-eff66d82b05f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:17.742635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146a6cc-7da5-4871-ba04-eff66d82b05f None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:17.743295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146a6cc-7da5-4871-ba04-eff66d82b05f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:17.743600 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146a6cc-7da5-4871-ba04-eff66d82b05f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:17.745003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146a6cc-7da5-4871-ba04-eff66d82b05f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:17.758147 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 539/1063] 10.222.0.15 () {56 vars in 1115 bytes} [Fri Sep 9 20:44:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:17.759296 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0afad-1d3e-40e5-97a2-e62b564f9ad8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:17.862735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0afad-1d3e-40e5-97a2-e62b564f9ad8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:17.864295 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:17.899644 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ef507-c031-4722-b548-d7167f6868bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:17.900323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ef507-c031-4722-b548-d7167f6868bc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:17.900602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ef507-c031-4722-b548-d7167f6868bc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:17.901142 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ef507-c031-4722-b548-d7167f6868bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:17.911976 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ef507-c031-4722-b548-d7167f6868bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:17.913450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ef507-c031-4722-b548-d7167f6868bc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:17.929183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-5b1ef507-c031-4722-b548-d7167f6868bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:44:17.929183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:17.929183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:17.929183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:17.929183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:17.929183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:17.929183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:17.929183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:17.929183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:17.929183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:17.929183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:17.929183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:17.929183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:44:17.929183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:44:17.929183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:44:17.929183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:44:17.930203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:17.930203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:17.930203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:17.930203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:17.930203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:17.930203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:17.930203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:17.930203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:17.930203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:17.930203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:17.930203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:17.930203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:17.930203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:17.930203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:17.930203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:17.930203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:17.930203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:44:17.935872 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:44:17.935872 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:44:17.935872 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:17.935872 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 525/1064] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:44:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:44:17.937229 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146a6cc-7da5-4871-ba04-eff66d82b05f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:18.008946 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:18.045360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146a6cc-7da5-4871-ba04-eff66d82b05f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:18.078609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755ef02-46a0-4bd9-a5bc-77f64dc9f8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:18.079220 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755ef02-46a0-4bd9-a5bc-77f64dc9f8e6 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:18.079485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755ef02-46a0-4bd9-a5bc-77f64dc9f8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:18.079759 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755ef02-46a0-4bd9-a5bc-77f64dc9f8e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:18.080511 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755ef02-46a0-4bd9-a5bc-77f64dc9f8e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:18.082092 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631cde1-53f1-40d7-9d6f-373100e61d45 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:18.082466 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631cde1-53f1-40d7-9d6f-373100e61d45 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:18.082629 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631cde1-53f1-40d7-9d6f-373100e61d45 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:18.083949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 526/1065] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:44:18.084247 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755ef02-46a0-4bd9-a5bc-77f64dc9f8e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:18.085671 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755ef02-46a0-4bd9-a5bc-77f64dc9f8e6 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:18.088863 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaac653-d121-425c-90bc-78ce0ce02595 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:18.089144 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaac653-d121-425c-90bc-78ce0ce02595 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:18.089415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaac653-d121-425c-90bc-78ce0ce02595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:18.102898 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 540/1066] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:18.103941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755ef02-46a0-4bd9-a5bc-77f64dc9f8e6 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:18.109071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-eeaac653-d121-425c-90bc-78ce0ce02595 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:18.110252 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-eeaac653-d121-425c-90bc-78ce0ce02595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:18.190301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 527/1067] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 20:44:18.209463 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755ef02-46a0-4bd9-a5bc-77f64dc9f8e6 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:18.236493 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:18.245784 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97249196-8aa3-4a08-ac78-4a041c98cc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:18.246414 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97249196-8aa3-4a08-ac78-4a041c98cc09 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:18.246775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97249196-8aa3-4a08-ac78-4a041c98cc09 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:18.247050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97249196-8aa3-4a08-ac78-4a041c98cc09 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:18.254309 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97249196-8aa3-4a08-ac78-4a041c98cc09 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:18.255737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97249196-8aa3-4a08-ac78-4a041c98cc09 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:18.267843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-97249196-8aa3-4a08-ac78-4a041c98cc09 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 20:44:18.267843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:18.267843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:18.267843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:18.267843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:18.267843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:18.267843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:18.267843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:18.267843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:18.267843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:18.267843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:18.267843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:18.267843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:44:18.267843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:44:18.267843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:44:18.267843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:44:18.273790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:18.273790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:18.273790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:44:18.273790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:44:18.273790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:44:18.273790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:44:18.273790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:18.273790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:18.273790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:18.273790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:18.273790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:18.273790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:18.273790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:18.273790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:18.273790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:18.273790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:18.273790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:18.273790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:18.274775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:18.274775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:18.274775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:44:18.274775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:44:18.274775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:44:18.274775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:44:18.274775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:44:18.274775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:44:18.274775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 20:44:18.274775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:18.274775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 541/1068] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Sep 9 20:44:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:44:18.277250 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaac653-d121-425c-90bc-78ce0ce02595 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:18.370208 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:18.388199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaac653-d121-425c-90bc-78ce0ce02595 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:18.425639 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd4088-f12c-4912-8f8e-8fdb7b775c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:18.426253 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd4088-f12c-4912-8f8e-8fdb7b775c85 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:18.426533 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd4088-f12c-4912-8f8e-8fdb7b775c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:18.426809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd4088-f12c-4912-8f8e-8fdb7b775c85 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:18.427534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd4088-f12c-4912-8f8e-8fdb7b775c85 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:18.427835 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd4088-f12c-4912-8f8e-8fdb7b775c85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:18.429308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd4088-f12c-4912-8f8e-8fdb7b775c85 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:18.451865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 528/1069] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Sep 9 20:44:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:18.453545 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97249196-8aa3-4a08-ac78-4a041c98cc09 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:18.459624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd4088-f12c-4912-8f8e-8fdb7b775c85 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:18.567723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd4088-f12c-4912-8f8e-8fdb7b775c85 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:18.568152 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97249196-8aa3-4a08-ac78-4a041c98cc09 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:18.605572 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642ddd6-703a-4a90-95ca-a45a58e35b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:18.605952 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fffc4b-052e-4f45-8953-b117ff83c0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:18.606792 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642ddd6-703a-4a90-95ca-a45a58e35b13 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:18.607076 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642ddd6-703a-4a90-95ca-a45a58e35b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:18.607237 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fffc4b-052e-4f45-8953-b117ff83c0e2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:18.607333 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642ddd6-703a-4a90-95ca-a45a58e35b13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:18.607555 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fffc4b-052e-4f45-8953-b117ff83c0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:18.607822 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fffc4b-052e-4f45-8953-b117ff83c0e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:18.618868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fffc4b-052e-4f45-8953-b117ff83c0e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:18.619678 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642ddd6-703a-4a90-95ca-a45a58e35b13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:44:18.620331 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fffc4b-052e-4f45-8953-b117ff83c0e2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:18.624800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-3642ddd6-703a-4a90-95ca-a45a58e35b13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:44:18.624800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:18.624800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:18.624800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:18.624800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:18.624800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:18.624800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:18.624800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:18.624800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:18.624800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:18.624800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:18.624800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:18.624800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:44:18.624800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:44:18.624800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:44:18.624800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:44:18.625731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:44:18.625731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:44:18.625731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:44:18.625731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:44:18.625731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:18.625731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:18.625731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:18.625731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:18.625731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:18.625731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:18.625731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:18.625731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:18.625731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:18.625731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:18.625731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:18.625731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:18.626582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:18.626582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:18.626582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:18.626582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:18.626582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:44:18.626582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:44:18.626582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:44:18.626582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:44:18.626582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:44:18.626582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:44:18.626582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:44:18.626582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:18.626582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 529/1070] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:44:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:44:18.631636 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642ddd6-703a-4a90-95ca-a45a58e35b13 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:18.634876 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:18.640410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-42fffc4b-052e-4f45-8953-b117ff83c0e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:44:18.640410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:18.640410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:18.640410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:18.640410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:18.640410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:18.640410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:18.640410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:18.640410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:18.640410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:18.640410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:18.640410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:18.640410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:44:18.640410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:44:18.640410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:44:18.640410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:44:18.641365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:18.641365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:18.641365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:18.641365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:18.641365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:18.641365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:18.641365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:18.641365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:18.641365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:18.641365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:18.641365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:18.641365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:18.641365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:18.641365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:18.641365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:18.641365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:18.641365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:44:18.647675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:44:18.647675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:44:18.647675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:18.647675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 542/1071] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:44:18.647675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fffc4b-052e-4f45-8953-b117ff83c0e2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:18.691323 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:18.748563 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642ddd6-703a-4a90-95ca-a45a58e35b13 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:18.758723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fffc4b-052e-4f45-8953-b117ff83c0e2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:18.789418 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e71a32-32cd-4c93-a004-0635684d589e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:18.790063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e71a32-32cd-4c93-a004-0635684d589e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:18.790346 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e71a32-32cd-4c93-a004-0635684d589e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:18.790618 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e71a32-32cd-4c93-a004-0635684d589e None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:18.791398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e71a32-32cd-4c93-a004-0635684d589e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:18.791826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e71a32-32cd-4c93-a004-0635684d589e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:18.793237 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e71a32-32cd-4c93-a004-0635684d589e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:18.797588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8829ba-874a-4a01-b340-0eaa55234a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:18.798205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8829ba-874a-4a01-b340-0eaa55234a91 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:18.798480 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8829ba-874a-4a01-b340-0eaa55234a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:18.798753 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8829ba-874a-4a01-b340-0eaa55234a91 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:18.799373 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8829ba-874a-4a01-b340-0eaa55234a91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:18.799675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8829ba-874a-4a01-b340-0eaa55234a91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:18.801043 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8829ba-874a-4a01-b340-0eaa55234a91 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:18.803224 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 530/1072] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:44:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:18.808756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e71a32-32cd-4c93-a004-0635684d589e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:18.818777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 543/1073] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:18.819724 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8829ba-874a-4a01-b340-0eaa55234a91 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:18.875473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:18.914851 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e71a32-32cd-4c93-a004-0635684d589e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:18.921226 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:18.926426 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8829ba-874a-4a01-b340-0eaa55234a91 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:18.949534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5923ca-3a35-4497-a592-71bb42acd9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:18.950704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5923ca-3a35-4497-a592-71bb42acd9ef None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:18.950990 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5923ca-3a35-4497-a592-71bb42acd9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:18.951262 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5923ca-3a35-4497-a592-71bb42acd9ef None admin] PATH_INFO: `/v3/users/65f8f39f1ab64e419305f5b1c07f9701` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:18.952436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5923ca-3a35-4497-a592-71bb42acd9ef None admin] RBAC: Authorizing `identity:get_user(user_id=65f8f39f1ab64e419305f5b1c07f9701)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:18.953882 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5923ca-3a35-4497-a592-71bb42acd9ef None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:18.955474 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 531/1074] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:44:18 2022] GET /identity/v3/users/65f8f39f1ab64e419305f5b1c07f9701 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:18.956614 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b1b47-a1f7-4fa3-9f73-e4265a3cc85e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:18.956897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b1b47-a1f7-4fa3-9f73-e4265a3cc85e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:18.957171 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b1b47-a1f7-4fa3-9f73-e4265a3cc85e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:18.958563 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 532/1075] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:18.961025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b1b47-a1f7-4fa3-9f73-e4265a3cc85e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:18.961135 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3452a98-eb61-449a-827e-4f1adeadf56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:18.961761 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3452a98-eb61-449a-827e-4f1adeadf56e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:18.962062 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3452a98-eb61-449a-827e-4f1adeadf56e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:18.962585 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3452a98-eb61-449a-827e-4f1adeadf56e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:18.970292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3452a98-eb61-449a-827e-4f1adeadf56e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:18.972154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3452a98-eb61-449a-827e-4f1adeadf56e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:18.983642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-b3452a98-eb61-449a-827e-4f1adeadf56e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:44:18.983642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:18.983642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:18.983642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:18.983642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:18.983642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:18.983642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:18.983642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:18.983642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:18.983642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:18.983642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:18.983642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:18.983642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:44:18.983642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:44:18.983642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:44:18.984780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:44:18.984780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:18.984780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:18.984780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:18.984780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:18.984780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:18.984780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:18.984780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:18.984780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:18.984780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:18.984780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:18.984780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:18.984780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:18.984780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:18.984780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:18.984780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:18.984780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:18.985879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:44:18.985879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:44:18.985879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:44:18.985879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:44:18.985879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:44:18.985879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:44:18.985879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:44:18.985879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:18.985879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 544/1076] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:44:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:44:18.985879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcbc00-003a-4f76-91c6-4365ca721c53 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:18.986544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcbc00-003a-4f76-91c6-4365ca721c53 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:18.986544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcbc00-003a-4f76-91c6-4365ca721c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:19.003656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3afcbc00-003a-4f76-91c6-4365ca721c53 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:19.004881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3afcbc00-003a-4f76-91c6-4365ca721c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:19.069777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b1b47-a1f7-4fa3-9f73-e4265a3cc85e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:19.075052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 545/1077] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:19.076141 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcbc00-003a-4f76-91c6-4365ca721c53 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:19.103695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:19.110153 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4918a-6d02-4e5f-94dd-5313afa5d431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:19.110777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4918a-6d02-4e5f-94dd-5313afa5d431 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:19.111048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4918a-6d02-4e5f-94dd-5313afa5d431 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:19.111512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4918a-6d02-4e5f-94dd-5313afa5d431 None admin] PATH_INFO: `/v3/projects/e740f1759ab84ca8a0e744ef97d0ba5a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:19.112926 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4918a-6d02-4e5f-94dd-5313afa5d431 None admin] RBAC: Authorizing `identity:get_project(project_id=e740f1759ab84ca8a0e744ef97d0ba5a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:19.114383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4918a-6d02-4e5f-94dd-5313afa5d431 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:19.121039 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 533/1078] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:44:18 2022] GET /identity/v3/projects/e740f1759ab84ca8a0e744ef97d0ba5a => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:19.122268 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4918a-6d02-4e5f-94dd-5313afa5d431 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:19.170802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:19.184586 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcbc00-003a-4f76-91c6-4365ca721c53 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:19.223233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81a197-6c8b-4854-bb8c-bb8497c1bef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:19.223839 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81a197-6c8b-4854-bb8c-bb8497c1bef8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:19.224145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81a197-6c8b-4854-bb8c-bb8497c1bef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:19.224416 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81a197-6c8b-4854-bb8c-bb8497c1bef8 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:19.225097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81a197-6c8b-4854-bb8c-bb8497c1bef8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:19.225395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81a197-6c8b-4854-bb8c-bb8497c1bef8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:19.226824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81a197-6c8b-4854-bb8c-bb8497c1bef8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:19.229436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4918a-6d02-4e5f-94dd-5313afa5d431 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:19.238946 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 546/1079] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:44:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:19.244735 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81a197-6c8b-4854-bb8c-bb8497c1bef8 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:19.267952 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b207dc-38ff-49b2-ad6d-205812e77ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:19.268961 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b207dc-38ff-49b2-ad6d-205812e77ba5 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:19.269547 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b207dc-38ff-49b2-ad6d-205812e77ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:19.270141 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b207dc-38ff-49b2-ad6d-205812e77ba5 None admin] PATH_INFO: `/v3/projects/e740f1759ab84ca8a0e744ef97d0ba5a/users/65f8f39f1ab64e419305f5b1c07f9701/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:19.272512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b207dc-38ff-49b2-ad6d-205812e77ba5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e740f1759ab84ca8a0e744ef97d0ba5a, user_id=65f8f39f1ab64e419305f5b1c07f9701, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:19.274310 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b207dc-38ff-49b2-ad6d-205812e77ba5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:19.295976 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 534/1080] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:44:19 2022] PUT /identity/v3/projects/e740f1759ab84ca8a0e744ef97d0ba5a/users/65f8f39f1ab64e419305f5b1c07f9701/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:44:19.347247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b207dc-38ff-49b2-ad6d-205812e77ba5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:19.364229 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81a197-6c8b-4854-bb8c-bb8497c1bef8 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:19.403340 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79faf7c-7774-448c-b36d-63898f3fca8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:19.404045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79faf7c-7774-448c-b36d-63898f3fca8f None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:19.404330 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79faf7c-7774-448c-b36d-63898f3fca8f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:19.404577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79faf7c-7774-448c-b36d-63898f3fca8f None admin] PATH_INFO: `/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/dc210376e57a41e6b3812110db249099/roles/5e8e8a438e704946842357d01ab848a8` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:19.406875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79faf7c-7774-448c-b36d-63898f3fca8f None admin] RBAC: Authorizing `identity:create_grant(project_id=a57df41195d240fe8f28ac49bfd37921, user_id=dc210376e57a41e6b3812110db249099, role_id=5e8e8a438e704946842357d01ab848a8)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:19.408369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79faf7c-7774-448c-b36d-63898f3fca8f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:19.419776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:19.432147 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 547/1081] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:44:19 2022] PUT /identity/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/dc210376e57a41e6b3812110db249099/roles/5e8e8a438e704946842357d01ab848a8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:44:19.476970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b207dc-38ff-49b2-ad6d-205812e77ba5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:19.518354 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05762e2-9559-44e8-b561-6c567f38ab92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:19.518993 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05762e2-9559-44e8-b561-6c567f38ab92 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:19.519274 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05762e2-9559-44e8-b561-6c567f38ab92 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:19.519546 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05762e2-9559-44e8-b561-6c567f38ab92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:19.595215 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05762e2-9559-44e8-b561-6c567f38ab92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:19.596746 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05762e2-9559-44e8-b561-6c567f38ab92 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:19.664336 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:19.712019 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 535/1082] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:44:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 20:44:19.715149 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79faf7c-7774-448c-b36d-63898f3fca8f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:19.727080 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:19.823624 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79faf7c-7774-448c-b36d-63898f3fca8f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:19.857854 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0095c91-aa92-455d-9565-8bc0cfff9b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:19.858487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0095c91-aa92-455d-9565-8bc0cfff9b61 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:19.858762 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0095c91-aa92-455d-9565-8bc0cfff9b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:19.859034 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0095c91-aa92-455d-9565-8bc0cfff9b61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:19.869575 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0095c91-aa92-455d-9565-8bc0cfff9b61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:19.871011 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0095c91-aa92-455d-9565-8bc0cfff9b61 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:19.885998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-b0095c91-aa92-455d-9565-8bc0cfff9b61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:44:19.885998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:19.885998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:19.885998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:19.885998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:19.885998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:19.885998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:19.885998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:19.885998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:19.885998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:19.885998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:19.885998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:19.885998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:44:19.885998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:44:19.885998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:44:19.885998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:44:19.887052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:19.887052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:19.887052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:19.887052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:19.887052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:19.887052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:19.887052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:19.887052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:19.887052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:19.887052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:19.887052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:19.887052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:19.887052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:19.887052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:19.887052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:19.887052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:19.887052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:44:19.888646 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:44:19.888646 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:44:19.888646 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:19.888646 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 548/1083] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:44:19.897123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05762e2-9559-44e8-b561-6c567f38ab92 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:20.002246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05762e2-9559-44e8-b561-6c567f38ab92 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:20.036821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6861c-4b56-412a-8f24-370bca32460f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:20.037431 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6861c-4b56-412a-8f24-370bca32460f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:20.037712 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6861c-4b56-412a-8f24-370bca32460f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:20.037987 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6861c-4b56-412a-8f24-370bca32460f None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:20.038619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6861c-4b56-412a-8f24-370bca32460f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:20.038930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6861c-4b56-412a-8f24-370bca32460f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:20.040324 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6861c-4b56-412a-8f24-370bca32460f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:20.060033 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 536/1084] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:21.514841 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5489b2-93da-4977-a395-7769bb832607 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:21.515399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5489b2-93da-4977-a395-7769bb832607 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:21.515399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5489b2-93da-4977-a395-7769bb832607 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:21.516795 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 549/1085] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:21.522627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb6522-3619-4c48-b50d-7939fb4d3a3a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:21.523139 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb6522-3619-4c48-b50d-7939fb4d3a3a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:21.523237 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb6522-3619-4c48-b50d-7939fb4d3a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:21.541709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d7cb6522-3619-4c48-b50d-7939fb4d3a3a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:21.542879 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d7cb6522-3619-4c48-b50d-7939fb4d3a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:21.557410 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:21.610421 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 537/1086] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:21.610793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63902b9-f7cd-4160-bd76-1401cf9e0db4 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:21.611074 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63902b9-f7cd-4160-bd76-1401cf9e0db4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:21.611345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63902b9-f7cd-4160-bd76-1401cf9e0db4 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:21.612687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 550/1087] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:44:21.617738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f01ec7-ff48-42f6-902f-83c7ba91a985 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:21.618032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f01ec7-ff48-42f6-902f-83c7ba91a985 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:21.618308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f01ec7-ff48-42f6-902f-83c7ba91a985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:21.636633 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e8f01ec7-ff48-42f6-902f-83c7ba91a985 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:21.638361 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e8f01ec7-ff48-42f6-902f-83c7ba91a985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:21.704494 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 538/1088] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:21.883159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63902b9-f7cd-4160-bd76-1401cf9e0db4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:21.942721 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:21.971008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f01ec7-ff48-42f6-902f-83c7ba91a985 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:21.987417 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63902b9-f7cd-4160-bd76-1401cf9e0db4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:22.021787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76dee6-3499-47d7-adad-974e3b288da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:22.022420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76dee6-3499-47d7-adad-974e3b288da9 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:22.022702 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76dee6-3499-47d7-adad-974e3b288da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:22.022977 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76dee6-3499-47d7-adad-974e3b288da9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:22.034743 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76dee6-3499-47d7-adad-974e3b288da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:44:22.039466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-ec76dee6-3499-47d7-adad-974e3b288da9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:44:22.039466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:22.039466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:22.039466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:22.039466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:22.039466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:22.039466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:22.039466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:22.039466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:22.039466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:22.039466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:22.039466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:22.039466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:44:22.039466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:44:22.039466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:44:22.039466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:44:22.040638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:44:22.040638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:44:22.040638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:44:22.040638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:44:22.040638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:22.040638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:22.040638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:22.040638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:22.040638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:22.040638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:22.040638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:22.040638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:22.040638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:22.040638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:22.040638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:22.040638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:22.041483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:22.041483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:22.041483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:22.041483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:22.041483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:44:22.041483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:44:22.041483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:44:22.041483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:44:22.041483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:44:22.041483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:44:22.041483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:44:22.041483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:22.041483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 551/1089] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:44:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:44:22.047075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76dee6-3499-47d7-adad-974e3b288da9 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:22.051109 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:22.070203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f01ec7-ff48-42f6-902f-83c7ba91a985 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:22.105411 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cbb1a-8cd6-4edc-8667-494bc63ce63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:22.106069 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cbb1a-8cd6-4edc-8667-494bc63ce63d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:22.106348 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cbb1a-8cd6-4edc-8667-494bc63ce63d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:22.106626 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cbb1a-8cd6-4edc-8667-494bc63ce63d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:22.116651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257cbb1a-8cd6-4edc-8667-494bc63ce63d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:44:22.122212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-257cbb1a-8cd6-4edc-8667-494bc63ce63d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 20:44:22.122212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:22.122212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:22.122212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:22.122212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:22.122212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:22.122212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:22.122212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:22.122212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:22.122212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:22.122212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:22.122212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:22.122212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:44:22.122212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:44:22.122212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:44:22.122212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:44:22.123386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:44:22.123386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:44:22.123386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:44:22.123386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:44:22.123386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:22.123386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:22.123386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:22.123386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:22.123386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:22.123386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:22.123386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:22.123386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:22.123386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:22.123386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:22.123386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:22.123386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:22.124249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:22.124249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:22.124249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:22.124249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:22.124249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:44:22.124249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:44:22.124249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:44:22.124249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:44:22.124249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:44:22.124249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:44:22.124249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 09 20:44:22.124249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:22.124249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 539/1090] 10.222.0.15 () {56 vars in 1120 bytes} [Fri Sep 9 20:44:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:44:22.129000 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cbb1a-8cd6-4edc-8667-494bc63ce63d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:22.150566 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76dee6-3499-47d7-adad-974e3b288da9 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:22.170484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:22.186742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec8b46-d96a-44db-8eb7-df908e16fc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:22.187354 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec8b46-d96a-44db-8eb7-df908e16fc3c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:22.187634 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec8b46-d96a-44db-8eb7-df908e16fc3c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:22.187910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec8b46-d96a-44db-8eb7-df908e16fc3c None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:22.188605 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec8b46-d96a-44db-8eb7-df908e16fc3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:22.188913 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec8b46-d96a-44db-8eb7-df908e16fc3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:22.190275 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec8b46-d96a-44db-8eb7-df908e16fc3c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:22.198257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 552/1091] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:44:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:22.204767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec8b46-d96a-44db-8eb7-df908e16fc3c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:22.230995 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257cbb1a-8cd6-4edc-8667-494bc63ce63d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:22.267927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db62f77-2855-4e6e-bfd3-bf294e5544a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:22.268565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db62f77-2855-4e6e-bfd3-bf294e5544a4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:22.268846 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db62f77-2855-4e6e-bfd3-bf294e5544a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:22.269121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db62f77-2855-4e6e-bfd3-bf294e5544a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:22.269774 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db62f77-2855-4e6e-bfd3-bf294e5544a4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:22.270077 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db62f77-2855-4e6e-bfd3-bf294e5544a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:22.271452 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db62f77-2855-4e6e-bfd3-bf294e5544a4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:22.280562 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 540/1092] 10.222.0.15 () {56 vars in 1115 bytes} [Fri Sep 9 20:44:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:22.287523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db62f77-2855-4e6e-bfd3-bf294e5544a4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:22.290260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:22.305222 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec8b46-d96a-44db-8eb7-df908e16fc3c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:22.339880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2e4f5-9186-4ccc-b162-6a1e7821543b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:22.341119 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2e4f5-9186-4ccc-b162-6a1e7821543b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:22.341394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2e4f5-9186-4ccc-b162-6a1e7821543b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:22.341666 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a2e4f5-9186-4ccc-b162-6a1e7821543b None admin] PATH_INFO: `/v3/users/65f8f39f1ab64e419305f5b1c07f9701` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:22.342805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2e4f5-9186-4ccc-b162-6a1e7821543b None admin] RBAC: Authorizing `identity:get_user(user_id=65f8f39f1ab64e419305f5b1c07f9701)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:22.344322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a2e4f5-9186-4ccc-b162-6a1e7821543b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:22.345931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 553/1093] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:44:22 2022] GET /identity/v3/users/65f8f39f1ab64e419305f5b1c07f9701 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:22.351570 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2e4f5-9186-4ccc-b162-6a1e7821543b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:22.391902 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db62f77-2855-4e6e-bfd3-bf294e5544a4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:22.402006 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:22.427876 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf6d58-e00e-413f-91a5-2e631bb99766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:22.428554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf6d58-e00e-413f-91a5-2e631bb99766 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:22.428837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf6d58-e00e-413f-91a5-2e631bb99766 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:22.429113 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf6d58-e00e-413f-91a5-2e631bb99766 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:22.439559 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf6d58-e00e-413f-91a5-2e631bb99766 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:22.441535 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf6d58-e00e-413f-91a5-2e631bb99766 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:22.455477 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a2e4f5-9186-4ccc-b162-6a1e7821543b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:22.456116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-5faf6d58-e00e-413f-91a5-2e631bb99766 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:44:22.456116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:22.456116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:22.456116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:22.456116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:22.456116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:22.456116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:22.456116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:22.456116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:22.456116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:22.456116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:22.456116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:22.456116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:44:22.456116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:44:22.456116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:44:22.456116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:44:22.457235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:22.457235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:22.457235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:22.457235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:22.457235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:22.457235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:22.457235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:22.457235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:22.457235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:22.457235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:22.457235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:22.457235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:22.457235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:22.457235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:22.457235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:22.457235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:22.457235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:44:22.458316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:44:22.458316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:44:22.458316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:22.458316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 541/1094] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:44:22.462868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf6d58-e00e-413f-91a5-2e631bb99766 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:22.491345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d75ab-3c68-4b18-a9c6-f045e831a67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:22.491960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d75ab-3c68-4b18-a9c6-f045e831a67b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:22.492266 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d75ab-3c68-4b18-a9c6-f045e831a67b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:22.492537 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d75ab-3c68-4b18-a9c6-f045e831a67b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:22.518298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:22.558522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d75ab-3c68-4b18-a9c6-f045e831a67b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:22.560077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d75ab-3c68-4b18-a9c6-f045e831a67b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:22.563468 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf6d58-e00e-413f-91a5-2e631bb99766 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:22.597947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360952e-6311-4fe5-90a2-9e646d97e60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:22.598554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360952e-6311-4fe5-90a2-9e646d97e60d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:22.598843 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360952e-6311-4fe5-90a2-9e646d97e60d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:22.599117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360952e-6311-4fe5-90a2-9e646d97e60d None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:22.599754 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360952e-6311-4fe5-90a2-9e646d97e60d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:22.600095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360952e-6311-4fe5-90a2-9e646d97e60d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:22.601470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360952e-6311-4fe5-90a2-9e646d97e60d None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:22.607201 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:22.614111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 542/1095] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:22.619634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360952e-6311-4fe5-90a2-9e646d97e60d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:22.658217 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 554/1096] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:44:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 20:44:22.664092 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d75ab-3c68-4b18-a9c6-f045e831a67b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:22.720088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360952e-6311-4fe5-90a2-9e646d97e60d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:22.734400 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:22.755911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd26571-b965-4e1c-a530-332dca43f384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:22.756573 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd26571-b965-4e1c-a530-332dca43f384 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:22.756882 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd26571-b965-4e1c-a530-332dca43f384 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:22.757159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd26571-b965-4e1c-a530-332dca43f384 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:22.761244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d75ab-3c68-4b18-a9c6-f045e831a67b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:22.764126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd26571-b965-4e1c-a530-332dca43f384 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:22.765586 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd26571-b965-4e1c-a530-332dca43f384 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:22.779227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-8bd26571-b965-4e1c-a530-332dca43f384 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 09 20:44:22.779227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:22.779227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:22.779227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:22.779227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:22.779227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:22.779227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:22.779227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:22.779227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:22.779227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:22.779227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:22.779227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:22.779227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:44:22.779227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:44:22.779227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:44:22.779227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:44:22.780368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:22.780368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:22.780368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:44:22.780368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:44:22.780368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:44:22.780368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:44:22.780368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:22.780368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:22.780368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:22.780368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:22.780368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:22.780368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:22.780368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:22.780368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:22.780368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:22.780368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:22.780368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:22.780368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:22.781341 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:22.781341 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:22.781341 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:44:22.781341 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:44:22.781341 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:44:22.781341 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:44:22.781341 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:44:22.781341 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:44:22.781341 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 09 20:44:22.781341 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:22.781341 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 543/1097] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Sep 9 20:44:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:44:22.786016 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd26571-b965-4e1c-a530-332dca43f384 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:22.799398 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138d7fd-4745-4038-8e27-0d89a07c1028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:22.800059 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138d7fd-4745-4038-8e27-0d89a07c1028 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:22.800340 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138d7fd-4745-4038-8e27-0d89a07c1028 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:22.800612 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138d7fd-4745-4038-8e27-0d89a07c1028 None admin] PATH_INFO: `/v3/projects/e740f1759ab84ca8a0e744ef97d0ba5a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:22.801710 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138d7fd-4745-4038-8e27-0d89a07c1028 None admin] RBAC: Authorizing `identity:get_project(project_id=e740f1759ab84ca8a0e744ef97d0ba5a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:22.803140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9138d7fd-4745-4038-8e27-0d89a07c1028 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:22.804801 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 555/1098] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:44:22 2022] GET /identity/v3/projects/e740f1759ab84ca8a0e744ef97d0ba5a => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:22.811444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138d7fd-4745-4038-8e27-0d89a07c1028 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:22.829197 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:22.890810 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd26571-b965-4e1c-a530-332dca43f384 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:22.909118 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138d7fd-4745-4038-8e27-0d89a07c1028 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:22.924819 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5df73-74f0-4a6b-86fd-e095f6901d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:22.925430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5df73-74f0-4a6b-86fd-e095f6901d46 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:22.925712 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5df73-74f0-4a6b-86fd-e095f6901d46 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:22.925987 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5df73-74f0-4a6b-86fd-e095f6901d46 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:22.926708 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5df73-74f0-4a6b-86fd-e095f6901d46 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:22.927018 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5df73-74f0-4a6b-86fd-e095f6901d46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:22.928494 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5df73-74f0-4a6b-86fd-e095f6901d46 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:22.943504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96ecac-55ff-4410-bcbf-45fec775b832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:22.944128 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96ecac-55ff-4410-bcbf-45fec775b832 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:22.944407 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96ecac-55ff-4410-bcbf-45fec775b832 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:22.944685 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96ecac-55ff-4410-bcbf-45fec775b832 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:22.945398 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96ecac-55ff-4410-bcbf-45fec775b832 None admin] RBAC: Adding query filter params (role.id=be620fc7968740269d233c5ace94a563, scope.project.id=e740f1759ab84ca8a0e744ef97d0ba5a, user.id=65f8f39f1ab64e419305f5b1c07f9701) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:22.945705 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96ecac-55ff-4410-bcbf-45fec775b832 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:22.946630 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 544/1099] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Sep 9 20:44:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:22.947116 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96ecac-55ff-4410-bcbf-45fec775b832 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:22.952373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5df73-74f0-4a6b-86fd-e095f6901d46 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:22.953291 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 556/1100] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:44:22 2022] GET /identity/v3/role_assignments?user.id=65f8f39f1ab64e419305f5b1c07f9701&scope.project.id=e740f1759ab84ca8a0e744ef97d0ba5a&role.id=be620fc7968740269d233c5ace94a563 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:22.985956 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:23.061364 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5df73-74f0-4a6b-86fd-e095f6901d46 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:23.098172 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e173e5b-2526-488c-9157-afa6cc2af187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:23.098804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e173e5b-2526-488c-9157-afa6cc2af187 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:23.099084 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e173e5b-2526-488c-9157-afa6cc2af187 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:23.099356 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e173e5b-2526-488c-9157-afa6cc2af187 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:23.170702 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e173e5b-2526-488c-9157-afa6cc2af187 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:23.172119 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e173e5b-2526-488c-9157-afa6cc2af187 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:23.201386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:23.269498 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 545/1101] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:44:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 20:44:23.275322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96ecac-55ff-4410-bcbf-45fec775b832 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:23.359876 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:23.377787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96ecac-55ff-4410-bcbf-45fec775b832 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:23.411788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2b789-11e6-4ffa-a9e0-e0c82f85f140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:23.412448 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2b789-11e6-4ffa-a9e0-e0c82f85f140 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:23.412725 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2b789-11e6-4ffa-a9e0-e0c82f85f140 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:23.412996 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2b789-11e6-4ffa-a9e0-e0c82f85f140 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:23.423503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2b789-11e6-4ffa-a9e0-e0c82f85f140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:23.424925 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2b789-11e6-4ffa-a9e0-e0c82f85f140 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:23.439224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-8fc2b789-11e6-4ffa-a9e0-e0c82f85f140 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:44:23.439224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:23.439224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:23.439224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:23.439224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:23.439224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:23.439224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:23.439224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:23.439224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:23.439224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:23.439224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:23.439224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:23.439224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:44:23.439224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:44:23.439224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:44:23.439224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:44:23.440366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:23.440366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:23.440366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:23.440366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:23.440366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:23.440366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:23.440366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:23.440366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:23.440366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:23.440366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:23.440366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:23.440366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:23.440366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:23.440366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:23.440366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:23.440366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:23.440366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:44:23.441317 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:44:23.441317 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:44:23.441317 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:23.441317 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 557/1102] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:44:23.446063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e173e5b-2526-488c-9157-afa6cc2af187 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:23.546983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e173e5b-2526-488c-9157-afa6cc2af187 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:23.575709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:23.580792 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b57ecf-eea6-40e6-8099-abb2e58cc431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:23.581394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b57ecf-eea6-40e6-8099-abb2e58cc431 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:23.581671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b57ecf-eea6-40e6-8099-abb2e58cc431 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:23.581937 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b57ecf-eea6-40e6-8099-abb2e58cc431 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:23.582558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b57ecf-eea6-40e6-8099-abb2e58cc431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:23.582854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b57ecf-eea6-40e6-8099-abb2e58cc431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:23.584234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b57ecf-eea6-40e6-8099-abb2e58cc431 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:23.595760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 546/1103] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:23.601368 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2b789-11e6-4ffa-a9e0-e0c82f85f140 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:23.700758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2b789-11e6-4ffa-a9e0-e0c82f85f140 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:23.733228 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfa9b8-8e96-4a1c-8606-9f192ff12984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:23.733852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfa9b8-8e96-4a1c-8606-9f192ff12984 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:23.734132 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfa9b8-8e96-4a1c-8606-9f192ff12984 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:23.734406 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cfa9b8-8e96-4a1c-8606-9f192ff12984 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:23.736282 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:23.741980 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cfa9b8-8e96-4a1c-8606-9f192ff12984 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:23.743562 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cfa9b8-8e96-4a1c-8606-9f192ff12984 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:23.755381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-49cfa9b8-8e96-4a1c-8606-9f192ff12984 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:44:23.755381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:23.755381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:23.755381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:23.755381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:23.755381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:23.755381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:23.755381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:23.755381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:23.755381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:23.755381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:23.755381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:23.755381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:44:23.755381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:44:23.755381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:44:23.756505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:44:23.756505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:23.756505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:23.756505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:23.756505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:23.756505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:23.756505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:23.756505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:23.756505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:23.756505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:23.756505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:23.756505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:23.756505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:23.756505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:23.756505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:23.756505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:23.756505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:23.757588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:44:23.757588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:44:23.757588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:44:23.757588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:44:23.757588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:44:23.757588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:44:23.757588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:44:23.757588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:23.757588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 558/1104] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:44:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:44:23.762887 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b57ecf-eea6-40e6-8099-abb2e58cc431 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:23.865335 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b57ecf-eea6-40e6-8099-abb2e58cc431 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:23.906047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635c0e1-0739-4746-bfaf-6c3fd653cea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:23.906650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635c0e1-0739-4746-bfaf-6c3fd653cea4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:23.906927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635c0e1-0739-4746-bfaf-6c3fd653cea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:23.907196 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635c0e1-0739-4746-bfaf-6c3fd653cea4 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:23.907874 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635c0e1-0739-4746-bfaf-6c3fd653cea4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:23.908208 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635c0e1-0739-4746-bfaf-6c3fd653cea4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:23.909667 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d635c0e1-0739-4746-bfaf-6c3fd653cea4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:23.922167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 547/1105] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:44:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:44:23.928153 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfa9b8-8e96-4a1c-8606-9f192ff12984 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:24.032793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cfa9b8-8e96-4a1c-8606-9f192ff12984 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:24.064331 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46966b-22cf-4740-af10-1066f337e77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:24.064916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46966b-22cf-4740-af10-1066f337e77b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:24.065191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46966b-22cf-4740-af10-1066f337e77b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:24.065464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46966b-22cf-4740-af10-1066f337e77b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:24.066171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46966b-22cf-4740-af10-1066f337e77b None admin] RBAC: Adding query filter params (role.id=5e8e8a438e704946842357d01ab848a8, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=dc210376e57a41e6b3812110db249099) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:24.066472 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46966b-22cf-4740-af10-1066f337e77b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:24.067877 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46966b-22cf-4740-af10-1066f337e77b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:24.073406 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 559/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:44:23 2022] GET /identity/v3/role_assignments?user.id=dc210376e57a41e6b3812110db249099&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=5e8e8a438e704946842357d01ab848a8 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:25.142665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcf8eb-c0b9-4191-8921-54354bbe08c5 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:25.143192 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcf8eb-c0b9-4191-8921-54354bbe08c5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:25.143192 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bcf8eb-c0b9-4191-8921-54354bbe08c5 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:25.144575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 548/1107] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:25.149814 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9c624-3806-4e00-a18d-338f26d56766 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:25.150232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9c624-3806-4e00-a18d-338f26d56766 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:25.150358 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9c624-3806-4e00-a18d-338f26d56766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:25.168744 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a2f9c624-3806-4e00-a18d-338f26d56766 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:25.169937 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a2f9c624-3806-4e00-a18d-338f26d56766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:25.222030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:25.235572 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 560/1108] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 20:44:25.505017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bcf8eb-c0b9-4191-8921-54354bbe08c5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:25.558411 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:25.606502 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bcf8eb-c0b9-4191-8921-54354bbe08c5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:25.639950 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda02b1-711c-4251-90fd-20219b4e171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:25.640602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda02b1-711c-4251-90fd-20219b4e171c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:25.640883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda02b1-711c-4251-90fd-20219b4e171c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:25.641156 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda02b1-711c-4251-90fd-20219b4e171c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:25.642262 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda02b1-711c-4251-90fd-20219b4e171c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:25.643706 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda02b1-711c-4251-90fd-20219b4e171c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:25.645296 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 549/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:44:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:25.651221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9c624-3806-4e00-a18d-338f26d56766 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:25.751363 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9c624-3806-4e00-a18d-338f26d56766 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:25.784796 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad57857-545d-4609-b9a6-c39f79b888a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:25.785337 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad57857-545d-4609-b9a6-c39f79b888a9 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:25.785613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad57857-545d-4609-b9a6-c39f79b888a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:25.785883 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad57857-545d-4609-b9a6-c39f79b888a9 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:25.786535 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad57857-545d-4609-b9a6-c39f79b888a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:25.787959 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad57857-545d-4609-b9a6-c39f79b888a9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:25.810661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 561/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Sep 9 20:44:25 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:44:28.143203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e27f3d-7dd8-42b3-973b-d8236de1e91c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:28.143731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e27f3d-7dd8-42b3-973b-d8236de1e91c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:28.143731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e27f3d-7dd8-42b3-973b-d8236de1e91c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:28.145125 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 550/1111] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:28.150236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8b363-8ed5-4d9d-8c30-d2ffa60ad391 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:28.150614 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8b363-8ed5-4d9d-8c30-d2ffa60ad391 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:28.150786 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8b363-8ed5-4d9d-8c30-d2ffa60ad391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:28.168795 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f7d8b363-8ed5-4d9d-8c30-d2ffa60ad391 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:28.169965 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f7d8b363-8ed5-4d9d-8c30-d2ffa60ad391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:28.209052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:28.235266 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 562/1112] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:28.498371 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e27f3d-7dd8-42b3-973b-d8236de1e91c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:28.599088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e27f3d-7dd8-42b3-973b-d8236de1e91c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:28.618676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:28.632518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f8822-d78f-4c56-8e31-527b593d16ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:28.633141 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f8822-d78f-4c56-8e31-527b593d16ec None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:28.633417 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f8822-d78f-4c56-8e31-527b593d16ec None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:28.633690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520f8822-d78f-4c56-8e31-527b593d16ec None admin] PATH_INFO: `/v3/roles/d9c09fde9a114c2fa299455f8298db09` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:28.635052 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f8822-d78f-4c56-8e31-527b593d16ec None admin] RBAC: Authorizing `identity:get_role(role_id=d9c09fde9a114c2fa299455f8298db09)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:28.636457 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520f8822-d78f-4c56-8e31-527b593d16ec None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:28.638462 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 551/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:44:28 2022] GET /identity/v3/roles/d9c09fde9a114c2fa299455f8298db09 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:28.644276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8b363-8ed5-4d9d-8c30-d2ffa60ad391 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:28.739570 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8b363-8ed5-4d9d-8c30-d2ffa60ad391 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:28.773006 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648d61c-0158-4989-a83c-afa1fae5565a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:28.773637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648d61c-0158-4989-a83c-afa1fae5565a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:28.773976 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648d61c-0158-4989-a83c-afa1fae5565a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:28.774270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648d61c-0158-4989-a83c-afa1fae5565a None admin] PATH_INFO: `/v3/users/4e6e78b7b2d34b11956ad81f479d68a7` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:28.790003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648d61c-0158-4989-a83c-afa1fae5565a None admin] RBAC: Authorizing `identity:get_user(user_id=4e6e78b7b2d34b11956ad81f479d68a7)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:28.791449 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648d61c-0158-4989-a83c-afa1fae5565a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:28.793663 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 563/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:44:28 2022] GET /identity/v3/users/4e6e78b7b2d34b11956ad81f479d68a7 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:28.799805 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f8822-d78f-4c56-8e31-527b593d16ec None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:28.899299 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520f8822-d78f-4c56-8e31-527b593d16ec None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:28.933989 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aef048-7fc8-44e8-a0f3-44d4866a5a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:28.934523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aef048-7fc8-44e8-a0f3-44d4866a5a0b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:28.934788 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aef048-7fc8-44e8-a0f3-44d4866a5a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:28.935064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aef048-7fc8-44e8-a0f3-44d4866a5a0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:28.989901 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:29.002777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aef048-7fc8-44e8-a0f3-44d4866a5a0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:29.004262 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aef048-7fc8-44e8-a0f3-44d4866a5a0b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:29.100259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 552/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:44:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 20:44:29.106727 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648d61c-0158-4989-a83c-afa1fae5565a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:29.136710 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:29.202195 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648d61c-0158-4989-a83c-afa1fae5565a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:29.235403 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3d814-d974-411e-85ff-c57a80bf53f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:29.236047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3d814-d974-411e-85ff-c57a80bf53f8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:29.236328 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3d814-d974-411e-85ff-c57a80bf53f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:29.236599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3d814-d974-411e-85ff-c57a80bf53f8 None admin] PATH_INFO: `/v3/projects/e740f1759ab84ca8a0e744ef97d0ba5a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:29.237696 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3d814-d974-411e-85ff-c57a80bf53f8 None admin] RBAC: Authorizing `identity:get_project(project_id=e740f1759ab84ca8a0e744ef97d0ba5a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:29.239111 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3d814-d974-411e-85ff-c57a80bf53f8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:29.240742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 564/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:44:29 2022] GET /identity/v3/projects/e740f1759ab84ca8a0e744ef97d0ba5a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:29.246931 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aef048-7fc8-44e8-a0f3-44d4866a5a0b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:29.332926 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:29.345802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aef048-7fc8-44e8-a0f3-44d4866a5a0b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:29.379061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af936a-69f1-4613-a44f-591d4eab9f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:29.379602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af936a-69f1-4613-a44f-591d4eab9f26 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:29.379885 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af936a-69f1-4613-a44f-591d4eab9f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:29.380190 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af936a-69f1-4613-a44f-591d4eab9f26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:29.380901 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af936a-69f1-4613-a44f-591d4eab9f26 None admin] RBAC: Adding query filter params (role.id=d9c09fde9a114c2fa299455f8298db09, scope.project.id=e740f1759ab84ca8a0e744ef97d0ba5a, user.id=4e6e78b7b2d34b11956ad81f479d68a7) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:29.381211 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af936a-69f1-4613-a44f-591d4eab9f26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:29.382641 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af936a-69f1-4613-a44f-591d4eab9f26 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:29.388317 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 553/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:44:29 2022] GET /identity/v3/role_assignments?user.id=4e6e78b7b2d34b11956ad81f479d68a7&scope.project.id=e740f1759ab84ca8a0e744ef97d0ba5a&role.id=d9c09fde9a114c2fa299455f8298db09 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:31.482835 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982527f-1b9b-438f-8243-8a036175ac08 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:31.483367 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982527f-1b9b-438f-8243-8a036175ac08 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:31.483367 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982527f-1b9b-438f-8243-8a036175ac08 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:31.484770 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 565/1118] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:31.489809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f67772-a90e-4b00-bbe1-2b6354856eb7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:31.490236 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f67772-a90e-4b00-bbe1-2b6354856eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:31.490354 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f67772-a90e-4b00-bbe1-2b6354856eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:31.508186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-86f67772-a90e-4b00-bbe1-2b6354856eb7 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:31.509364 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-86f67772-a90e-4b00-bbe1-2b6354856eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:31.575301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 554/1119] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:31.843301 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982527f-1b9b-438f-8243-8a036175ac08 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:31.939342 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:31.943423 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982527f-1b9b-438f-8243-8a036175ac08 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:31.975861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb71873-657d-44cb-9f33-253204317f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:31.976505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb71873-657d-44cb-9f33-253204317f9d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:31.976781 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb71873-657d-44cb-9f33-253204317f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:31.977053 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb71873-657d-44cb-9f33-253204317f9d None admin] PATH_INFO: `/v3/roles/d9c09fde9a114c2fa299455f8298db09` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:31.978416 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb71873-657d-44cb-9f33-253204317f9d None admin] RBAC: Authorizing `identity:get_role(role_id=d9c09fde9a114c2fa299455f8298db09)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:31.979764 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb71873-657d-44cb-9f33-253204317f9d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:31.981715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 566/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:44:31 2022] GET /identity/v3/roles/d9c09fde9a114c2fa299455f8298db09 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:31.987534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f67772-a90e-4b00-bbe1-2b6354856eb7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:32.072185 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:32.091017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f67772-a90e-4b00-bbe1-2b6354856eb7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:32.123923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213e649-251a-44df-a7a3-9413ca940537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:32.124517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213e649-251a-44df-a7a3-9413ca940537 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:32.124796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213e649-251a-44df-a7a3-9413ca940537 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:32.125068 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213e649-251a-44df-a7a3-9413ca940537 None admin] PATH_INFO: `/v3/users/4e6e78b7b2d34b11956ad81f479d68a7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:32.126174 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213e649-251a-44df-a7a3-9413ca940537 None admin] RBAC: Authorizing `identity:get_user(user_id=4e6e78b7b2d34b11956ad81f479d68a7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:32.127612 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213e649-251a-44df-a7a3-9413ca940537 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:32.129203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 555/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:44:31 2022] GET /identity/v3/users/4e6e78b7b2d34b11956ad81f479d68a7 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:32.134956 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb71873-657d-44cb-9f33-253204317f9d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:32.232141 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb71873-657d-44cb-9f33-253204317f9d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:32.267035 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2eda5c-f7f4-4f74-8baf-482cfbc226d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:32.267648 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2eda5c-f7f4-4f74-8baf-482cfbc226d8 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:32.267923 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2eda5c-f7f4-4f74-8baf-482cfbc226d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:32.268220 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2eda5c-f7f4-4f74-8baf-482cfbc226d8 None admin] PATH_INFO: `/v3/projects/e740f1759ab84ca8a0e744ef97d0ba5a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:32.269319 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2eda5c-f7f4-4f74-8baf-482cfbc226d8 None admin] RBAC: Authorizing `identity:get_project(project_id=e740f1759ab84ca8a0e744ef97d0ba5a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:32.270738 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2eda5c-f7f4-4f74-8baf-482cfbc226d8 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:32.272371 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 567/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:44:32 2022] GET /identity/v3/projects/e740f1759ab84ca8a0e744ef97d0ba5a => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:32.279223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213e649-251a-44df-a7a3-9413ca940537 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:32.377840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213e649-251a-44df-a7a3-9413ca940537 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:32.410362 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b96e9e-b2c4-4d9c-84fd-c87193e34d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:32.411018 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b96e9e-b2c4-4d9c-84fd-c87193e34d0f None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:32.411302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b96e9e-b2c4-4d9c-84fd-c87193e34d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:32.411578 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b96e9e-b2c4-4d9c-84fd-c87193e34d0f None admin] PATH_INFO: `/v3/projects/e740f1759ab84ca8a0e744ef97d0ba5a/users/4e6e78b7b2d34b11956ad81f479d68a7/roles/d9c09fde9a114c2fa299455f8298db09` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:32.413743 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b96e9e-b2c4-4d9c-84fd-c87193e34d0f None admin] RBAC: Authorizing `identity:create_grant(project_id=e740f1759ab84ca8a0e744ef97d0ba5a, user_id=4e6e78b7b2d34b11956ad81f479d68a7, role_id=d9c09fde9a114c2fa299455f8298db09)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:32.415193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b96e9e-b2c4-4d9c-84fd-c87193e34d0f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:32.429052 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 556/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:44:32 2022] PUT /identity/v3/projects/e740f1759ab84ca8a0e744ef97d0ba5a/users/4e6e78b7b2d34b11956ad81f479d68a7/roles/d9c09fde9a114c2fa299455f8298db09 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:44:34.558515 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fada0e9-f44b-4645-96d1-39ff7bd92cc7 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:34.559013 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fada0e9-f44b-4645-96d1-39ff7bd92cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:34.559013 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fada0e9-f44b-4645-96d1-39ff7bd92cc7 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:34.560479 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 568/1124] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:34.565595 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23d0c7-eedb-4320-bd4a-0e4804e9689a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:34.565993 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23d0c7-eedb-4320-bd4a-0e4804e9689a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:34.566151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23d0c7-eedb-4320-bd4a-0e4804e9689a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:34.584581 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6c23d0c7-eedb-4320-bd4a-0e4804e9689a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:34.585780 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6c23d0c7-eedb-4320-bd4a-0e4804e9689a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:34.588559 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:34.652168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 557/1125] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:34.918975 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fada0e9-f44b-4645-96d1-39ff7bd92cc7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:34.954881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:35.018470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fada0e9-f44b-4645-96d1-39ff7bd92cc7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:35.052283 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92795b88-c43e-411d-99a3-9256d7b4346f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:35.052906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92795b88-c43e-411d-99a3-9256d7b4346f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:35.053184 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92795b88-c43e-411d-99a3-9256d7b4346f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:35.053457 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92795b88-c43e-411d-99a3-9256d7b4346f None admin] PATH_INFO: `/v3/roles/d9c09fde9a114c2fa299455f8298db09` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:35.054846 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92795b88-c43e-411d-99a3-9256d7b4346f None admin] RBAC: Authorizing `identity:get_role(role_id=d9c09fde9a114c2fa299455f8298db09)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:35.056233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92795b88-c43e-411d-99a3-9256d7b4346f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:35.057550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 569/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:44:34 2022] GET /identity/v3/roles/d9c09fde9a114c2fa299455f8298db09 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:35.063452 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23d0c7-eedb-4320-bd4a-0e4804e9689a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:35.160734 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23d0c7-eedb-4320-bd4a-0e4804e9689a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:35.193424 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7328306-e400-4fbf-8545-fb3502b7deaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:35.193985 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7328306-e400-4fbf-8545-fb3502b7deaf None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:35.194263 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7328306-e400-4fbf-8545-fb3502b7deaf None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:35.194536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7328306-e400-4fbf-8545-fb3502b7deaf None admin] PATH_INFO: `/v3/users/4e6e78b7b2d34b11956ad81f479d68a7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:35.195653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7328306-e400-4fbf-8545-fb3502b7deaf None admin] RBAC: Authorizing `identity:get_user(user_id=4e6e78b7b2d34b11956ad81f479d68a7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:35.197123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7328306-e400-4fbf-8545-fb3502b7deaf None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:35.198667 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 558/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:44:35 2022] GET /identity/v3/users/4e6e78b7b2d34b11956ad81f479d68a7 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:35.204580 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92795b88-c43e-411d-99a3-9256d7b4346f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:35.302890 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92795b88-c43e-411d-99a3-9256d7b4346f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:35.305451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:35.336986 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1273be7-7811-4796-92f9-2e714050cc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:35.337580 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1273be7-7811-4796-92f9-2e714050cc14 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:35.337858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1273be7-7811-4796-92f9-2e714050cc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:35.338129 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1273be7-7811-4796-92f9-2e714050cc14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:35.403660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1273be7-7811-4796-92f9-2e714050cc14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:35.405123 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1273be7-7811-4796-92f9-2e714050cc14 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:35.498338 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 570/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:44:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 20:44:35.504192 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7328306-e400-4fbf-8545-fb3502b7deaf None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:35.515434 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:35.603331 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7328306-e400-4fbf-8545-fb3502b7deaf None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:35.637360 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c4b0f-2176-419d-9d18-d35ae4ad4b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:35.638169 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c4b0f-2176-419d-9d18-d35ae4ad4b01 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:35.638448 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c4b0f-2176-419d-9d18-d35ae4ad4b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:35.638718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c4b0f-2176-419d-9d18-d35ae4ad4b01 None admin] PATH_INFO: `/v3/projects/e740f1759ab84ca8a0e744ef97d0ba5a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:35.639821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c4b0f-2176-419d-9d18-d35ae4ad4b01 None admin] RBAC: Authorizing `identity:get_project(project_id=e740f1759ab84ca8a0e744ef97d0ba5a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:35.641268 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c4b0f-2176-419d-9d18-d35ae4ad4b01 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:35.642859 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 559/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:44:35 2022] GET /identity/v3/projects/e740f1759ab84ca8a0e744ef97d0ba5a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:35.648876 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1273be7-7811-4796-92f9-2e714050cc14 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:35.652135 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:35.744845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1273be7-7811-4796-92f9-2e714050cc14 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:35.779694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c19815-6895-4028-8754-afe55b967036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:35.780266 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c19815-6895-4028-8754-afe55b967036 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:35.780545 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c19815-6895-4028-8754-afe55b967036 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:35.780816 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c19815-6895-4028-8754-afe55b967036 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:35.781535 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c19815-6895-4028-8754-afe55b967036 None admin] RBAC: Adding query filter params (role.id=d9c09fde9a114c2fa299455f8298db09, scope.project.id=e740f1759ab84ca8a0e744ef97d0ba5a, user.id=4e6e78b7b2d34b11956ad81f479d68a7) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:35.781871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c19815-6895-4028-8754-afe55b967036 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:35.783285 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c19815-6895-4028-8754-afe55b967036 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:35.788927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 571/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:44:35 2022] GET /identity/v3/role_assignments?user.id=4e6e78b7b2d34b11956ad81f479d68a7&scope.project.id=e740f1759ab84ca8a0e744ef97d0ba5a&role.id=d9c09fde9a114c2fa299455f8298db09 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:37.944588 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6ff82-3c43-4cda-bd5d-816ed6dcbdba None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:37.945119 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6ff82-3c43-4cda-bd5d-816ed6dcbdba None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:37.945119 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6ff82-3c43-4cda-bd5d-816ed6dcbdba None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:37.946991 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 560/1131] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:37.953202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105839a5-708d-46e9-8161-1bcc372d904a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:37.953622 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105839a5-708d-46e9-8161-1bcc372d904a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:37.953754 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105839a5-708d-46e9-8161-1bcc372d904a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:37.971501 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-105839a5-708d-46e9-8161-1bcc372d904a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:37.972726 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-105839a5-708d-46e9-8161-1bcc372d904a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:38.034143 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:38.039779 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 572/1132] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:38.305824 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6ff82-3c43-4cda-bd5d-816ed6dcbdba None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:38.381793 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:38.405164 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6ff82-3c43-4cda-bd5d-816ed6dcbdba None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:38.437958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbd720-0915-414c-8193-f31569d4b4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:38.438578 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbd720-0915-414c-8193-f31569d4b4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:38.438857 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbd720-0915-414c-8193-f31569d4b4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:38.439131 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbd720-0915-414c-8193-f31569d4b4e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:38.440284 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dbd720-0915-414c-8193-f31569d4b4e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:38.441718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dbd720-0915-414c-8193-f31569d4b4e6 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:38.443251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 561/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:44:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:38.448996 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105839a5-708d-46e9-8161-1bcc372d904a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:38.545216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105839a5-708d-46e9-8161-1bcc372d904a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:38.579019 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020ca7c-4a65-4232-82da-f1abb6fd5692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:38.579556 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020ca7c-4a65-4232-82da-f1abb6fd5692 None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:38.579837 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020ca7c-4a65-4232-82da-f1abb6fd5692 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:38.580141 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020ca7c-4a65-4232-82da-f1abb6fd5692 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:38.580786 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020ca7c-4a65-4232-82da-f1abb6fd5692 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:38.582211 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020ca7c-4a65-4232-82da-f1abb6fd5692 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:38.608497 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 573/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Sep 9 20:44:38 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:44:40.746008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0eba7-d222-4a0a-a77c-c61dcd55fb8d None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:40.746592 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0eba7-d222-4a0a-a77c-c61dcd55fb8d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:40.746592 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0eba7-d222-4a0a-a77c-c61dcd55fb8d None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:40.747884 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 562/1135] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:40.753253 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc4128-d014-45c6-be29-ff5c83239d6e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:40.753647 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc4128-d014-45c6-be29-ff5c83239d6e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:40.753807 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc4128-d014-45c6-be29-ff5c83239d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:40.772394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3afc4128-d014-45c6-be29-ff5c83239d6e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:40.773579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3afc4128-d014-45c6-be29-ff5c83239d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:40.818988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:40.841460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 574/1136] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:41.107386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0eba7-d222-4a0a-a77c-c61dcd55fb8d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:41.206197 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0eba7-d222-4a0a-a77c-c61dcd55fb8d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:41.238930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eac855-5b35-4bde-a61b-42a98dd8e993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:41.239541 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eac855-5b35-4bde-a61b-42a98dd8e993 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:41.239816 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eac855-5b35-4bde-a61b-42a98dd8e993 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:41.240111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eac855-5b35-4bde-a61b-42a98dd8e993 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:41.241198 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eac855-5b35-4bde-a61b-42a98dd8e993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:41.242626 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eac855-5b35-4bde-a61b-42a98dd8e993 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:41.244166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 563/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:44:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:41.250456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc4128-d014-45c6-be29-ff5c83239d6e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:41.346228 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc4128-d014-45c6-be29-ff5c83239d6e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:41.379405 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59123159-9a67-4a86-9ce1-78c9a2b9dbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:41.379943 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59123159-9a67-4a86-9ce1-78c9a2b9dbaf None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:41.380254 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59123159-9a67-4a86-9ce1-78c9a2b9dbaf None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:41.380525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59123159-9a67-4a86-9ce1-78c9a2b9dbaf None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:41.381184 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59123159-9a67-4a86-9ce1-78c9a2b9dbaf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:41.382617 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59123159-9a67-4a86-9ce1-78c9a2b9dbaf None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:41.402809 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 575/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Sep 9 20:44:41 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:44:43.564821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a03f6-fbac-4b0c-a0c4-be3768b00f3f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:43.565334 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a03f6-fbac-4b0c-a0c4-be3768b00f3f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:43.565334 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a03f6-fbac-4b0c-a0c4-be3768b00f3f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:43.566596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 564/1139] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:43.571836 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9804412-63e6-4e6f-8348-93214e24fe06 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:43.572227 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9804412-63e6-4e6f-8348-93214e24fe06 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:43.572425 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9804412-63e6-4e6f-8348-93214e24fe06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:43.590192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b9804412-63e6-4e6f-8348-93214e24fe06 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:43.591381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b9804412-63e6-4e6f-8348-93214e24fe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:43.619034 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:43.656953 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 576/1140] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:43.927037 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a03f6-fbac-4b0c-a0c4-be3768b00f3f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:43.941801 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:44.029237 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a03f6-fbac-4b0c-a0c4-be3768b00f3f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:44.063669 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583eda75-d3d3-4392-8e56-5cf526e0fade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:44.064329 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583eda75-d3d3-4392-8e56-5cf526e0fade None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:44.064619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583eda75-d3d3-4392-8e56-5cf526e0fade None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:44.064895 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583eda75-d3d3-4392-8e56-5cf526e0fade None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:44.074758 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583eda75-d3d3-4392-8e56-5cf526e0fade None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:44:44.079518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-583eda75-d3d3-4392-8e56-5cf526e0fade None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:44:44.079518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:44.079518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:44.079518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:44.079518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:44.079518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:44.079518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:44.079518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:44.079518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:44.079518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:44.079518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:44.079518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:44.079518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:44:44.079518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:44:44.079518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:44:44.079518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:44:44.080642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:44:44.080642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:44:44.080642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:44:44.080642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:44:44.080642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:44.080642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:44.080642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:44.080642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:44.080642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:44.080642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:44.080642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:44.080642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:44.080642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:44.080642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:44.080642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:44.080642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:44.081698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:44.081698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:44.081698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:44.081698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:44.081698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:44:44.081698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:44:44.081698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:44:44.081698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:44:44.081698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:44:44.081698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:44:44.081698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:44:44.081698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:44.081698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 565/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:44:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:44:44.086790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9804412-63e6-4e6f-8348-93214e24fe06 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:44.181580 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9804412-63e6-4e6f-8348-93214e24fe06 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:44.213882 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd686dda-0233-43b8-a4d3-dbd5180454c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:44.214992 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd686dda-0233-43b8-a4d3-dbd5180454c2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:44.215277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd686dda-0233-43b8-a4d3-dbd5180454c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:44.215547 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd686dda-0233-43b8-a4d3-dbd5180454c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:44.216223 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd686dda-0233-43b8-a4d3-dbd5180454c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:44.216525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd686dda-0233-43b8-a4d3-dbd5180454c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:44.217879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd686dda-0233-43b8-a4d3-dbd5180454c2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:44.225552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 577/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:44:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:44.231911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583eda75-d3d3-4392-8e56-5cf526e0fade None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:44.304825 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:44.332466 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583eda75-d3d3-4392-8e56-5cf526e0fade None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:44.365606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708fa4a-3bd2-41be-929f-dcd716eb114e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:44.366225 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708fa4a-3bd2-41be-929f-dcd716eb114e None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:44.366501 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708fa4a-3bd2-41be-929f-dcd716eb114e None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:44.366770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708fa4a-3bd2-41be-929f-dcd716eb114e None admin] PATH_INFO: `/v3/users/06e0f919faa7477dbf704284b9849cb0` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:44.379392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708fa4a-3bd2-41be-929f-dcd716eb114e None admin] RBAC: Authorizing `identity:get_user(user_id=06e0f919faa7477dbf704284b9849cb0)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:44.380852 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b708fa4a-3bd2-41be-929f-dcd716eb114e None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:44.382414 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 566/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:44:44 2022] GET /identity/v3/users/06e0f919faa7477dbf704284b9849cb0 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:44.388780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd686dda-0233-43b8-a4d3-dbd5180454c2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:44.417490 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:44.487383 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd686dda-0233-43b8-a4d3-dbd5180454c2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:44.519510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055d1e0-9e6c-45ad-9e24-d058f9b1d329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:44.520143 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055d1e0-9e6c-45ad-9e24-d058f9b1d329 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:44.520431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055d1e0-9e6c-45ad-9e24-d058f9b1d329 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:44.520704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055d1e0-9e6c-45ad-9e24-d058f9b1d329 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:44.585497 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055d1e0-9e6c-45ad-9e24-d058f9b1d329 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:44.586930 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4055d1e0-9e6c-45ad-9e24-d058f9b1d329 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:44.612794 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:44.684327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 578/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:44:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 20:44:44.690253 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708fa4a-3bd2-41be-929f-dcd716eb114e None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:44.786607 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708fa4a-3bd2-41be-929f-dcd716eb114e None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:44.814695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:44.821070 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8839af-2734-4225-8c6f-2ee894e34b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:44.821699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8839af-2734-4225-8c6f-2ee894e34b52 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:44.821978 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8839af-2734-4225-8c6f-2ee894e34b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:44.822249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8839af-2734-4225-8c6f-2ee894e34b52 None admin] PATH_INFO: `/v3/projects/4d9cec10b9064f9dbfcc60eddacdd0c9` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:44.823350 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8839af-2734-4225-8c6f-2ee894e34b52 None admin] RBAC: Authorizing `identity:get_project(project_id=4d9cec10b9064f9dbfcc60eddacdd0c9)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:44.825003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8839af-2734-4225-8c6f-2ee894e34b52 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:44.826609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 567/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:44:44 2022] GET /identity/v3/projects/4d9cec10b9064f9dbfcc60eddacdd0c9 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:44.832688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055d1e0-9e6c-45ad-9e24-d058f9b1d329 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:44.928764 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055d1e0-9e6c-45ad-9e24-d058f9b1d329 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:44.953704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:44.961456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1a02b-262b-49ef-85b8-6ddf6099a36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:44.962047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1a02b-262b-49ef-85b8-6ddf6099a36e None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:44.962324 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1a02b-262b-49ef-85b8-6ddf6099a36e None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:44.962596 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1a02b-262b-49ef-85b8-6ddf6099a36e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:44.963308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1a02b-262b-49ef-85b8-6ddf6099a36e None admin] RBAC: Adding query filter params (role.id=be620fc7968740269d233c5ace94a563, scope.project.id=4d9cec10b9064f9dbfcc60eddacdd0c9, user.id=06e0f919faa7477dbf704284b9849cb0) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:44.963616 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1a02b-262b-49ef-85b8-6ddf6099a36e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:44.965612 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1a02b-262b-49ef-85b8-6ddf6099a36e None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:44.970902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 579/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:44:44 2022] GET /identity/v3/role_assignments?user.id=06e0f919faa7477dbf704284b9849cb0&scope.project.id=4d9cec10b9064f9dbfcc60eddacdd0c9&role.id=be620fc7968740269d233c5ace94a563 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:47.087190 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7cd7d-213a-4d5b-a48b-d0ea5c93c9e4 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:47.087715 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7cd7d-213a-4d5b-a48b-d0ea5c93c9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:47.087715 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7cd7d-213a-4d5b-a48b-d0ea5c93c9e4 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:47.089105 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 568/1147] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:47.094826 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f89221-a75b-4baf-adf5-468a4d84233e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:47.095232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f89221-a75b-4baf-adf5-468a4d84233e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:47.095379 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f89221-a75b-4baf-adf5-468a4d84233e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:47.113852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-61f89221-a75b-4baf-adf5-468a4d84233e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:47.115049 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-61f89221-a75b-4baf-adf5-468a4d84233e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:47.179623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 580/1148] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:47.451289 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7cd7d-213a-4d5b-a48b-d0ea5c93c9e4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:47.553028 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7cd7d-213a-4d5b-a48b-d0ea5c93c9e4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:47.592994 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df9262-8577-4f28-a1c4-c9c7dcfcf24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:47.593608 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df9262-8577-4f28-a1c4-c9c7dcfcf24d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:47.593885 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df9262-8577-4f28-a1c4-c9c7dcfcf24d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:47.594152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df9262-8577-4f28-a1c4-c9c7dcfcf24d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:47.603793 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df9262-8577-4f28-a1c4-c9c7dcfcf24d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:44:47.609515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-a5df9262-8577-4f28-a1c4-c9c7dcfcf24d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:44:47.609515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:47.609515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:47.609515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:47.609515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:47.609515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:47.609515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:47.609515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:47.609515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:47.609515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:47.609515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:47.609515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:47.609515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:44:47.609515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:44:47.609515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:44:47.609515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:44:47.610558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:44:47.610558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:44:47.610558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:44:47.610558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:44:47.610558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:47.610558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:47.610558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:47.610558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:47.610558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:47.610558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:47.610558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:47.610558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:47.610558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:47.610558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:47.610558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:47.610558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:47.611402 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:47.611402 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:47.611402 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:47.611402 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:47.611402 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:44:47.611402 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:44:47.611402 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:44:47.611402 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:44:47.611402 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:44:47.611402 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:44:47.611402 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:44:47.611402 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:47.611402 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 569/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:44:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:44:47.616622 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f89221-a75b-4baf-adf5-468a4d84233e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:47.711195 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f89221-a75b-4baf-adf5-468a4d84233e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:47.733613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:47.745045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc83b3-8190-4921-ad04-df9bcef5ddbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:47.745670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc83b3-8190-4921-ad04-df9bcef5ddbb None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:47.745955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc83b3-8190-4921-ad04-df9bcef5ddbb None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:47.746398 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc83b3-8190-4921-ad04-df9bcef5ddbb None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:47.747053 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc83b3-8190-4921-ad04-df9bcef5ddbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:47.747354 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc83b3-8190-4921-ad04-df9bcef5ddbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:47.748731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dc83b3-8190-4921-ad04-df9bcef5ddbb None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:47.756473 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 581/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:44:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:47.762651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df9262-8577-4f28-a1c4-c9c7dcfcf24d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:47.821657 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:47.862872 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df9262-8577-4f28-a1c4-c9c7dcfcf24d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:47.896735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59304866-9fd3-478a-a2be-53621cf84fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:47.897352 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59304866-9fd3-478a-a2be-53621cf84fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:47.897629 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59304866-9fd3-478a-a2be-53621cf84fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:47.897895 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59304866-9fd3-478a-a2be-53621cf84fe3 None admin] PATH_INFO: `/v3/users/06e0f919faa7477dbf704284b9849cb0` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:47.898992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59304866-9fd3-478a-a2be-53621cf84fe3 None admin] RBAC: Authorizing `identity:get_user(user_id=06e0f919faa7477dbf704284b9849cb0)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:47.900440 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59304866-9fd3-478a-a2be-53621cf84fe3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:47.902265 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 570/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:44:47 2022] GET /identity/v3/users/06e0f919faa7477dbf704284b9849cb0 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:47.908009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc83b3-8190-4921-ad04-df9bcef5ddbb None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:48.003468 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dc83b3-8190-4921-ad04-df9bcef5ddbb None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:48.035523 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20610d6-dffc-4da8-aaf4-1b19ea59344d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:48.036175 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20610d6-dffc-4da8-aaf4-1b19ea59344d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:48.036453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20610d6-dffc-4da8-aaf4-1b19ea59344d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:48.036719 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20610d6-dffc-4da8-aaf4-1b19ea59344d None admin] PATH_INFO: `/v3/projects/4d9cec10b9064f9dbfcc60eddacdd0c9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:48.037809 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20610d6-dffc-4da8-aaf4-1b19ea59344d None admin] RBAC: Authorizing `identity:get_project(project_id=4d9cec10b9064f9dbfcc60eddacdd0c9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:48.039216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20610d6-dffc-4da8-aaf4-1b19ea59344d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:48.040834 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 582/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:44:47 2022] GET /identity/v3/projects/4d9cec10b9064f9dbfcc60eddacdd0c9 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:48.047290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59304866-9fd3-478a-a2be-53621cf84fe3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:48.144874 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59304866-9fd3-478a-a2be-53621cf84fe3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:48.170560 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:48.179668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b012e-817d-45b7-81e8-d735552a0808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:48.180360 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b012e-817d-45b7-81e8-d735552a0808 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:48.180648 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b012e-817d-45b7-81e8-d735552a0808 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:48.180927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b012e-817d-45b7-81e8-d735552a0808 None admin] PATH_INFO: `/v3/projects/4d9cec10b9064f9dbfcc60eddacdd0c9/users/06e0f919faa7477dbf704284b9849cb0/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:48.182828 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b012e-817d-45b7-81e8-d735552a0808 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d9cec10b9064f9dbfcc60eddacdd0c9, user_id=06e0f919faa7477dbf704284b9849cb0, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:48.185572 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b012e-817d-45b7-81e8-d735552a0808 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:48.197935 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 571/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:44:48 2022] PUT /identity/v3/projects/4d9cec10b9064f9dbfcc60eddacdd0c9/users/06e0f919faa7477dbf704284b9849cb0/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:44:50.289526 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00c8bd-c1f7-407f-809d-923ef4544b21 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:50.290155 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00c8bd-c1f7-407f-809d-923ef4544b21 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:50.290155 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00c8bd-c1f7-407f-809d-923ef4544b21 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:50.291389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 583/1154] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:50.297225 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d523ef0-162a-4860-b233-6fbf325ce5b3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:50.297629 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d523ef0-162a-4860-b233-6fbf325ce5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:50.297777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d523ef0-162a-4860-b233-6fbf325ce5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:50.316704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0d523ef0-162a-4860-b233-6fbf325ce5b3 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:50.317897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0d523ef0-162a-4860-b233-6fbf325ce5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:50.382563 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 572/1155] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:50.657914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00c8bd-c1f7-407f-809d-923ef4544b21 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:50.710903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:50.757997 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00c8bd-c1f7-407f-809d-923ef4544b21 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:50.791434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86439048-2997-464b-aa1c-7f64c0bf715f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:50.792080 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86439048-2997-464b-aa1c-7f64c0bf715f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:50.792361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86439048-2997-464b-aa1c-7f64c0bf715f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:50.793177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86439048-2997-464b-aa1c-7f64c0bf715f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:50.802838 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86439048-2997-464b-aa1c-7f64c0bf715f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:44:50.807649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-86439048-2997-464b-aa1c-7f64c0bf715f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:44:50.807649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:50.807649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:50.807649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:50.807649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:50.807649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:50.807649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:50.807649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:50.807649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:50.807649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:50.807649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:50.807649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:50.807649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:44:50.807649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:44:50.807649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:44:50.807649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:44:50.809005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:44:50.809005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:44:50.809005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:44:50.809005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:44:50.809005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:50.809005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:50.809005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:50.809005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:50.809005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:50.809005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:50.809005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:50.809005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:50.809005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:50.809005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:50.809005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:50.809005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:50.810212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:50.810212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:50.810212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:50.810212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:50.810212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:44:50.810212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:44:50.810212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:44:50.810212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:44:50.810212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:44:50.810212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:44:50.810212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:44:50.810212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:44:50.810212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 584/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:44:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:44:50.814778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d523ef0-162a-4860-b233-6fbf325ce5b3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:50.910771 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d523ef0-162a-4860-b233-6fbf325ce5b3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:50.926947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:50.944897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7c70d-fce4-4fc6-a1fa-88e36ffe523f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:50.945496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7c70d-fce4-4fc6-a1fa-88e36ffe523f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:50.945776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7c70d-fce4-4fc6-a1fa-88e36ffe523f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:50.946050 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7c70d-fce4-4fc6-a1fa-88e36ffe523f None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:50.946710 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7c70d-fce4-4fc6-a1fa-88e36ffe523f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:50.947013 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7c70d-fce4-4fc6-a1fa-88e36ffe523f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:50.948417 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7c70d-fce4-4fc6-a1fa-88e36ffe523f None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:50.956354 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 573/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:44:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:50.962188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86439048-2997-464b-aa1c-7f64c0bf715f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:51.061675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86439048-2997-464b-aa1c-7f64c0bf715f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:51.074854 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:51.095779 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c080f0b-946e-4680-b277-8349ff853580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:51.096426 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c080f0b-946e-4680-b277-8349ff853580 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:51.096706 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c080f0b-946e-4680-b277-8349ff853580 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:51.096977 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c080f0b-946e-4680-b277-8349ff853580 None admin] PATH_INFO: `/v3/users/06e0f919faa7477dbf704284b9849cb0` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:51.098090 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c080f0b-946e-4680-b277-8349ff853580 None admin] RBAC: Authorizing `identity:get_user(user_id=06e0f919faa7477dbf704284b9849cb0)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:51.099502 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c080f0b-946e-4680-b277-8349ff853580 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:51.101095 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 585/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:44:50 2022] GET /identity/v3/users/06e0f919faa7477dbf704284b9849cb0 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:51.106782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7c70d-fce4-4fc6-a1fa-88e36ffe523f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:51.205383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7c70d-fce4-4fc6-a1fa-88e36ffe523f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:51.238084 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe081f8-527f-4123-b9cf-fb884ba844ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:51.238694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe081f8-527f-4123-b9cf-fb884ba844ab None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:51.238980 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe081f8-527f-4123-b9cf-fb884ba844ab None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:51.239253 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe081f8-527f-4123-b9cf-fb884ba844ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:51.284928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:51.306761 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe081f8-527f-4123-b9cf-fb884ba844ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:51.308352 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe081f8-527f-4123-b9cf-fb884ba844ab None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:51.404477 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 574/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:44:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 20:44:51.410395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c080f0b-946e-4680-b277-8349ff853580 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:51.506209 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c080f0b-946e-4680-b277-8349ff853580 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:51.538762 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c67318-2592-4a87-8e73-19bad45f70f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:51.539372 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c67318-2592-4a87-8e73-19bad45f70f2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:51.539649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c67318-2592-4a87-8e73-19bad45f70f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:51.539924 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c67318-2592-4a87-8e73-19bad45f70f2 None admin] PATH_INFO: `/v3/projects/4d9cec10b9064f9dbfcc60eddacdd0c9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:51.541047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c67318-2592-4a87-8e73-19bad45f70f2 None admin] RBAC: Authorizing `identity:get_project(project_id=4d9cec10b9064f9dbfcc60eddacdd0c9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:51.542538 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c67318-2592-4a87-8e73-19bad45f70f2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:51.544179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 586/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:44:51 2022] GET /identity/v3/projects/4d9cec10b9064f9dbfcc60eddacdd0c9 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:51.550121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe081f8-527f-4123-b9cf-fb884ba844ab None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:51.628839 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:51.650608 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe081f8-527f-4123-b9cf-fb884ba844ab None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:51.684725 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c3d3a-be0a-4270-b9bf-bbb627dafaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:51.685321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c3d3a-be0a-4270-b9bf-bbb627dafaa8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:51.685601 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c3d3a-be0a-4270-b9bf-bbb627dafaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:51.685873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c3d3a-be0a-4270-b9bf-bbb627dafaa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:51.686585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c3d3a-be0a-4270-b9bf-bbb627dafaa8 None admin] RBAC: Adding query filter params (role.id=be620fc7968740269d233c5ace94a563, scope.project.id=4d9cec10b9064f9dbfcc60eddacdd0c9, user.id=06e0f919faa7477dbf704284b9849cb0) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:51.686893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c3d3a-be0a-4270-b9bf-bbb627dafaa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:51.688351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15c3d3a-be0a-4270-b9bf-bbb627dafaa8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:51.693891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 575/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:44:51 2022] GET /identity/v3/role_assignments?user.id=06e0f919faa7477dbf704284b9849cb0&scope.project.id=4d9cec10b9064f9dbfcc60eddacdd0c9&role.id=be620fc7968740269d233c5ace94a563 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:53.829226 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900f8ad-663f-405d-a0d7-2b1122e634ef None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:53.829776 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900f8ad-663f-405d-a0d7-2b1122e634ef None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:53.829776 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1900f8ad-663f-405d-a0d7-2b1122e634ef None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:53.831102 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 587/1162] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:53.836199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992c804-11fd-43f2-8a8f-e74fa5cbee9f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:53.836612 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992c804-11fd-43f2-8a8f-e74fa5cbee9f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:53.836755 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5992c804-11fd-43f2-8a8f-e74fa5cbee9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:53.855778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5992c804-11fd-43f2-8a8f-e74fa5cbee9f None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:53.857010 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5992c804-11fd-43f2-8a8f-e74fa5cbee9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:53.922502 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 576/1163] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:54.190257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900f8ad-663f-405d-a0d7-2b1122e634ef None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:54.239173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:54.289305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1900f8ad-663f-405d-a0d7-2b1122e634ef None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:54.322746 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d18957-cda2-4308-9158-e159f54022ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:54.323347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d18957-cda2-4308-9158-e159f54022ef None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:54.323663 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d18957-cda2-4308-9158-e159f54022ef None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:54.323928 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d18957-cda2-4308-9158-e159f54022ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:54.387796 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d18957-cda2-4308-9158-e159f54022ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:54.389257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d18957-cda2-4308-9158-e159f54022ef None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:54.434830 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:54.484014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 588/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:44:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 20:44:54.489785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992c804-11fd-43f2-8a8f-e74fa5cbee9f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:54.558460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:54.587950 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5992c804-11fd-43f2-8a8f-e74fa5cbee9f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:54.621830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9953a4-5712-402e-9030-eb2c7903c287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:54.622444 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9953a4-5712-402e-9030-eb2c7903c287 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:54.622720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9953a4-5712-402e-9030-eb2c7903c287 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:54.622990 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9953a4-5712-402e-9030-eb2c7903c287 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:54.629441 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9953a4-5712-402e-9030-eb2c7903c287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:54.630880 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9953a4-5712-402e-9030-eb2c7903c287 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:54.641947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-0a9953a4-5712-402e-9030-eb2c7903c287 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 09 20:44:54.641947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:54.641947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 09 20:44:54.641947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 09 20:44:54.641947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:44:54.641947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:44:54.641947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:44:54.641947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:44:54.641947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 09 20:44:54.641947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:54.641947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:44:54.641947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:54.641947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:44:54.641947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:44:54.641947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:44:54.641947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:44:54.641947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:44:54.643149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:44:54.643149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:44:54.643149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:44:54.643149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:44:54.643149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:44:54.643149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:44:54.643149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:44:54.643149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:44:54.643149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:44:54.643149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:44:54.643149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:44:54.643149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:44:54.643149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:44:54.643149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:44:54.643149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:44:54.643149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:44:54.643970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:44:54.643970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:44:54.643970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:44:54.643970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:44:54.643970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:44:54.643970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:44:54.643970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:44:54.643970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:44:54.643970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:44:54.643970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:44:54.643970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 09 20:44:54.643970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:44:54.643970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 09 20:44:54.643970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:44:54.643970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 577/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Sep 9 20:44:54 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:44:54.648952 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d18957-cda2-4308-9158-e159f54022ef None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:54.746543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d18957-cda2-4308-9158-e159f54022ef None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:54.779787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05380a-97eb-411a-afaf-434f22a64402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:54.780424 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05380a-97eb-411a-afaf-434f22a64402 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:54.780704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05380a-97eb-411a-afaf-434f22a64402 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:54.780975 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05380a-97eb-411a-afaf-434f22a64402 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:54.781610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05380a-97eb-411a-afaf-434f22a64402 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:44:54.781911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05380a-97eb-411a-afaf-434f22a64402 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:54.783257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05380a-97eb-411a-afaf-434f22a64402 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:54.790176 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 589/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Fri Sep 9 20:44:54 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:44:56.915286 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed0c03-0bf1-457e-b5d2-fd3f62a29d30 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:56.915816 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed0c03-0bf1-457e-b5d2-fd3f62a29d30 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:56.915816 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed0c03-0bf1-457e-b5d2-fd3f62a29d30 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:56.917245 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 578/1167] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:56.923142 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7edc7-315a-4eb6-bfb1-f26ff2bf7b54 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:56.923525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7edc7-315a-4eb6-bfb1-f26ff2bf7b54 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:56.923683 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c7edc7-315a-4eb6-bfb1-f26ff2bf7b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:56.941332 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-54c7edc7-315a-4eb6-bfb1-f26ff2bf7b54 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:56.942525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-54c7edc7-315a-4eb6-bfb1-f26ff2bf7b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:56.949549 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:57.007002 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 590/1168] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:57.276361 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed0c03-0bf1-457e-b5d2-fd3f62a29d30 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:44:57.378215 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed0c03-0bf1-457e-b5d2-fd3f62a29d30 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:44:57.407134 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:44:57.412374 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c754b-f558-4410-925a-ebebc7acafcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:44:57.412976 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c754b-f558-4410-925a-ebebc7acafcf None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:57.413259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c754b-f558-4410-925a-ebebc7acafcf None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:57.413533 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c754b-f558-4410-925a-ebebc7acafcf None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:57.414201 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c754b-f558-4410-925a-ebebc7acafcf None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:44:57.415577 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c754b-f558-4410-925a-ebebc7acafcf None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:44:57.431317 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 579/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Fri Sep 9 20:44:57 2022] POST /identity/v3/domains => generated 267 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:44:59.585174 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3061ac-a9e0-4a88-bf89-0530003332c5 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:59.585680 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3061ac-a9e0-4a88-bf89-0530003332c5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:59.585680 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3061ac-a9e0-4a88-bf89-0530003332c5 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:59.586986 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 591/1170] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:44:59.592748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86aba17-6561-4739-be87-95a6480946cc None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:44:59.593173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86aba17-6561-4739-be87-95a6480946cc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:44:59.593303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86aba17-6561-4739-be87-95a6480946cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:44:59.611381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c86aba17-6561-4739-be87-95a6480946cc None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:44:59.612670 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c86aba17-6561-4739-be87-95a6480946cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:44:59.679430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 580/1171] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:44:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:44:59.950175 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3061ac-a9e0-4a88-bf89-0530003332c5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:45:00.050146 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3061ac-a9e0-4a88-bf89-0530003332c5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:45:00.083538 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba2bae-db68-427e-b45e-975d4c2fc4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:45:00.084186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba2bae-db68-427e-b45e-975d4c2fc4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:00.084465 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba2bae-db68-427e-b45e-975d4c2fc4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:00.084736 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba2bae-db68-427e-b45e-975d4c2fc4d2 None admin] PATH_INFO: `/v3/domains/0357a69b369a47ce8a1bc3bb26c19290` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:00.095468 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba2bae-db68-427e-b45e-975d4c2fc4d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0357a69b369a47ce8a1bc3bb26c19290)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:45:00.096947 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ba2bae-db68-427e-b45e-975d4c2fc4d2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:45:00.098541 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 592/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Fri Sep 9 20:44:59 2022] GET /identity/v3/domains/0357a69b369a47ce8a1bc3bb26c19290 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:45:00.104430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86aba17-6561-4739-be87-95a6480946cc None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:45:00.202677 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86aba17-6561-4739-be87-95a6480946cc None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:45:00.225093 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:45:00.239321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fcfd12-0521-44ea-a53d-060e81c7efae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:45:00.239930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcfd12-0521-44ea-a53d-060e81c7efae None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:00.240240 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcfd12-0521-44ea-a53d-060e81c7efae None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:00.240515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcfd12-0521-44ea-a53d-060e81c7efae None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:00.241153 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcfd12-0521-44ea-a53d-060e81c7efae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:45:00.242594 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fcfd12-0521-44ea-a53d-060e81c7efae None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:45:00.268573 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 581/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Sep 9 20:45:00 2022] POST /identity/v3/projects => generated 361 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:45:02.463466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bd940-2a40-4868-96bc-36a54a4771dd None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:02.464657 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bd940-2a40-4868-96bc-36a54a4771dd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:02.464657 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543bd940-2a40-4868-96bc-36a54a4771dd None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:02.466066 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 593/1174] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:45:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:45:02.471256 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295b87a-9b55-4731-9893-ef38ab32c17f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:02.471636 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295b87a-9b55-4731-9893-ef38ab32c17f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:02.471817 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295b87a-9b55-4731-9893-ef38ab32c17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:02.489963 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4295b87a-9b55-4731-9893-ef38ab32c17f None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:45:02.491164 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4295b87a-9b55-4731-9893-ef38ab32c17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:45:02.557237 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 582/1175] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:45:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:45:02.830555 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bd940-2a40-4868-96bc-36a54a4771dd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:45:02.833411 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:45:02.929426 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543bd940-2a40-4868-96bc-36a54a4771dd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:45:02.962411 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc1fe7-3192-42f1-b9de-f977af6dcdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:45:02.963033 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc1fe7-3192-42f1-b9de-f977af6dcdb3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:02.963310 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc1fe7-3192-42f1-b9de-f977af6dcdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:02.963581 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc1fe7-3192-42f1-b9de-f977af6dcdb3 None admin] PATH_INFO: `/v3/domains/0357a69b369a47ce8a1bc3bb26c19290` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:02.964742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc1fe7-3192-42f1-b9de-f977af6dcdb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0357a69b369a47ce8a1bc3bb26c19290)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:45:02.966156 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcc1fe7-3192-42f1-b9de-f977af6dcdb3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:45:02.967707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 594/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Fri Sep 9 20:45:02 2022] GET /identity/v3/domains/0357a69b369a47ce8a1bc3bb26c19290 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:45:02.973465 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295b87a-9b55-4731-9893-ef38ab32c17f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:45:03.070105 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295b87a-9b55-4731-9893-ef38ab32c17f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:45:03.072376 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:45:03.103676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb64187-ebb1-457e-a226-930062de2aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:45:03.104250 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb64187-ebb1-457e-a226-930062de2aff None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:03.105135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb64187-ebb1-457e-a226-930062de2aff None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:03.105424 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb64187-ebb1-457e-a226-930062de2aff None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:03.106066 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb64187-ebb1-457e-a226-930062de2aff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:45:03.107508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb64187-ebb1-457e-a226-930062de2aff None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:45:03.127917 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 583/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Sep 9 20:45:02 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:45:05.345471 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5176d0d-a341-40ca-8663-ab228509496f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:05.345950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5176d0d-a341-40ca-8663-ab228509496f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:05.346060 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5176d0d-a341-40ca-8663-ab228509496f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:05.347346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 595/1178] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:45:05.352763 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477e2bb-9491-4767-b611-1b0376151b12 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:05.353128 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477e2bb-9491-4767-b611-1b0376151b12 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:05.353309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477e2bb-9491-4767-b611-1b0376151b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:05.371324 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d477e2bb-9491-4767-b611-1b0376151b12 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:45:05.372551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d477e2bb-9491-4767-b611-1b0376151b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:45:05.438271 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 584/1179] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:45:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:45:05.710364 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5176d0d-a341-40ca-8663-ab228509496f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:45:05.779701 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:45:05.811239 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5176d0d-a341-40ca-8663-ab228509496f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:45:05.843640 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4aec6b-2351-4617-b8ba-837046b058bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:45:05.844288 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aec6b-2351-4617-b8ba-837046b058bc None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:05.844568 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aec6b-2351-4617-b8ba-837046b058bc None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:05.844839 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aec6b-2351-4617-b8ba-837046b058bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:05.855112 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4aec6b-2351-4617-b8ba-837046b058bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:45:05.859861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-cf4aec6b-2351-4617-b8ba-837046b058bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:45:05.859861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:45:05.859861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:45:05.859861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:45:05.859861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:45:05.859861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:45:05.859861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:45:05.859861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:45:05.859861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:45:05.859861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:45:05.859861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:45:05.859861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:45:05.859861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:45:05.859861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:45:05.859861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:45:05.859861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:45:05.860941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:45:05.860941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:45:05.860941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:45:05.860941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:45:05.860941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:45:05.860941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:45:05.860941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:45:05.860941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:45:05.860941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:45:05.860941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:45:05.860941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:45:05.860941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:45:05.860941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:45:05.860941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:45:05.860941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:45:05.860941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:45:05.861804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:45:05.861804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:45:05.861804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:45:05.861804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:45:05.861804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:45:05.861804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:45:05.861804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:45:05.861804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:45:05.861804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:45:05.861804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:45:05.861804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:45:05.861804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:45:05.861804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 596/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:45:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:45:05.867103 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477e2bb-9491-4767-b611-1b0376151b12 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:45:05.953720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:45:05.964641 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477e2bb-9491-4767-b611-1b0376151b12 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:45:05.997684 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac36cbb-74c8-46b6-b27a-b1df0672ffcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:45:05.998290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac36cbb-74c8-46b6-b27a-b1df0672ffcb None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:05.998569 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac36cbb-74c8-46b6-b27a-b1df0672ffcb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:05.998870 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac36cbb-74c8-46b6-b27a-b1df0672ffcb None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:05.999521 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac36cbb-74c8-46b6-b27a-b1df0672ffcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:45:05.999821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac36cbb-74c8-46b6-b27a-b1df0672ffcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:45:06.001220 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac36cbb-74c8-46b6-b27a-b1df0672ffcb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:45:06.008998 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 585/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:45:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:45:06.015372 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4aec6b-2351-4617-b8ba-837046b058bc None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:45:06.113785 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4aec6b-2351-4617-b8ba-837046b058bc None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:45:06.141247 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:45:06.149585 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a1ab8-1472-4dc2-b097-640d0e34cc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:45:06.150609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a1ab8-1472-4dc2-b097-640d0e34cc67 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:06.150951 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a1ab8-1472-4dc2-b097-640d0e34cc67 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:06.151865 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a1ab8-1472-4dc2-b097-640d0e34cc67 None admin] PATH_INFO: `/v3/users/e5a0b918e2eb49b1b876966ca21246f5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:06.164723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a1ab8-1472-4dc2-b097-640d0e34cc67 None admin] RBAC: Authorizing `identity:get_user(user_id=e5a0b918e2eb49b1b876966ca21246f5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:45:06.166156 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a1ab8-1472-4dc2-b097-640d0e34cc67 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:45:06.168757 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 597/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:45:06 2022] GET /identity/v3/users/e5a0b918e2eb49b1b876966ca21246f5 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:45:06.174555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac36cbb-74c8-46b6-b27a-b1df0672ffcb None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:45:06.271601 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac36cbb-74c8-46b6-b27a-b1df0672ffcb None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:45:06.306971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e3858-97c4-4ded-8ee8-8a8220729f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:45:06.307703 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e3858-97c4-4ded-8ee8-8a8220729f62 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:06.307871 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e3858-97c4-4ded-8ee8-8a8220729f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:06.308178 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e3858-97c4-4ded-8ee8-8a8220729f62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:06.329884 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:45:06.375957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e3858-97c4-4ded-8ee8-8a8220729f62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:45:06.377454 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e3858-97c4-4ded-8ee8-8a8220729f62 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:45:06.473502 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 586/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:45:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 20:45:06.479399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a1ab8-1472-4dc2-b097-640d0e34cc67 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:45:06.575760 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a1ab8-1472-4dc2-b097-640d0e34cc67 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:45:06.611369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e748ef9-e3d0-467e-b70e-8a4b45f29018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:45:06.612011 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e748ef9-e3d0-467e-b70e-8a4b45f29018 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:06.612296 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e748ef9-e3d0-467e-b70e-8a4b45f29018 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:06.612568 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e748ef9-e3d0-467e-b70e-8a4b45f29018 None admin] PATH_INFO: `/v3/projects/3384bad58cea4460a1fdb2686b599680` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:06.613680 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e748ef9-e3d0-467e-b70e-8a4b45f29018 None admin] RBAC: Authorizing `identity:get_project(project_id=3384bad58cea4460a1fdb2686b599680)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:45:06.615105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e748ef9-e3d0-467e-b70e-8a4b45f29018 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:45:06.616741 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 598/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:45:06 2022] GET /identity/v3/projects/3384bad58cea4460a1fdb2686b599680 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:45:06.623090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e3858-97c4-4ded-8ee8-8a8220729f62 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:45:06.674876 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:45:06.720774 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e3858-97c4-4ded-8ee8-8a8220729f62 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:45:06.754084 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3886053-b127-4ae1-ae40-841fe3625303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:45:06.754683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3886053-b127-4ae1-ae40-841fe3625303 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:06.754962 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3886053-b127-4ae1-ae40-841fe3625303 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:06.755233 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3886053-b127-4ae1-ae40-841fe3625303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:06.755951 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3886053-b127-4ae1-ae40-841fe3625303 None admin] RBAC: Adding query filter params (role.id=be620fc7968740269d233c5ace94a563, scope.project.id=3384bad58cea4460a1fdb2686b599680, user.id=e5a0b918e2eb49b1b876966ca21246f5) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:45:06.756290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3886053-b127-4ae1-ae40-841fe3625303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:45:06.757728 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3886053-b127-4ae1-ae40-841fe3625303 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:45:06.763664 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 587/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:45:06 2022] GET /identity/v3/role_assignments?user.id=e5a0b918e2eb49b1b876966ca21246f5&scope.project.id=3384bad58cea4460a1fdb2686b599680&role.id=be620fc7968740269d233c5ace94a563 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:45:08.867720 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd179c-d978-4d68-8001-5d0828de2dae None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:08.868273 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd179c-d978-4d68-8001-5d0828de2dae None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:08.868273 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd179c-d978-4d68-8001-5d0828de2dae None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:08.869606 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 599/1186] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:45:08.874784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf19f22-4549-47c5-ba73-6da53d6d1477 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:08.875180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf19f22-4549-47c5-ba73-6da53d6d1477 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:08.875333 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf19f22-4549-47c5-ba73-6da53d6d1477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:08.893127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0bf19f22-4549-47c5-ba73-6da53d6d1477 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:45:08.894299 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0bf19f22-4549-47c5-ba73-6da53d6d1477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:45:08.959413 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 588/1187] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:45:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:45:09.231770 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd179c-d978-4d68-8001-5d0828de2dae None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:45:09.287686 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:45:09.332157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd179c-d978-4d68-8001-5d0828de2dae None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:45:09.364731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4b4fc-8a43-40b0-9e81-29d580412935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:45:09.365354 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4b4fc-8a43-40b0-9e81-29d580412935 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:09.365633 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4b4fc-8a43-40b0-9e81-29d580412935 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:09.365909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4b4fc-8a43-40b0-9e81-29d580412935 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:09.376309 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4b4fc-8a43-40b0-9e81-29d580412935 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:45:09.381032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-cbe4b4fc-8a43-40b0-9e81-29d580412935 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:45:09.381032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:45:09.381032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:45:09.381032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:45:09.381032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:45:09.381032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:45:09.381032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:45:09.381032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:45:09.381032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:45:09.381032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:45:09.381032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:45:09.381032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:45:09.381032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:45:09.381032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:45:09.381032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:45:09.381032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:45:09.382108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:45:09.382108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:45:09.382108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:45:09.382108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:45:09.382108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:45:09.382108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:45:09.382108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:45:09.382108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:45:09.382108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:45:09.382108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:45:09.382108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:45:09.382108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:45:09.382108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:45:09.382108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:45:09.382108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:45:09.382108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:45:09.383252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:45:09.383252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:45:09.383252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:45:09.383252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:45:09.383252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:45:09.383252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:45:09.383252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:45:09.383252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:45:09.383252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:45:09.383252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:45:09.383252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:45:09.383252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:45:09.383252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 600/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:45:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:45:09.388303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf19f22-4549-47c5-ba73-6da53d6d1477 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:45:09.435455 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:45:09.487123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf19f22-4549-47c5-ba73-6da53d6d1477 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:45:09.520454 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cac94-d55e-4710-85b1-0168074fffe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:45:09.521052 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cac94-d55e-4710-85b1-0168074fffe8 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:09.521332 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cac94-d55e-4710-85b1-0168074fffe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:09.521604 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cac94-d55e-4710-85b1-0168074fffe8 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:09.522256 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cac94-d55e-4710-85b1-0168074fffe8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:45:09.522558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cac94-d55e-4710-85b1-0168074fffe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:45:09.523926 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cac94-d55e-4710-85b1-0168074fffe8 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:45:09.533547 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 589/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:45:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:45:09.539466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4b4fc-8a43-40b0-9e81-29d580412935 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:45:09.635591 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4b4fc-8a43-40b0-9e81-29d580412935 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:45:09.652592 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:45:09.670481 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a9990-f387-4fdd-a240-6c6206ac2541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:45:09.671100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a9990-f387-4fdd-a240-6c6206ac2541 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:09.671378 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a9990-f387-4fdd-a240-6c6206ac2541 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:09.671651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a9990-f387-4fdd-a240-6c6206ac2541 None admin] PATH_INFO: `/v3/users/e5a0b918e2eb49b1b876966ca21246f5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:09.672795 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a9990-f387-4fdd-a240-6c6206ac2541 None admin] RBAC: Authorizing `identity:get_user(user_id=e5a0b918e2eb49b1b876966ca21246f5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:45:09.674219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a9990-f387-4fdd-a240-6c6206ac2541 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:45:09.675781 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 601/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:45:09 2022] GET /identity/v3/users/e5a0b918e2eb49b1b876966ca21246f5 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:45:09.681451 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cac94-d55e-4710-85b1-0168074fffe8 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:45:09.781200 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cac94-d55e-4710-85b1-0168074fffe8 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:45:09.789754 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:45:09.814342 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2f801-8aea-445d-bf16-838852abcd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:45:09.814972 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2f801-8aea-445d-bf16-838852abcd0c None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:09.815249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2f801-8aea-445d-bf16-838852abcd0c None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:09.815521 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2f801-8aea-445d-bf16-838852abcd0c None admin] PATH_INFO: `/v3/projects/3384bad58cea4460a1fdb2686b599680` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:09.816647 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2f801-8aea-445d-bf16-838852abcd0c None admin] RBAC: Authorizing `identity:get_project(project_id=3384bad58cea4460a1fdb2686b599680)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:45:09.818089 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2f801-8aea-445d-bf16-838852abcd0c None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:45:09.819697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 590/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:45:09 2022] GET /identity/v3/projects/3384bad58cea4460a1fdb2686b599680 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:45:09.826203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a9990-f387-4fdd-a240-6c6206ac2541 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:45:09.921726 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a9990-f387-4fdd-a240-6c6206ac2541 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:45:09.954599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938bd651-6bf1-497f-a494-fed845f06845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:45:09.955243 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bd651-6bf1-497f-a494-fed845f06845 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:09.955548 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bd651-6bf1-497f-a494-fed845f06845 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:09.955820 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bd651-6bf1-497f-a494-fed845f06845 None admin] PATH_INFO: `/v3/projects/3384bad58cea4460a1fdb2686b599680/users/e5a0b918e2eb49b1b876966ca21246f5/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:09.957733 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938bd651-6bf1-497f-a494-fed845f06845 None admin] RBAC: Authorizing `identity:create_grant(project_id=3384bad58cea4460a1fdb2686b599680, user_id=e5a0b918e2eb49b1b876966ca21246f5, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:45:09.959167 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938bd651-6bf1-497f-a494-fed845f06845 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:45:09.972001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 602/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:45:09 2022] PUT /identity/v3/projects/3384bad58cea4460a1fdb2686b599680/users/e5a0b918e2eb49b1b876966ca21246f5/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:45:12.065131 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7124a-1a6a-4ad4-aa10-fbbddfa578cd None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:12.065685 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7124a-1a6a-4ad4-aa10-fbbddfa578cd None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:12.065685 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7124a-1a6a-4ad4-aa10-fbbddfa578cd None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:12.067015 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 591/1193] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:45:12.072122 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95de51-87c6-4ae2-9375-91faa8780308 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:12.072530 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95de51-87c6-4ae2-9375-91faa8780308 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:12.072678 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c95de51-87c6-4ae2-9375-91faa8780308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:12.091727 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5c95de51-87c6-4ae2-9375-91faa8780308 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:45:12.092955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5c95de51-87c6-4ae2-9375-91faa8780308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:45:12.131402 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:45:12.159553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 603/1194] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:45:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:45:12.429634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7124a-1a6a-4ad4-aa10-fbbddfa578cd None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:45:12.530234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7124a-1a6a-4ad4-aa10-fbbddfa578cd None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:45:12.563448 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d273606-e594-412f-bde8-5879869bc61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:45:12.564102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d273606-e594-412f-bde8-5879869bc61a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:12.564391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d273606-e594-412f-bde8-5879869bc61a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:12.564663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d273606-e594-412f-bde8-5879869bc61a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:12.574551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d273606-e594-412f-bde8-5879869bc61a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:45:12.579300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-0d273606-e594-412f-bde8-5879869bc61a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:45:12.579300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:45:12.579300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:45:12.579300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:45:12.579300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:45:12.579300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:45:12.579300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:45:12.579300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:45:12.579300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:45:12.579300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:45:12.579300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:45:12.579300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:45:12.579300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:45:12.579300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:45:12.579300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:45:12.579300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:45:12.580416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:45:12.580416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:45:12.580416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:45:12.580416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:45:12.580416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:45:12.580416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:45:12.580416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:45:12.580416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:45:12.580416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:45:12.580416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:45:12.580416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:45:12.580416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:45:12.580416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:45:12.580416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:45:12.580416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:45:12.580416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:45:12.581464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:45:12.581464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:45:12.581464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:45:12.581464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:45:12.581464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:45:12.581464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:45:12.581464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:45:12.581464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:45:12.581464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:45:12.581464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:45:12.581464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:45:12.581464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:45:12.581464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 592/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:45:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:45:12.586502 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95de51-87c6-4ae2-9375-91faa8780308 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:45:12.682639 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c95de51-87c6-4ae2-9375-91faa8780308 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:45:12.716478 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05279079-e8ee-4cf3-b1db-ec405b9093e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:45:12.717070 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05279079-e8ee-4cf3-b1db-ec405b9093e2 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:12.717344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05279079-e8ee-4cf3-b1db-ec405b9093e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:12.717612 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05279079-e8ee-4cf3-b1db-ec405b9093e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:12.718270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05279079-e8ee-4cf3-b1db-ec405b9093e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:45:12.718570 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05279079-e8ee-4cf3-b1db-ec405b9093e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:45:12.719920 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05279079-e8ee-4cf3-b1db-ec405b9093e2 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:45:12.727682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 604/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:45:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:45:12.734172 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d273606-e594-412f-bde8-5879869bc61a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:45:12.769002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:45:12.832725 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d273606-e594-412f-bde8-5879869bc61a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:45:12.866692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0244c-f31f-49f3-983e-6ac0a4ad5f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:45:12.867314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0244c-f31f-49f3-983e-6ac0a4ad5f0b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:12.867593 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0244c-f31f-49f3-983e-6ac0a4ad5f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:12.867866 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0244c-f31f-49f3-983e-6ac0a4ad5f0b None admin] PATH_INFO: `/v3/users/e5a0b918e2eb49b1b876966ca21246f5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:12.869003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0244c-f31f-49f3-983e-6ac0a4ad5f0b None admin] RBAC: Authorizing `identity:get_user(user_id=e5a0b918e2eb49b1b876966ca21246f5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:45:12.870512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0244c-f31f-49f3-983e-6ac0a4ad5f0b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:45:12.872089 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 593/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Sep 9 20:45:12 2022] GET /identity/v3/users/e5a0b918e2eb49b1b876966ca21246f5 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:45:12.877825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05279079-e8ee-4cf3-b1db-ec405b9093e2 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:45:12.912902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:45:12.974763 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05279079-e8ee-4cf3-b1db-ec405b9093e2 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:45:13.006679 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008e315-9b2c-4cb6-b4fe-7b0ff097257a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:45:13.007270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008e315-9b2c-4cb6-b4fe-7b0ff097257a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:13.007553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008e315-9b2c-4cb6-b4fe-7b0ff097257a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:13.007824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008e315-9b2c-4cb6-b4fe-7b0ff097257a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:13.072285 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008e315-9b2c-4cb6-b4fe-7b0ff097257a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:45:13.074224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008e315-9b2c-4cb6-b4fe-7b0ff097257a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:45:13.106381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:45:13.168818 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 605/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:45:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 20:45:13.174627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0244c-f31f-49f3-983e-6ac0a4ad5f0b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:45:13.271427 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0244c-f31f-49f3-983e-6ac0a4ad5f0b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:45:13.273651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:45:13.305497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3495c-1a3c-4da2-b6c2-b20b0d0b36a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:45:13.306375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3495c-1a3c-4da2-b6c2-b20b0d0b36a7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:13.306658 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3495c-1a3c-4da2-b6c2-b20b0d0b36a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:13.306937 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3495c-1a3c-4da2-b6c2-b20b0d0b36a7 None admin] PATH_INFO: `/v3/projects/3384bad58cea4460a1fdb2686b599680` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:13.308612 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3495c-1a3c-4da2-b6c2-b20b0d0b36a7 None admin] RBAC: Authorizing `identity:get_project(project_id=3384bad58cea4460a1fdb2686b599680)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:45:13.310063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3495c-1a3c-4da2-b6c2-b20b0d0b36a7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:45:13.311698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 594/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Sep 9 20:45:13 2022] GET /identity/v3/projects/3384bad58cea4460a1fdb2686b599680 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:45:13.317766 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008e315-9b2c-4cb6-b4fe-7b0ff097257a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:45:13.412040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008e315-9b2c-4cb6-b4fe-7b0ff097257a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:45:13.444546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a901f-60f3-4484-8c9e-99f98c6f11ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:45:13.445162 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a901f-60f3-4484-8c9e-99f98c6f11ab None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:45:13.445442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a901f-60f3-4484-8c9e-99f98c6f11ab None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:45:13.445715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a901f-60f3-4484-8c9e-99f98c6f11ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:45:13.446435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a901f-60f3-4484-8c9e-99f98c6f11ab None admin] RBAC: Adding query filter params (role.id=be620fc7968740269d233c5ace94a563, scope.project.id=3384bad58cea4460a1fdb2686b599680, user.id=e5a0b918e2eb49b1b876966ca21246f5) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:45:13.446747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a901f-60f3-4484-8c9e-99f98c6f11ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:45:13.448797 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a901f-60f3-4484-8c9e-99f98c6f11ab None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:45:13.451626 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:45:13.460053 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 606/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:45:13 2022] GET /identity/v3/role_assignments?user.id=e5a0b918e2eb49b1b876966ca21246f5&scope.project.id=3384bad58cea4460a1fdb2686b599680&role.id=be620fc7968740269d233c5ace94a563 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:45:23.301243 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=14 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:09.184198 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60032fda-2a2f-480f-9268-d04f246fa16c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:09.184896 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60032fda-2a2f-480f-9268-d04f246fa16c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:09.184896 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60032fda-2a2f-480f-9268-d04f246fa16c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:09.186268 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 595/1201] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:46:09.191550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9bd06-5df3-4e88-9a13-621b604187f9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:09.192030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9bd06-5df3-4e88-9a13-621b604187f9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:09.192132 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9bd06-5df3-4e88-9a13-621b604187f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:09.214635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-74f9bd06-5df3-4e88-9a13-621b604187f9 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:46:09.215961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-74f9bd06-5df3-4e88-9a13-621b604187f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:46:09.310610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 607/1202] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:46:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:46:09.582891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60032fda-2a2f-480f-9268-d04f246fa16c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:09.706662 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60032fda-2a2f-480f-9268-d04f246fa16c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:09.749060 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35d497-be75-4f7c-8b6d-93dd7ad0a8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:09.750088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35d497-be75-4f7c-8b6d-93dd7ad0a8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:09.750589 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35d497-be75-4f7c-8b6d-93dd7ad0a8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:09.751073 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35d497-be75-4f7c-8b6d-93dd7ad0a8e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:09.762658 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35d497-be75-4f7c-8b6d-93dd7ad0a8e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:09.764045 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35d497-be75-4f7c-8b6d-93dd7ad0a8e3 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:09.782313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-7e35d497-be75-4f7c-8b6d-93dd7ad0a8e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:09.782313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:09.782313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:09.782313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:09.782313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:09.782313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:09.782313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:09.782313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:09.782313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:09.782313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:09.782313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:09.782313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:09.782313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:46:09.782313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:46:09.782313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:46:09.782313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:46:09.783373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:09.783373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:09.783373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:09.783373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:09.783373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:09.783373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:09.783373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:09.783373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:09.783373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:09.783373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:09.783373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:09.783373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:09.783373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:09.783373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:09.783373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:09.783373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:09.783373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:46:09.784396 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:46:09.784396 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:09.784396 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:46:09.785927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 596/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:46:09.793305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9bd06-5df3-4e88-9a13-621b604187f9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:09.922066 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9bd06-5df3-4e88-9a13-621b604187f9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:09.957042 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:09.969979 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcf673-3df5-4e94-a957-71fd4b929df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:09.970744 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcf673-3df5-4e94-a957-71fd4b929df0 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:09.971130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcf673-3df5-4e94-a957-71fd4b929df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:09.971409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcf673-3df5-4e94-a957-71fd4b929df0 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:09.972126 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcf673-3df5-4e94-a957-71fd4b929df0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:09.972413 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcf673-3df5-4e94-a957-71fd4b929df0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:09.973789 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcf673-3df5-4e94-a957-71fd4b929df0 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:09.996085 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 608/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:09.997547 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35d497-be75-4f7c-8b6d-93dd7ad0a8e3 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:10.064865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:10.127146 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35d497-be75-4f7c-8b6d-93dd7ad0a8e3 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:10.166800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3d2a1-c998-40e8-9b2e-44f2ba10eb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:10.167580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3d2a1-c998-40e8-9b2e-44f2ba10eb83 None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:10.167875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3d2a1-c998-40e8-9b2e-44f2ba10eb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:10.168216 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3d2a1-c998-40e8-9b2e-44f2ba10eb83 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:10.168923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3d2a1-c998-40e8-9b2e-44f2ba10eb83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:10.170539 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3d2a1-c998-40e8-9b2e-44f2ba10eb83 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:10.196817 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 597/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Sep 9 20:46:09 2022] POST /identity/v3/users => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:46:12.566439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b2190-a5b4-490c-b8d5-e1d0aa006a16 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:12.566439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b2190-a5b4-490c-b8d5-e1d0aa006a16 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:12.566439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b2190-a5b4-490c-b8d5-e1d0aa006a16 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:12.567785 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 609/1206] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:46:12.577731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b78bf-6ea5-4772-94ba-69ff38b07673 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:12.577731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b78bf-6ea5-4772-94ba-69ff38b07673 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:12.577731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b78bf-6ea5-4772-94ba-69ff38b07673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:12.595958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b22b78bf-6ea5-4772-94ba-69ff38b07673 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:46:12.597268 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b22b78bf-6ea5-4772-94ba-69ff38b07673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:46:12.676458 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 598/1207] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:46:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:46:12.966173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b2190-a5b4-490c-b8d5-e1d0aa006a16 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:13.091428 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b2190-a5b4-490c-b8d5-e1d0aa006a16 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:13.136084 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21022d63-9866-4651-90c9-bd8137954e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:13.136718 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21022d63-9866-4651-90c9-bd8137954e67 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:13.138045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21022d63-9866-4651-90c9-bd8137954e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:13.138045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21022d63-9866-4651-90c9-bd8137954e67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:13.152077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21022d63-9866-4651-90c9-bd8137954e67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:46:13.156867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-21022d63-9866-4651-90c9-bd8137954e67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:46:13.156867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:13.156867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:13.156867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:13.156867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:13.156867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:13.156867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:13.156867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:13.156867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:13.156867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:13.156867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:13.156867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:13.156867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:46:13.156867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:46:13.156867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:46:13.156867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:46:13.158009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:46:13.158009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:46:13.158009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:46:13.158009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:46:13.158009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:13.158009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:13.158009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:13.158009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:13.158009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:13.158009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:13.158009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:13.158009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:13.158009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:13.158009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:13.158009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:13.158009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:13.158874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:13.158874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:13.158874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:13.158874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:13.158874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:46:13.158874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:46:13.158874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:46:13.158874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:46:13.158874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:46:13.158874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:46:13.158874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:46:13.158874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:13.158874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 610/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:46:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:46:13.164287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b78bf-6ea5-4772-94ba-69ff38b07673 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:13.213122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:13.289653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b78bf-6ea5-4772-94ba-69ff38b07673 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:13.335448 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712639b9-34e8-4b4b-bf0b-79917074ebbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:13.336265 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712639b9-34e8-4b4b-bf0b-79917074ebbf None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:13.336575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712639b9-34e8-4b4b-bf0b-79917074ebbf None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:13.337054 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712639b9-34e8-4b4b-bf0b-79917074ebbf None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:13.337986 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712639b9-34e8-4b4b-bf0b-79917074ebbf None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:13.338368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712639b9-34e8-4b4b-bf0b-79917074ebbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:13.340179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712639b9-34e8-4b4b-bf0b-79917074ebbf None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:13.354924 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 599/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Sep 9 20:46:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:13.356545 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21022d63-9866-4651-90c9-bd8137954e67 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:13.418200 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:13.485940 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21022d63-9866-4651-90c9-bd8137954e67 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:13.524377 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8699345-31c5-42f9-8366-957940b87607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:13.525383 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8699345-31c5-42f9-8366-957940b87607 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:13.526388 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8699345-31c5-42f9-8366-957940b87607 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:13.526388 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8699345-31c5-42f9-8366-957940b87607 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:13.539442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8699345-31c5-42f9-8366-957940b87607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:13.542218 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8699345-31c5-42f9-8366-957940b87607 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:13.561559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d8699345-31c5-42f9-8366-957940b87607 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:13.561559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:13.561559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:13.561559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:13.561559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:13.561559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:13.561559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:13.561559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:13.561559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:13.561559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:13.561559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:13.561559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:13.561559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:46:13.561559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:46:13.561559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:46:13.561559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:46:13.562567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:13.562567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:13.562567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:13.562567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:13.562567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:13.562567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:13.562567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:13.562567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:13.562567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:13.562567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:13.562567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:13.562567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:13.562567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:13.562567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:13.562567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:13.562567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:13.562567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:46:13.563505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:46:13.563505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:13.563505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:13.563505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 611/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:46:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:13.569668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712639b9-34e8-4b4b-bf0b-79917074ebbf None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:13.689629 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:13.693112 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712639b9-34e8-4b4b-bf0b-79917074ebbf None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:13.732592 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ab8ce-af1e-46ca-a0cb-83fba7c176c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:13.733217 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ab8ce-af1e-46ca-a0cb-83fba7c176c0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:13.733499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ab8ce-af1e-46ca-a0cb-83fba7c176c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:13.733771 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ab8ce-af1e-46ca-a0cb-83fba7c176c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:13.734416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ab8ce-af1e-46ca-a0cb-83fba7c176c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:13.734716 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ab8ce-af1e-46ca-a0cb-83fba7c176c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:13.736114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ab8ce-af1e-46ca-a0cb-83fba7c176c0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:13.753537 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 600/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:46:13.754826 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8699345-31c5-42f9-8366-957940b87607 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:13.869482 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8699345-31c5-42f9-8366-957940b87607 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:13.871264 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:13.910285 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d97ea-089c-4067-9612-305e9a3039db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:13.910986 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d97ea-089c-4067-9612-305e9a3039db None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:13.911271 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d97ea-089c-4067-9612-305e9a3039db None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:13.911547 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d97ea-089c-4067-9612-305e9a3039db None admin] PATH_INFO: `/v3/users/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:13.919816 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d97ea-089c-4067-9612-305e9a3039db None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:13.921290 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d97ea-089c-4067-9612-305e9a3039db None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:13.933032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-f91d97ea-089c-4067-9612-305e9a3039db None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 20:46:13.933032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:13.933032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:13.933032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:13.933032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:13.933032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:13.933032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:13.933032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:13.933032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:13.933032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:13.933032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:13.933032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:13.933032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:46:13.933032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:46:13.933032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:46:13.933032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:46:13.934206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:13.934206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:13.934206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:46:13.934206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:46:13.934206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:46:13.934206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:46:13.934206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:13.934206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:13.934206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:13.934206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:13.934206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:13.934206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:13.934206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:13.934206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:13.934206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:13.934206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:13.934206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:13.934206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:13.935154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:13.935154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:13.935154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:46:13.935154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:46:13.935154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:46:13.935154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:46:13.935154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:46:13.935154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:46:13.935154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 20:46:13.935154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:13.939822 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 612/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:46:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:13.941189 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ab8ce-af1e-46ca-a0cb-83fba7c176c0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:14.058183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ab8ce-af1e-46ca-a0cb-83fba7c176c0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:14.105447 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7475a-e96c-421c-837b-b44b68cf5879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:14.106124 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7475a-e96c-421c-837b-b44b68cf5879 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:14.106395 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7475a-e96c-421c-837b-b44b68cf5879 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:14.106664 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7475a-e96c-421c-837b-b44b68cf5879 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:14.107536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7475a-e96c-421c-837b-b44b68cf5879 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:14.107821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7475a-e96c-421c-837b-b44b68cf5879 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:14.109823 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7475a-e96c-421c-837b-b44b68cf5879 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:14.134769 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 601/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Sep 9 20:46:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:14.136302 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d97ea-089c-4067-9612-305e9a3039db None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:14.258627 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d97ea-089c-4067-9612-305e9a3039db None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:14.305394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04595cbd-909a-4a7c-bc30-3a581cba4614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:14.305394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04595cbd-909a-4a7c-bc30-3a581cba4614 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:14.305394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04595cbd-909a-4a7c-bc30-3a581cba4614 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:14.305394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04595cbd-909a-4a7c-bc30-3a581cba4614 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:14.338105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:14.380224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04595cbd-909a-4a7c-bc30-3a581cba4614 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:14.381682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04595cbd-909a-4a7c-bc30-3a581cba4614 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:14.496105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 613/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:46:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 20:46:14.498021 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7475a-e96c-421c-837b-b44b68cf5879 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:14.523134 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:14.628424 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7475a-e96c-421c-837b-b44b68cf5879 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:14.671971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95a1b7-56ad-4f27-9e48-92f9f9e63f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:14.672626 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95a1b7-56ad-4f27-9e48-92f9f9e63f80 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:14.672907 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95a1b7-56ad-4f27-9e48-92f9f9e63f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:14.673173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95a1b7-56ad-4f27-9e48-92f9f9e63f80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:14.687516 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95a1b7-56ad-4f27-9e48-92f9f9e63f80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:14.689290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95a1b7-56ad-4f27-9e48-92f9f9e63f80 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:14.707496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-0c95a1b7-56ad-4f27-9e48-92f9f9e63f80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:14.707496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:14.707496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:14.707496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:14.707496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:14.707496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:14.707496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:14.707496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:14.707496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:14.707496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:14.707496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:14.707496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:14.707496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:46:14.707496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:46:14.707496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:46:14.707496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:46:14.709344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:14.709344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:14.709344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:14.709344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:14.709344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:14.709344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:14.709344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:14.709344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:14.709344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:14.709344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:14.709344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:14.709344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:14.709344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:14.709344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:14.709344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:14.709344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:14.709344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:46:14.710463 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:46:14.710463 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:14.710463 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:46:14.710463 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 602/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:46:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:14.716795 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04595cbd-909a-4a7c-bc30-3a581cba4614 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:14.800637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:14.850600 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04595cbd-909a-4a7c-bc30-3a581cba4614 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:14.899218 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2c966-0795-4dec-b3b0-84f948284562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:14.900306 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2c966-0795-4dec-b3b0-84f948284562 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:14.900584 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2c966-0795-4dec-b3b0-84f948284562 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:14.900854 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2c966-0795-4dec-b3b0-84f948284562 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:14.901485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2c966-0795-4dec-b3b0-84f948284562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:14.904655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2c966-0795-4dec-b3b0-84f948284562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:14.904655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2c966-0795-4dec-b3b0-84f948284562 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:14.917494 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 614/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:14.923453 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95a1b7-56ad-4f27-9e48-92f9f9e63f80 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:15.003132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:15.043778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95a1b7-56ad-4f27-9e48-92f9f9e63f80 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:15.081754 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180e6f4-bcff-490a-9060-cbd9b694bd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:15.082317 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180e6f4-bcff-490a-9060-cbd9b694bd02 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:15.082601 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180e6f4-bcff-490a-9060-cbd9b694bd02 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:15.082875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180e6f4-bcff-490a-9060-cbd9b694bd02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:15.094123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180e6f4-bcff-490a-9060-cbd9b694bd02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:15.095605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180e6f4-bcff-490a-9060-cbd9b694bd02 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:15.108473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-2180e6f4-bcff-490a-9060-cbd9b694bd02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:46:15.108473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:15.108473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:15.108473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:15.108473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:15.108473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:15.108473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:15.108473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:15.108473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:15.108473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:15.108473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:15.108473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:15.108473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:46:15.108473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:46:15.108473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:46:15.109570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:46:15.109570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:15.109570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:15.109570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:15.109570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:15.109570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:15.109570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:15.109570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:15.109570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:15.109570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:15.109570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:15.109570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:15.109570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:15.109570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:15.109570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:15.109570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:15.109570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:15.110699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:46:15.110699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:46:15.110699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:46:15.110699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:46:15.110699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:46:15.110699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:46:15.110699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:46:15.110699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:46:15.110699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 603/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:46:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 09 20:46:15.116047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2c966-0795-4dec-b3b0-84f948284562 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:15.225057 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2c966-0795-4dec-b3b0-84f948284562 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:15.249689 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:15.264933 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd794a0-7cab-4aaa-9424-ee783e50f089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:15.265699 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd794a0-7cab-4aaa-9424-ee783e50f089 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:15.266068 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd794a0-7cab-4aaa-9424-ee783e50f089 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:15.266337 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd794a0-7cab-4aaa-9424-ee783e50f089 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:15.267192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd794a0-7cab-4aaa-9424-ee783e50f089 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:15.267495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd794a0-7cab-4aaa-9424-ee783e50f089 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:15.269149 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd794a0-7cab-4aaa-9424-ee783e50f089 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:15.284657 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 615/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:46:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:46:15.291841 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180e6f4-bcff-490a-9060-cbd9b694bd02 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:15.406719 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180e6f4-bcff-490a-9060-cbd9b694bd02 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:15.440543 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:15.448734 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586ae15-07f8-4fae-90bc-7365a70a5e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:15.449346 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586ae15-07f8-4fae-90bc-7365a70a5e55 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:15.449627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586ae15-07f8-4fae-90bc-7365a70a5e55 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:15.449898 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586ae15-07f8-4fae-90bc-7365a70a5e55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:15.450610 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586ae15-07f8-4fae-90bc-7365a70a5e55 None admin] RBAC: Adding query filter params (role.id=e3de94d5ee924ea4b638d196d282af55, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=0fc28d9a1b3f4feca0deeb5f266f8b37) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:15.450929 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586ae15-07f8-4fae-90bc-7365a70a5e55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:15.452788 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586ae15-07f8-4fae-90bc-7365a70a5e55 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:15.459380 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 604/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:46:15 2022] GET /identity/v3/role_assignments?user.id=0fc28d9a1b3f4feca0deeb5f266f8b37&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=e3de94d5ee924ea4b638d196d282af55 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:17.744276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bff4a-b0a2-4909-b8e8-5e2dd0d0e137 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:17.744806 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bff4a-b0a2-4909-b8e8-5e2dd0d0e137 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:17.744806 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bff4a-b0a2-4909-b8e8-5e2dd0d0e137 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:17.746437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 616/1220] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:46:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:46:17.751771 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850542a2-a249-449d-b994-68bfe40c4f91 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:17.752278 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850542a2-a249-449d-b994-68bfe40c4f91 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:17.752417 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850542a2-a249-449d-b994-68bfe40c4f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:17.771958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-850542a2-a249-449d-b994-68bfe40c4f91 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:46:17.773222 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-850542a2-a249-449d-b994-68bfe40c4f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:46:17.855006 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 605/1221] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:46:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:46:18.165829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bff4a-b0a2-4909-b8e8-5e2dd0d0e137 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:18.271510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bff4a-b0a2-4909-b8e8-5e2dd0d0e137 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:18.314108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa914aad-a1d4-4970-b7de-f73017e3e363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:18.314885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa914aad-a1d4-4970-b7de-f73017e3e363 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:18.315198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa914aad-a1d4-4970-b7de-f73017e3e363 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:18.315486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa914aad-a1d4-4970-b7de-f73017e3e363 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:18.328383 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa914aad-a1d4-4970-b7de-f73017e3e363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:46:18.333510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-aa914aad-a1d4-4970-b7de-f73017e3e363 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:46:18.333510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:18.333510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:18.333510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:18.333510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:18.333510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:18.333510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:18.333510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:18.333510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:18.333510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:18.333510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:18.333510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:18.333510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:46:18.333510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:46:18.333510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:46:18.333510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:46:18.334529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:46:18.334529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:46:18.334529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:46:18.334529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:46:18.334529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:18.334529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:18.334529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:18.334529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:18.334529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:18.334529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:18.334529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:18.334529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:18.334529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:18.334529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:18.334529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:18.334529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:18.335360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:18.335360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:18.335360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:18.335360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:18.335360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:46:18.335360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:46:18.335360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:46:18.335360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:46:18.335360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:46:18.335360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:46:18.335360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:46:18.335360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:18.335360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 617/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:46:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:18.342699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850542a2-a249-449d-b994-68bfe40c4f91 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:18.454899 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850542a2-a249-449d-b994-68bfe40c4f91 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:18.479537 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:18.491578 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831a338-df6f-42cd-aeb1-8b17695ae5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:18.492224 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831a338-df6f-42cd-aeb1-8b17695ae5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:18.492502 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831a338-df6f-42cd-aeb1-8b17695ae5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:18.493379 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831a338-df6f-42cd-aeb1-8b17695ae5f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:18.494092 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831a338-df6f-42cd-aeb1-8b17695ae5f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:18.494393 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831a338-df6f-42cd-aeb1-8b17695ae5f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:18.495762 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831a338-df6f-42cd-aeb1-8b17695ae5f0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:18.508945 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 606/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Sep 9 20:46:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:18.510147 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa914aad-a1d4-4970-b7de-f73017e3e363 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:18.557056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:18.615181 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa914aad-a1d4-4970-b7de-f73017e3e363 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:18.650867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f32385-7869-4253-9b4f-ebf3004a4d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:18.651494 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f32385-7869-4253-9b4f-ebf3004a4d03 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:18.652049 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f32385-7869-4253-9b4f-ebf3004a4d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:18.652319 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f32385-7869-4253-9b4f-ebf3004a4d03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:18.662736 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f32385-7869-4253-9b4f-ebf3004a4d03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:18.664310 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f32385-7869-4253-9b4f-ebf3004a4d03 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:18.680173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-17f32385-7869-4253-9b4f-ebf3004a4d03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:18.680173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:18.680173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:18.680173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:18.680173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:18.680173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:18.680173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:18.680173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:18.680173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:18.680173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:18.680173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:18.680173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:18.680173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:46:18.680173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:46:18.680173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:46:18.680173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:46:18.682004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:18.682004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:18.682004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:18.682004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:18.682004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:18.682004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:18.682004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:18.682004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:18.682004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:18.682004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:18.682004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:18.682004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:18.682004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:18.682004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:18.682004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:18.682004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:18.682004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:46:18.683543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:46:18.683543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:18.683543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:18.683543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 618/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:46:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:18.688308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831a338-df6f-42cd-aeb1-8b17695ae5f0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:18.798739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831a338-df6f-42cd-aeb1-8b17695ae5f0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:18.842301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e94923-29be-47fa-b7a1-69429832196b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:18.842938 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e94923-29be-47fa-b7a1-69429832196b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:18.843217 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e94923-29be-47fa-b7a1-69429832196b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:18.843486 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e94923-29be-47fa-b7a1-69429832196b None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:18.844184 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e94923-29be-47fa-b7a1-69429832196b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:18.844488 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e94923-29be-47fa-b7a1-69429832196b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:18.845827 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e94923-29be-47fa-b7a1-69429832196b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:18.858624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 607/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:18.864557 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f32385-7869-4253-9b4f-ebf3004a4d03 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:18.958593 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:18.966525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f32385-7869-4253-9b4f-ebf3004a4d03 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:19.001361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9c327-baa3-4375-932e-05cae028ef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:19.002082 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9c327-baa3-4375-932e-05cae028ef63 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:19.002358 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9c327-baa3-4375-932e-05cae028ef63 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:19.002626 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9c327-baa3-4375-932e-05cae028ef63 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:19.010516 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9c327-baa3-4375-932e-05cae028ef63 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:19.011942 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9c327-baa3-4375-932e-05cae028ef63 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:19.023694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-4ac9c327-baa3-4375-932e-05cae028ef63 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 20:46:19.023694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:19.023694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:19.023694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:19.023694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:19.023694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:19.023694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:19.023694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:19.023694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:19.023694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:19.023694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:19.023694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:19.023694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:46:19.023694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:46:19.023694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:46:19.023694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:46:19.025514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:19.025514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:19.025514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:46:19.025514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:46:19.025514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:46:19.025514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:46:19.025514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:19.025514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:19.025514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:19.025514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:19.025514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:19.025514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:19.025514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:19.025514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:19.025514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:19.025514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:19.025514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:19.025514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:19.028329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:19.028329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:19.028329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:46:19.028329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:46:19.028329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:46:19.028329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:46:19.028329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:46:19.028329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:46:19.028329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 20:46:19.028329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:19.028329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 619/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:46:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:19.031638 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e94923-29be-47fa-b7a1-69429832196b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:19.089601 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:19.145851 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e94923-29be-47fa-b7a1-69429832196b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:19.182607 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14673b6-54b3-406a-a820-5797bd5c63a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:19.183236 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14673b6-54b3-406a-a820-5797bd5c63a5 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:19.183515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14673b6-54b3-406a-a820-5797bd5c63a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:19.183789 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14673b6-54b3-406a-a820-5797bd5c63a5 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:19.184549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14673b6-54b3-406a-a820-5797bd5c63a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:19.184860 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14673b6-54b3-406a-a820-5797bd5c63a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:19.186430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14673b6-54b3-406a-a820-5797bd5c63a5 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:19.205448 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 608/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Sep 9 20:46:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:19.211549 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9c327-baa3-4375-932e-05cae028ef63 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:19.319263 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9c327-baa3-4375-932e-05cae028ef63 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:19.355087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7a709-888b-44e1-94cc-9e34ed8a47f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:19.355634 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7a709-888b-44e1-94cc-9e34ed8a47f1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:19.355930 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7a709-888b-44e1-94cc-9e34ed8a47f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:19.356288 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7a709-888b-44e1-94cc-9e34ed8a47f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:19.367666 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7a709-888b-44e1-94cc-9e34ed8a47f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:19.369396 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7a709-888b-44e1-94cc-9e34ed8a47f1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:19.388429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-71e7a709-888b-44e1-94cc-9e34ed8a47f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:19.388429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:19.388429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:19.388429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:19.388429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:19.388429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:19.388429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:19.388429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:19.388429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:19.388429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:19.388429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:19.388429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:19.388429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:46:19.388429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:46:19.388429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:46:19.388429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:46:19.389693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:19.389693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:19.389693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:19.389693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:19.389693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:19.389693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:19.389693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:19.389693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:19.389693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:19.389693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:19.389693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:19.389693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:19.389693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:19.389693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:19.389693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:19.389693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:19.389693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:46:19.390720 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:46:19.390720 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:19.390720 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:19.390720 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 620/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:19.395716 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14673b6-54b3-406a-a820-5797bd5c63a5 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:19.504392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14673b6-54b3-406a-a820-5797bd5c63a5 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:19.506848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:19.544550 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d92e0-a326-40ea-bf90-96361998c7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:19.545364 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d92e0-a326-40ea-bf90-96361998c7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:19.545961 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d92e0-a326-40ea-bf90-96361998c7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:19.546363 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61d92e0-a326-40ea-bf90-96361998c7e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:19.547254 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d92e0-a326-40ea-bf90-96361998c7e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:19.547800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d92e0-a326-40ea-bf90-96361998c7e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:19.549497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61d92e0-a326-40ea-bf90-96361998c7e9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:19.565365 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 609/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:19.571226 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7a709-888b-44e1-94cc-9e34ed8a47f1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:19.582502 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:19.678458 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7a709-888b-44e1-94cc-9e34ed8a47f1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:19.713383 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c7213-5ebe-415a-a6a0-cb53036b4895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:19.714016 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c7213-5ebe-415a-a6a0-cb53036b4895 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:19.714305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c7213-5ebe-415a-a6a0-cb53036b4895 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:19.714582 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c7213-5ebe-415a-a6a0-cb53036b4895 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:19.721381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c7213-5ebe-415a-a6a0-cb53036b4895 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:19.722796 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c7213-5ebe-415a-a6a0-cb53036b4895 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:19.733961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-303c7213-5ebe-415a-a6a0-cb53036b4895 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:46:19.733961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:19.733961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:19.733961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:19.733961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:19.733961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:19.733961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:19.733961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:19.733961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:19.733961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:19.733961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:19.733961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:19.733961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:46:19.733961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:46:19.733961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:46:19.735086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:46:19.735086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:19.735086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:19.735086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:19.735086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:19.735086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:19.735086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:19.735086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:19.735086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:19.735086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:19.735086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:19.735086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:19.735086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:19.735086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:19.735086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:19.735086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:19.735086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:19.736257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:46:19.736257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:46:19.736257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:46:19.736257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:46:19.736257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:46:19.736257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:46:19.736257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:46:19.736257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:19.736257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 621/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:46:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:19.741012 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d92e0-a326-40ea-bf90-96361998c7e9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:19.856938 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61d92e0-a326-40ea-bf90-96361998c7e9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:19.896905 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b702dd-237b-47ba-9e76-41705d02e0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:19.897603 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b702dd-237b-47ba-9e76-41705d02e0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:19.897887 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b702dd-237b-47ba-9e76-41705d02e0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:19.898157 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b702dd-237b-47ba-9e76-41705d02e0a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:19.898872 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b702dd-237b-47ba-9e76-41705d02e0a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:19.899241 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b702dd-237b-47ba-9e76-41705d02e0a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:19.900739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b702dd-237b-47ba-9e76-41705d02e0a2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:19.914246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 610/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:46:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:19.921143 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c7213-5ebe-415a-a6a0-cb53036b4895 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:19.997919 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:20.038051 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c7213-5ebe-415a-a6a0-cb53036b4895 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:20.077079 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c0c6a3-800e-4937-bc90-f917e45ad4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:20.077860 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0c6a3-800e-4937-bc90-f917e45ad4e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:20.078159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0c6a3-800e-4937-bc90-f917e45ad4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:20.078498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c0c6a3-800e-4937-bc90-f917e45ad4e9 None admin] PATH_INFO: `/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/0fc28d9a1b3f4feca0deeb5f266f8b37/roles/e3de94d5ee924ea4b638d196d282af55` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:20.096206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0c6a3-800e-4937-bc90-f917e45ad4e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a57df41195d240fe8f28ac49bfd37921, user_id=0fc28d9a1b3f4feca0deeb5f266f8b37, role_id=e3de94d5ee924ea4b638d196d282af55)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:20.097904 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c0c6a3-800e-4937-bc90-f917e45ad4e9 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:20.112322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 622/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:46:19 2022] PUT /identity/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/0fc28d9a1b3f4feca0deeb5f266f8b37/roles/e3de94d5ee924ea4b638d196d282af55 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:46:22.323161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3a5e4-8b1b-4be8-8f94-1d710530c876 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:22.323708 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3a5e4-8b1b-4be8-8f94-1d710530c876 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:22.323708 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3a5e4-8b1b-4be8-8f94-1d710530c876 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:22.325316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 611/1233] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:46:22.331024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963766b-2acc-4c10-a6b5-69f8ea1b4724 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:22.331464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963766b-2acc-4c10-a6b5-69f8ea1b4724 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:22.331557 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963766b-2acc-4c10-a6b5-69f8ea1b4724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:22.354131 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6963766b-2acc-4c10-a6b5-69f8ea1b4724 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:46:22.355316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6963766b-2acc-4c10-a6b5-69f8ea1b4724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:46:22.432692 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 623/1234] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:46:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 20:46:22.713134 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3a5e4-8b1b-4be8-8f94-1d710530c876 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:22.739925 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:22.828138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3a5e4-8b1b-4be8-8f94-1d710530c876 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:22.867055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a37d8-f3eb-400e-9569-1039b5aa8f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:22.868335 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a37d8-f3eb-400e-9569-1039b5aa8f2f None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:22.868798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a37d8-f3eb-400e-9569-1039b5aa8f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:22.869216 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a37d8-f3eb-400e-9569-1039b5aa8f2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:22.880304 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a37d8-f3eb-400e-9569-1039b5aa8f2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:46:22.885132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-248a37d8-f3eb-400e-9569-1039b5aa8f2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:46:22.885132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:22.885132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:22.885132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:22.885132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:22.885132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:22.885132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:22.885132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:22.885132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:22.885132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:22.885132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:22.885132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:22.885132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:46:22.885132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:46:22.885132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:46:22.885132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:46:22.886599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:46:22.886599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:46:22.886599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:46:22.886599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:46:22.886599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:22.886599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:22.886599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:22.886599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:22.886599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:22.886599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:22.886599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:22.886599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:22.886599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:22.886599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:22.886599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:22.886599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:22.887694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:22.887694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:22.887694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:22.887694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:22.887694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:46:22.887694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:46:22.887694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:46:22.887694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:46:22.887694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:46:22.887694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:46:22.887694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 09 20:46:22.887694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:46:22.887694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 612/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Sep 9 20:46:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:22.892376 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963766b-2acc-4c10-a6b5-69f8ea1b4724 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:22.945709 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:23.007904 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963766b-2acc-4c10-a6b5-69f8ea1b4724 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:23.048722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb611e0-2689-4ebb-ae37-4bd03efdeb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:23.049476 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb611e0-2689-4ebb-ae37-4bd03efdeb5a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:23.049832 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb611e0-2689-4ebb-ae37-4bd03efdeb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:23.050111 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb611e0-2689-4ebb-ae37-4bd03efdeb5a None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:23.050814 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb611e0-2689-4ebb-ae37-4bd03efdeb5a None admin] RBAC: Adding query filter params (name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:23.051193 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb611e0-2689-4ebb-ae37-4bd03efdeb5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:23.052768 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb611e0-2689-4ebb-ae37-4bd03efdeb5a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:23.062049 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 624/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Sep 9 20:46:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:23.068596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a37d8-f3eb-400e-9569-1039b5aa8f2f None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:23.165620 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:23.186854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a37d8-f3eb-400e-9569-1039b5aa8f2f None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:23.224810 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62208b0a-c556-4aab-b295-8c14b21fd17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:23.225461 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62208b0a-c556-4aab-b295-8c14b21fd17b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:23.225738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62208b0a-c556-4aab-b295-8c14b21fd17b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:23.226014 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62208b0a-c556-4aab-b295-8c14b21fd17b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:23.237345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62208b0a-c556-4aab-b295-8c14b21fd17b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:23.238862 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62208b0a-c556-4aab-b295-8c14b21fd17b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:23.254768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-62208b0a-c556-4aab-b295-8c14b21fd17b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:23.254768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:23.254768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:23.254768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:23.254768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:23.254768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:23.254768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:23.254768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:23.254768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:23.254768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:23.254768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:23.254768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:23.254768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:46:23.254768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:46:23.254768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:46:23.254768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:46:23.255794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:23.255794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:23.255794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:23.255794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:23.255794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:23.255794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:23.255794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:23.255794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:23.255794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:23.255794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:23.255794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:23.255794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:23.255794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:23.255794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:23.255794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:23.255794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:23.255794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:46:23.257078 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:46:23.257078 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:23.257078 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:46:23.257078 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 613/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:46:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:23.262253 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb611e0-2689-4ebb-ae37-4bd03efdeb5a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:23.371194 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb611e0-2689-4ebb-ae37-4bd03efdeb5a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:23.381039 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:23.411429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca92bdf-21fd-4a78-b9b4-afa36d075019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:23.412097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca92bdf-21fd-4a78-b9b4-afa36d075019 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:23.412405 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca92bdf-21fd-4a78-b9b4-afa36d075019 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:23.412851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca92bdf-21fd-4a78-b9b4-afa36d075019 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:23.413478 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca92bdf-21fd-4a78-b9b4-afa36d075019 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:23.413778 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca92bdf-21fd-4a78-b9b4-afa36d075019 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:23.416144 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca92bdf-21fd-4a78-b9b4-afa36d075019 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:23.429234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 625/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:23.435513 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62208b0a-c556-4aab-b295-8c14b21fd17b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:23.547951 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62208b0a-c556-4aab-b295-8c14b21fd17b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:23.583439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f70030-b2be-4b7c-977d-243958825b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:23.584099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f70030-b2be-4b7c-977d-243958825b72 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:23.584382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f70030-b2be-4b7c-977d-243958825b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:23.584652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f70030-b2be-4b7c-977d-243958825b72 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:23.588382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:23.593762 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f70030-b2be-4b7c-977d-243958825b72 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:23.596009 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f70030-b2be-4b7c-977d-243958825b72 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:23.608567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-27f70030-b2be-4b7c-977d-243958825b72 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 20:46:23.608567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:23.608567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:23.608567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:23.608567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:23.608567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:23.608567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:23.608567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:23.608567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:23.608567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:23.608567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:23.608567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:23.608567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:46:23.608567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:46:23.608567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:46:23.608567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:46:23.614650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:23.614650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:23.614650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:46:23.614650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:46:23.614650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:46:23.614650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:46:23.614650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:23.614650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:23.614650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:23.614650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:23.614650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:23.614650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:23.614650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:23.614650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:23.614650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:23.614650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:23.614650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:23.614650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:23.615865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:23.615865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:23.615865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:46:23.615865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:46:23.615865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:46:23.615865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:46:23.615865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:46:23.615865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:46:23.615865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 20:46:23.615865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:46:23.615865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 614/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:46:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:23.616957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca92bdf-21fd-4a78-b9b4-afa36d075019 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:23.726691 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca92bdf-21fd-4a78-b9b4-afa36d075019 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:23.766436 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8d713-cbde-4a31-bef7-287946764d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:23.768337 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8d713-cbde-4a31-bef7-287946764d9c None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:23.768337 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8d713-cbde-4a31-bef7-287946764d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:23.768337 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b8d713-cbde-4a31-bef7-287946764d9c None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:23.768337 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8d713-cbde-4a31-bef7-287946764d9c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:23.768789 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8d713-cbde-4a31-bef7-287946764d9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:23.770178 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b8d713-cbde-4a31-bef7-287946764d9c None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:23.797008 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 626/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Sep 9 20:46:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:23.798623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f70030-b2be-4b7c-977d-243958825b72 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:23.919766 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f70030-b2be-4b7c-977d-243958825b72 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:23.956050 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0439c0-4b1c-41d5-beeb-c8329824b3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:23.956673 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0439c0-4b1c-41d5-beeb-c8329824b3ad None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:23.956949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0439c0-4b1c-41d5-beeb-c8329824b3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:23.957224 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0439c0-4b1c-41d5-beeb-c8329824b3ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:24.023079 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:24.030677 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0439c0-4b1c-41d5-beeb-c8329824b3ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:24.032210 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0439c0-4b1c-41d5-beeb-c8329824b3ad None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:24.139951 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 615/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:46:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 20:46:24.145690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8d713-cbde-4a31-bef7-287946764d9c None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:24.177017 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:24.262782 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b8d713-cbde-4a31-bef7-287946764d9c None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:24.302290 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c73fda-e4e0-4474-9b43-114c1717bbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:24.303022 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c73fda-e4e0-4474-9b43-114c1717bbda None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:24.303378 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c73fda-e4e0-4474-9b43-114c1717bbda None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:24.303714 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c73fda-e4e0-4474-9b43-114c1717bbda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:24.316953 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c73fda-e4e0-4474-9b43-114c1717bbda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:24.318394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c73fda-e4e0-4474-9b43-114c1717bbda None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:24.333994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-e4c73fda-e4e0-4474-9b43-114c1717bbda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:24.333994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:24.333994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:24.333994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:24.333994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:24.333994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:24.333994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:24.333994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:24.333994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:24.333994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:24.333994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:24.333994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:24.333994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:46:24.333994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:46:24.333994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:46:24.333994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:46:24.335140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:24.335140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:24.335140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:24.335140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:24.335140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:24.335140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:24.335140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:24.335140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:24.335140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:24.335140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:24.335140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:24.335140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:24.335140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:24.335140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:24.335140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:24.335140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:24.335140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:46:24.336255 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:46:24.336255 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:24.336255 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:24.337100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 627/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:24.343163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0439c0-4b1c-41d5-beeb-c8329824b3ad None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:24.451454 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:24.458334 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0439c0-4b1c-41d5-beeb-c8329824b3ad None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:24.497162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6ba12-4367-465f-bc2e-7ae0a96c46b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:24.497904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6ba12-4367-465f-bc2e-7ae0a96c46b0 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:24.498197 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6ba12-4367-465f-bc2e-7ae0a96c46b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:24.498499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6ba12-4367-465f-bc2e-7ae0a96c46b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:24.499345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6ba12-4367-465f-bc2e-7ae0a96c46b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:24.499711 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6ba12-4367-465f-bc2e-7ae0a96c46b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:24.501425 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6ba12-4367-465f-bc2e-7ae0a96c46b0 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:24.515407 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 616/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:24.521018 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c73fda-e4e0-4474-9b43-114c1717bbda None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:24.609170 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:24.633080 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c73fda-e4e0-4474-9b43-114c1717bbda None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:24.669496 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9d19f-b02b-445d-bfc3-80ae50f90f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:24.670144 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9d19f-b02b-445d-bfc3-80ae50f90f82 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:24.670389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9d19f-b02b-445d-bfc3-80ae50f90f82 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:24.670653 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9d19f-b02b-445d-bfc3-80ae50f90f82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:24.677220 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9d19f-b02b-445d-bfc3-80ae50f90f82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:24.678649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9d19f-b02b-445d-bfc3-80ae50f90f82 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:24.689909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-4cd9d19f-b02b-445d-bfc3-80ae50f90f82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:46:24.689909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:24.689909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:24.689909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:24.689909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:24.689909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:24.689909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:24.689909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:24.689909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:24.689909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:24.689909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:24.689909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:24.689909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:46:24.689909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:46:24.689909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:46:24.691001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:46:24.691001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:24.691001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:24.691001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:24.691001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:24.691001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:24.691001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:24.691001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:24.691001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:24.691001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:24.691001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:24.691001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:24.691001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:24.691001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:24.691001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:24.691001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:24.691001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:24.692050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:46:24.692050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:46:24.692050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:46:24.692050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:46:24.692050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:46:24.692050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:46:24.692050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:46:24.692050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:24.692050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 628/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:46:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:24.698853 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6ba12-4367-465f-bc2e-7ae0a96c46b0 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:24.806972 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6ba12-4367-465f-bc2e-7ae0a96c46b0 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:24.847583 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3ed44-c5f8-4046-af81-c51134e72d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:24.848243 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3ed44-c5f8-4046-af81-c51134e72d98 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:24.848518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3ed44-c5f8-4046-af81-c51134e72d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:24.848784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3ed44-c5f8-4046-af81-c51134e72d98 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:24.849465 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3ed44-c5f8-4046-af81-c51134e72d98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:24.849767 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3ed44-c5f8-4046-af81-c51134e72d98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:24.851323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3ed44-c5f8-4046-af81-c51134e72d98 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:24.863757 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 617/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:46:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:24.871074 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9d19f-b02b-445d-bfc3-80ae50f90f82 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:24.984023 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9d19f-b02b-445d-bfc3-80ae50f90f82 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:25.021942 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d04b9b-93bc-4709-8a6e-819da0cbe071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:25.022573 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d04b9b-93bc-4709-8a6e-819da0cbe071 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:25.022848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d04b9b-93bc-4709-8a6e-819da0cbe071 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:25.023117 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d04b9b-93bc-4709-8a6e-819da0cbe071 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:25.024395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d04b9b-93bc-4709-8a6e-819da0cbe071 None admin] RBAC: Adding query filter params (role.id=e3de94d5ee924ea4b638d196d282af55, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=0fc28d9a1b3f4feca0deeb5f266f8b37) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:25.024785 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d04b9b-93bc-4709-8a6e-819da0cbe071 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:25.026206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d04b9b-93bc-4709-8a6e-819da0cbe071 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:25.032390 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 629/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:46:24 2022] GET /identity/v3/role_assignments?user.id=0fc28d9a1b3f4feca0deeb5f266f8b37&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=e3de94d5ee924ea4b638d196d282af55 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:27.370027 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17fc7f-02b5-4f7f-a57b-a7d30728a99f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:27.370635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17fc7f-02b5-4f7f-a57b-a7d30728a99f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:27.370717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17fc7f-02b5-4f7f-a57b-a7d30728a99f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:27.372055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 618/1247] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:46:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:46:27.377553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefb020-a774-417b-9f56-d013eadf5ed5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:27.377989 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefb020-a774-417b-9f56-d013eadf5ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:27.378131 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefb020-a774-417b-9f56-d013eadf5ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:27.385255 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:27.400129 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0fefb020-a774-417b-9f56-d013eadf5ed5 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:46:27.401853 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0fefb020-a774-417b-9f56-d013eadf5ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:46:27.477611 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 630/1248] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:46:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:46:27.769299 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17fc7f-02b5-4f7f-a57b-a7d30728a99f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:27.792723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:27.896545 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17fc7f-02b5-4f7f-a57b-a7d30728a99f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:27.935117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d5503-ebf1-4df2-a501-0338bdc2a0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:27.935854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d5503-ebf1-4df2-a501-0338bdc2a0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:27.936168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d5503-ebf1-4df2-a501-0338bdc2a0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:27.936436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d5503-ebf1-4df2-a501-0338bdc2a0e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:27.948183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d5503-ebf1-4df2-a501-0338bdc2a0e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:46:27.953001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-a38d5503-ebf1-4df2-a501-0338bdc2a0e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:46:27.953001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:27.953001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:27.953001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:27.953001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:27.953001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:27.953001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:27.953001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:27.953001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:27.953001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:27.953001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:27.953001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:27.953001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:46:27.953001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:46:27.953001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:46:27.953001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:46:27.954135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:46:27.954135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:46:27.954135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:46:27.954135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:46:27.954135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:27.954135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:27.954135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:27.954135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:27.954135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:27.954135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:27.954135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:27.954135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:27.954135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:27.954135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:27.954135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:27.954135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:27.955386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:27.955386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:27.955386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:27.955386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:27.955386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:46:27.955386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:46:27.955386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:46:27.955386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:46:27.955386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:46:27.955386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:46:27.955386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:46:27.955386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:46:27.955386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 619/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:46:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:27.960719 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefb020-a774-417b-9f56-d013eadf5ed5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:28.079159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefb020-a774-417b-9f56-d013eadf5ed5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:28.112307 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:28.117824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4b164-080a-4eec-abd7-e8d3e781ef5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:28.118449 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4b164-080a-4eec-abd7-e8d3e781ef5d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:28.118730 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4b164-080a-4eec-abd7-e8d3e781ef5d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:28.119007 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c4b164-080a-4eec-abd7-e8d3e781ef5d None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:28.119696 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4b164-080a-4eec-abd7-e8d3e781ef5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:28.120076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4b164-080a-4eec-abd7-e8d3e781ef5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:28.121474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c4b164-080a-4eec-abd7-e8d3e781ef5d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:28.130737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 631/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:46:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:28.137047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d5503-ebf1-4df2-a501-0338bdc2a0e7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:28.221256 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:28.246679 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d5503-ebf1-4df2-a501-0338bdc2a0e7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:28.282145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915da589-ae95-48e5-a8d9-15bd762938f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:28.282794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915da589-ae95-48e5-a8d9-15bd762938f9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:28.283079 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915da589-ae95-48e5-a8d9-15bd762938f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:28.283414 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915da589-ae95-48e5-a8d9-15bd762938f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:28.295141 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915da589-ae95-48e5-a8d9-15bd762938f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:28.296659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915da589-ae95-48e5-a8d9-15bd762938f9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:28.312759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-915da589-ae95-48e5-a8d9-15bd762938f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:28.312759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:28.312759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:28.312759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:28.312759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:28.312759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:28.312759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:28.312759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:28.312759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:28.312759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:28.312759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:28.312759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:28.312759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:46:28.312759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:46:28.312759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:46:28.312759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:46:28.313806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:28.313806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:28.313806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:28.313806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:28.313806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:28.313806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:28.313806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:28.313806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:28.313806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:28.313806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:28.313806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:28.313806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:28.313806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:28.313806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:28.313806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:28.313806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:28.313806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:46:28.314705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:46:28.314705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:28.314705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:46:28.314705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 620/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:28.319950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4b164-080a-4eec-abd7-e8d3e781ef5d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:28.426044 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c4b164-080a-4eec-abd7-e8d3e781ef5d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:28.460828 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484e83d-f987-41df-9def-fde3854c3158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:28.462031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484e83d-f987-41df-9def-fde3854c3158 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:28.462304 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484e83d-f987-41df-9def-fde3854c3158 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:28.462569 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484e83d-f987-41df-9def-fde3854c3158 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:28.463411 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484e83d-f987-41df-9def-fde3854c3158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:28.463716 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484e83d-f987-41df-9def-fde3854c3158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:28.465115 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484e83d-f987-41df-9def-fde3854c3158 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:28.477251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 632/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:28.483272 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915da589-ae95-48e5-a8d9-15bd762938f9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:28.590752 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915da589-ae95-48e5-a8d9-15bd762938f9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:28.616428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:28.627673 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a1f92-62af-4e0f-bcfa-ca74a209f17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:28.628386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a1f92-62af-4e0f-bcfa-ca74a209f17b None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:28.628670 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a1f92-62af-4e0f-bcfa-ca74a209f17b None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:28.629007 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a1f92-62af-4e0f-bcfa-ca74a209f17b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:28.638141 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a1f92-62af-4e0f-bcfa-ca74a209f17b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:28.639607 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441a1f92-62af-4e0f-bcfa-ca74a209f17b None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:28.651294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-441a1f92-62af-4e0f-bcfa-ca74a209f17b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 20:46:28.651294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:28.651294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:28.651294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:28.651294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:28.651294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:28.651294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:28.651294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:28.651294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:28.651294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:28.651294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:28.651294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:28.651294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:46:28.651294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:46:28.651294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:46:28.651294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:46:28.652738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:28.652738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:28.652738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:46:28.652738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:46:28.652738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:46:28.652738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:46:28.652738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:28.652738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:28.652738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:28.652738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:28.652738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:28.652738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:28.652738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:28.652738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:28.652738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:28.652738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:28.652738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:28.652738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:28.653690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:28.653690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:28.653690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:46:28.653690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:46:28.653690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:46:28.653690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:46:28.653690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:46:28.653690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:46:28.653690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 20:46:28.653690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:46:28.653690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 621/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:46:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:28.658855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484e83d-f987-41df-9def-fde3854c3158 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:28.718857 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:28.765479 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484e83d-f987-41df-9def-fde3854c3158 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:28.799594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf1d4a-691d-4f31-a160-034dc5b57461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:28.800311 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf1d4a-691d-4f31-a160-034dc5b57461 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:28.800704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf1d4a-691d-4f31-a160-034dc5b57461 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:28.800861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf1d4a-691d-4f31-a160-034dc5b57461 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:28.801642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf1d4a-691d-4f31-a160-034dc5b57461 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:28.801952 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf1d4a-691d-4f31-a160-034dc5b57461 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:28.803640 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf1d4a-691d-4f31-a160-034dc5b57461 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:28.824995 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 633/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Sep 9 20:46:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:28.831419 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a1f92-62af-4e0f-bcfa-ca74a209f17b None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:28.930384 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a1f92-62af-4e0f-bcfa-ca74a209f17b None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:28.963413 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d246c60-dfb0-4bc9-93ec-f1724065ffbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:28.964015 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d246c60-dfb0-4bc9-93ec-f1724065ffbc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:28.964302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d246c60-dfb0-4bc9-93ec-f1724065ffbc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:28.964571 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d246c60-dfb0-4bc9-93ec-f1724065ffbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:29.018461 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:29.031571 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d246c60-dfb0-4bc9-93ec-f1724065ffbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:29.033044 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d246c60-dfb0-4bc9-93ec-f1724065ffbc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:29.128058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 622/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:46:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 09 20:46:29.134356 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf1d4a-691d-4f31-a160-034dc5b57461 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:29.231380 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf1d4a-691d-4f31-a160-034dc5b57461 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:29.244557 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:29.264977 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0628855-43fb-4d3d-8945-fa04d380c14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:29.265590 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0628855-43fb-4d3d-8945-fa04d380c14a None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:29.265866 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0628855-43fb-4d3d-8945-fa04d380c14a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:29.266131 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0628855-43fb-4d3d-8945-fa04d380c14a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:29.275840 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0628855-43fb-4d3d-8945-fa04d380c14a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:29.277503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0628855-43fb-4d3d-8945-fa04d380c14a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:29.292216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-d0628855-43fb-4d3d-8945-fa04d380c14a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:29.292216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:29.292216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:29.292216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:29.292216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:29.292216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:29.292216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:29.292216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:29.292216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:29.292216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:29.292216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:29.292216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:29.292216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:46:29.292216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:46:29.292216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:46:29.292216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:46:29.293322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:29.293322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:29.293322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:29.293322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:29.293322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:29.293322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:29.293322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:29.293322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:29.293322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:29.293322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:29.293322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:29.293322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:29.293322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:29.293322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:29.293322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:29.293322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:29.293322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:46:29.294444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:46:29.294444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:29.294444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:29.294444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 634/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:29.298931 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d246c60-dfb0-4bc9-93ec-f1724065ffbc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:29.384279 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:29.396176 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d246c60-dfb0-4bc9-93ec-f1724065ffbc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:29.431788 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2a2d1-0d3d-49ae-856a-a6d0569bc8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:29.432424 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2a2d1-0d3d-49ae-856a-a6d0569bc8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:29.432701 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2a2d1-0d3d-49ae-856a-a6d0569bc8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:29.432969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2a2d1-0d3d-49ae-856a-a6d0569bc8f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:29.433591 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2a2d1-0d3d-49ae-856a-a6d0569bc8f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:29.433888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2a2d1-0d3d-49ae-856a-a6d0569bc8f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:29.435249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2a2d1-0d3d-49ae-856a-a6d0569bc8f4 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:29.446263 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 623/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:29.452184 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0628855-43fb-4d3d-8945-fa04d380c14a None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:29.549004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0628855-43fb-4d3d-8945-fa04d380c14a None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:29.581731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab2c34-9a39-4970-bd7e-862d5bb99656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:29.582355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab2c34-9a39-4970-bd7e-862d5bb99656 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:29.582635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab2c34-9a39-4970-bd7e-862d5bb99656 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:29.582911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab2c34-9a39-4970-bd7e-862d5bb99656 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:29.589676 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab2c34-9a39-4970-bd7e-862d5bb99656 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:29.591101 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab2c34-9a39-4970-bd7e-862d5bb99656 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:29.602950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c6ab2c34-9a39-4970-bd7e-862d5bb99656 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:46:29.602950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:29.602950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:29.602950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:29.602950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:29.602950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:29.602950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:29.602950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:29.602950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:29.602950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:29.602950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:29.602950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:29.602950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:46:29.602950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:46:29.602950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:46:29.604026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:46:29.604026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:29.604026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:29.604026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:29.604026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:29.604026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:29.604026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:29.604026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:29.604026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:29.604026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:29.604026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:29.604026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:29.604026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:29.604026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:29.604026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:29.604026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:29.604026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:29.609099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:46:29.609099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:46:29.609099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:46:29.609099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:46:29.609099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:46:29.609099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:46:29.609099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:46:29.609099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:29.609099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 635/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:46:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:29.609966 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2a2d1-0d3d-49ae-856a-a6d0569bc8f4 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:29.708822 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2a2d1-0d3d-49ae-856a-a6d0569bc8f4 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:29.741207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8cba4-ef14-41b4-8107-ce29f1df9942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:29.741806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8cba4-ef14-41b4-8107-ce29f1df9942 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:29.742087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8cba4-ef14-41b4-8107-ce29f1df9942 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:29.742385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8cba4-ef14-41b4-8107-ce29f1df9942 None admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:29.743679 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8cba4-ef14-41b4-8107-ce29f1df9942 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:29.744017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8cba4-ef14-41b4-8107-ce29f1df9942 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:29.745457 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b8cba4-ef14-41b4-8107-ce29f1df9942 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:29.757018 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 624/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:46:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:29.763582 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab2c34-9a39-4970-bd7e-862d5bb99656 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:29.792945 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:29.875564 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab2c34-9a39-4970-bd7e-862d5bb99656 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:29.907185 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0516d54-2cb8-48ff-a6f8-c88cb4682f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:29.907776 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0516d54-2cb8-48ff-a6f8-c88cb4682f54 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:29.908076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0516d54-2cb8-48ff-a6f8-c88cb4682f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:29.908344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0516d54-2cb8-48ff-a6f8-c88cb4682f54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:29.909048 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0516d54-2cb8-48ff-a6f8-c88cb4682f54 None admin] RBAC: Adding query filter params (role.id=be620fc7968740269d233c5ace94a563, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=0fc28d9a1b3f4feca0deeb5f266f8b37) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:29.909373 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0516d54-2cb8-48ff-a6f8-c88cb4682f54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:29.910790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0516d54-2cb8-48ff-a6f8-c88cb4682f54 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:29.916421 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 636/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:46:29 2022] GET /identity/v3/role_assignments?user.id=0fc28d9a1b3f4feca0deeb5f266f8b37&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=be620fc7968740269d233c5ace94a563 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:32.089175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26890d27-6f14-4a6f-bc56-9685cd5d735e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:32.089925 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26890d27-6f14-4a6f-bc56-9685cd5d735e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:32.089925 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26890d27-6f14-4a6f-bc56-9685cd5d735e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:32.091062 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 625/1261] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:46:32.096210 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb980e7-b858-431f-8c94-774050ceb389 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:32.096603 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb980e7-b858-431f-8c94-774050ceb389 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:32.096753 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb980e7-b858-431f-8c94-774050ceb389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:32.114682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-cfb980e7-b858-431f-8c94-774050ceb389 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:46:32.115869 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cfb980e7-b858-431f-8c94-774050ceb389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:46:32.180507 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 637/1262] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:46:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 20:46:32.460313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26890d27-6f14-4a6f-bc56-9685cd5d735e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:32.471785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:32.562945 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26890d27-6f14-4a6f-bc56-9685cd5d735e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:32.596371 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb61d57-73c2-41e0-b03e-f5d84ff0d67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:32.596996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb61d57-73c2-41e0-b03e-f5d84ff0d67d None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:32.597278 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb61d57-73c2-41e0-b03e-f5d84ff0d67d None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:32.597552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb61d57-73c2-41e0-b03e-f5d84ff0d67d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:32.608015 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb61d57-73c2-41e0-b03e-f5d84ff0d67d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:46:32.612758 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-1cb61d57-73c2-41e0-b03e-f5d84ff0d67d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:46:32.612758 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:32.612758 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:32.612758 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:32.612758 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:32.612758 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:32.612758 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:32.612758 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:32.612758 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:32.612758 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:32.612758 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:32.612758 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:32.612758 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:46:32.612758 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:46:32.612758 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:46:32.612758 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:46:32.613798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:46:32.613798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:46:32.613798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:46:32.613798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:46:32.613798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:32.613798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:32.613798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:32.613798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:32.613798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:32.613798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:32.613798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:32.613798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:32.613798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:32.613798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:32.613798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:32.613798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:32.614782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:32.614782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:32.614782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:32.614782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:32.614782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:46:32.614782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:46:32.614782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:46:32.614782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:46:32.614782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:46:32.614782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:46:32.614782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:46:32.614782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:46:32.614782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 626/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:46:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:32.619846 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb980e7-b858-431f-8c94-774050ceb389 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:32.637310 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:32.716055 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb980e7-b858-431f-8c94-774050ceb389 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:32.748735 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e97409-943f-4d90-95f6-bc608f1a9db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:32.749327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e97409-943f-4d90-95f6-bc608f1a9db3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:32.749601 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e97409-943f-4d90-95f6-bc608f1a9db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:32.749869 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e97409-943f-4d90-95f6-bc608f1a9db3 None admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:32.750514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e97409-943f-4d90-95f6-bc608f1a9db3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:32.750810 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e97409-943f-4d90-95f6-bc608f1a9db3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:32.752187 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e97409-943f-4d90-95f6-bc608f1a9db3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:32.759905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 638/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:46:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:46:32.765652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb61d57-73c2-41e0-b03e-f5d84ff0d67d None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:32.837379 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:32.875921 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb61d57-73c2-41e0-b03e-f5d84ff0d67d None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:32.909577 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb790b2f-7e42-47c5-9dd2-ce1bdfcb16d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:32.910212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb790b2f-7e42-47c5-9dd2-ce1bdfcb16d9 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:32.910494 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb790b2f-7e42-47c5-9dd2-ce1bdfcb16d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:32.910768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb790b2f-7e42-47c5-9dd2-ce1bdfcb16d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:32.921151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb790b2f-7e42-47c5-9dd2-ce1bdfcb16d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:32.922598 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb790b2f-7e42-47c5-9dd2-ce1bdfcb16d9 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:32.937605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-eb790b2f-7e42-47c5-9dd2-ce1bdfcb16d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:32.937605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:32.937605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:32.937605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:32.937605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:32.937605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:32.937605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:32.937605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:32.937605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:32.937605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:32.937605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:32.937605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:32.937605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:46:32.937605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:46:32.937605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:46:32.937605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:46:32.938695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:32.938695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:32.938695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:32.938695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:32.938695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:32.938695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:32.938695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:32.938695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:32.938695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:32.938695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:32.938695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:32.938695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:32.938695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:32.938695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:32.938695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:32.938695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:32.938695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:46:32.939575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:46:32.939575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:32.939575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:46:32.939575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 627/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:32.944444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e97409-943f-4d90-95f6-bc608f1a9db3 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:33.022435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:33.041866 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e97409-943f-4d90-95f6-bc608f1a9db3 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:33.074603 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aebde-08aa-495b-ad25-47d9b2690f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:33.075200 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aebde-08aa-495b-ad25-47d9b2690f36 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:33.075479 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aebde-08aa-495b-ad25-47d9b2690f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:33.075752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9aebde-08aa-495b-ad25-47d9b2690f36 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:33.076419 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9aebde-08aa-495b-ad25-47d9b2690f36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:33.076721 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9aebde-08aa-495b-ad25-47d9b2690f36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:33.078080 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9aebde-08aa-495b-ad25-47d9b2690f36 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:33.089845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 639/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:33.095389 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb790b2f-7e42-47c5-9dd2-ce1bdfcb16d9 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:33.192881 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb790b2f-7e42-47c5-9dd2-ce1bdfcb16d9 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:33.212476 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:33.226427 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bb4b7-8902-4f7d-8baa-061fa57ee2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:33.227117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bb4b7-8902-4f7d-8baa-061fa57ee2bc None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:33.227457 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bb4b7-8902-4f7d-8baa-061fa57ee2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:33.227728 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bb4b7-8902-4f7d-8baa-061fa57ee2bc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:33.235620 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2bb4b7-8902-4f7d-8baa-061fa57ee2bc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:33.237086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2bb4b7-8902-4f7d-8baa-061fa57ee2bc None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:33.248565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-2f2bb4b7-8902-4f7d-8baa-061fa57ee2bc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 20:46:33.248565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:33.248565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:33.248565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:33.248565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:33.248565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:33.248565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:33.248565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:33.248565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:33.248565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:33.248565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:33.248565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:33.248565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:46:33.248565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:46:33.248565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:46:33.248565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:46:33.249623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:33.249623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:33.249623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:46:33.249623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:46:33.249623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:46:33.249623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:46:33.249623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:33.249623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:33.249623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:33.249623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:33.249623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:33.249623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:33.249623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:33.249623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:33.249623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:33.249623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:33.249623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:33.249623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:33.250576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:33.250576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:33.250576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:46:33.250576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:46:33.250576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:46:33.250576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:46:33.250576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:46:33.250576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:46:33.250576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 20:46:33.250576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:46:33.250576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 628/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:46:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:33.255427 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aebde-08aa-495b-ad25-47d9b2690f36 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:33.353159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9aebde-08aa-495b-ad25-47d9b2690f36 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:33.385371 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3850abc-e97e-4604-bcec-217d2d06b3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:33.385955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3850abc-e97e-4604-bcec-217d2d06b3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:33.386232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3850abc-e97e-4604-bcec-217d2d06b3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:33.386504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3850abc-e97e-4604-bcec-217d2d06b3e1 None admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:33.387216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3850abc-e97e-4604-bcec-217d2d06b3e1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:33.387523 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3850abc-e97e-4604-bcec-217d2d06b3e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:33.388961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3850abc-e97e-4604-bcec-217d2d06b3e1 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:33.397251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:33.406541 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 640/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Sep 9 20:46:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:33.412476 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bb4b7-8902-4f7d-8baa-061fa57ee2bc None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:33.510037 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bb4b7-8902-4f7d-8baa-061fa57ee2bc None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:33.542843 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279cc83-9342-4f80-8b04-799bc3531b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:33.543463 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279cc83-9342-4f80-8b04-799bc3531b4a None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:33.543742 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279cc83-9342-4f80-8b04-799bc3531b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:33.544044 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c279cc83-9342-4f80-8b04-799bc3531b4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:33.554134 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279cc83-9342-4f80-8b04-799bc3531b4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:33.555600 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c279cc83-9342-4f80-8b04-799bc3531b4a None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:33.569234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-c279cc83-9342-4f80-8b04-799bc3531b4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:33.569234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:33.569234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:33.569234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:33.569234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:33.569234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:33.569234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:33.569234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:33.569234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:33.569234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:33.569234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:33.569234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:33.569234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:46:33.569234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:46:33.569234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:46:33.569234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:46:33.570314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:33.570314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:33.570314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:33.570314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:33.570314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:33.570314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:33.570314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:33.570314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:33.570314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:33.570314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:33.570314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:33.570314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:33.570314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:33.570314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:33.570314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:33.570314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:33.570314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:46:33.571764 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:46:33.571764 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:33.571764 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:46:33.571764 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 629/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:33.576450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3850abc-e97e-4604-bcec-217d2d06b3e1 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:33.673059 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3850abc-e97e-4604-bcec-217d2d06b3e1 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:33.705536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257b0e6-49d8-46dc-80a2-b5d268f75699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:33.706126 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257b0e6-49d8-46dc-80a2-b5d268f75699 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:33.706401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257b0e6-49d8-46dc-80a2-b5d268f75699 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:33.706669 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257b0e6-49d8-46dc-80a2-b5d268f75699 None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:33.707296 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257b0e6-49d8-46dc-80a2-b5d268f75699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:33.707596 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257b0e6-49d8-46dc-80a2-b5d268f75699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:33.708967 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257b0e6-49d8-46dc-80a2-b5d268f75699 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:33.720566 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 641/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:33.726132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279cc83-9342-4f80-8b04-799bc3531b4a None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:33.756721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:33.833331 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c279cc83-9342-4f80-8b04-799bc3531b4a None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:33.867146 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b90a7-d9e2-4634-9d46-bd9e77a946d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:33.867803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b90a7-d9e2-4634-9d46-bd9e77a946d7 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:33.868110 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b90a7-d9e2-4634-9d46-bd9e77a946d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:33.868384 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b90a7-d9e2-4634-9d46-bd9e77a946d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:33.874916 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b90a7-d9e2-4634-9d46-bd9e77a946d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:33.876384 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b90a7-d9e2-4634-9d46-bd9e77a946d7 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:33.887439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-4c7b90a7-d9e2-4634-9d46-bd9e77a946d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:46:33.887439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:33.887439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:33.887439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:33.887439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:33.887439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:33.887439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:33.887439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:33.887439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:33.887439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:33.887439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:33.887439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:33.887439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:46:33.887439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:46:33.887439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:46:33.888497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:46:33.888497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:33.888497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:33.888497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:33.888497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:33.888497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:33.888497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:33.888497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:33.888497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:33.888497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:33.888497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:33.888497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:33.888497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:33.888497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:33.888497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:33.888497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:33.888497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:33.889600 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:46:33.889600 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:46:33.889600 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:46:33.889600 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:46:33.889600 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:46:33.889600 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:46:33.889600 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:46:33.889600 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:46:33.889600 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 630/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:46:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:33.894436 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257b0e6-49d8-46dc-80a2-b5d268f75699 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:33.951374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:33.992672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257b0e6-49d8-46dc-80a2-b5d268f75699 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:34.024958 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a6e5e-fbe4-4922-8f8c-8f2b86bee9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:34.025556 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a6e5e-fbe4-4922-8f8c-8f2b86bee9e3 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:34.025835 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a6e5e-fbe4-4922-8f8c-8f2b86bee9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:34.026109 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a6e5e-fbe4-4922-8f8c-8f2b86bee9e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:34.027056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a6e5e-fbe4-4922-8f8c-8f2b86bee9e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:34.027364 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a6e5e-fbe4-4922-8f8c-8f2b86bee9e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:34.028810 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a6e5e-fbe4-4922-8f8c-8f2b86bee9e3 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:34.040885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 642/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:46:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:46:34.046977 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b90a7-d9e2-4634-9d46-bd9e77a946d7 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:34.139747 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:34.151299 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b90a7-d9e2-4634-9d46-bd9e77a946d7 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:34.184733 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9189bf-ab7a-444d-8ddd-b5da8c7e1944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:34.185388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9189bf-ab7a-444d-8ddd-b5da8c7e1944 None admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:34.185670 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9189bf-ab7a-444d-8ddd-b5da8c7e1944 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:34.185948 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9189bf-ab7a-444d-8ddd-b5da8c7e1944 None admin] PATH_INFO: `/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/0fc28d9a1b3f4feca0deeb5f266f8b37/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:34.187825 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9189bf-ab7a-444d-8ddd-b5da8c7e1944 None admin] RBAC: Authorizing `identity:create_grant(project_id=a57df41195d240fe8f28ac49bfd37921, user_id=0fc28d9a1b3f4feca0deeb5f266f8b37, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:34.189314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9189bf-ab7a-444d-8ddd-b5da8c7e1944 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:34.202340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 631/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Sep 9 20:46:34 2022] PUT /identity/v3/projects/a57df41195d240fe8f28ac49bfd37921/users/0fc28d9a1b3f4feca0deeb5f266f8b37/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:46:36.315780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0df317-12f0-4320-be14-358643593019 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:36.316273 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0df317-12f0-4320-be14-358643593019 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:36.316373 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0df317-12f0-4320-be14-358643593019 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:36.317735 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 643/1274] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:46:36.323565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44b5cb-fc54-446e-bb3f-7215489e0b7d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:36.323983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44b5cb-fc54-446e-bb3f-7215489e0b7d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:36.324147 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44b5cb-fc54-446e-bb3f-7215489e0b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:36.341949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8c44b5cb-fc54-446e-bb3f-7215489e0b7d None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:46:36.343127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8c44b5cb-fc54-446e-bb3f-7215489e0b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:46:36.407390 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 632/1275] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:46:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:46:36.672273 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0df317-12f0-4320-be14-358643593019 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:36.770220 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0df317-12f0-4320-be14-358643593019 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:36.787617 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:36.808715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90580b-4775-4604-b512-d760fabb65c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:36.809346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90580b-4775-4604-b512-d760fabb65c5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:36.809623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90580b-4775-4604-b512-d760fabb65c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:36.809890 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90580b-4775-4604-b512-d760fabb65c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:36.821645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e90580b-4775-4604-b512-d760fabb65c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 09 20:46:36.826749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-3e90580b-4775-4604-b512-d760fabb65c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:46:36.826749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:36.826749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:36.826749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:36.826749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:36.826749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:36.826749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:36.826749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:36.826749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:36.826749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:36.826749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:36.826749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:36.826749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 09 20:46:36.826749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 09 20:46:36.826749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 09 20:46:36.826749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 09 20:46:36.828475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 09 20:46:36.828475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 09 20:46:36.828475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 09 20:46:36.828475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 09 20:46:36.828475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:36.828475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:36.828475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:36.828475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:36.828475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:36.828475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:36.828475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:36.828475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:36.828475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:36.828475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:36.828475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:36.828475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:36.829327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:36.829327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:36.829327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:36.829327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:36.829327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 09 20:46:36.829327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 09 20:46:36.829327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 09 20:46:36.829327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 09 20:46:36.829327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 09 20:46:36.829327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 09 20:46:36.829327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 09 20:46:36.829327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:36.829327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 644/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Sep 9 20:46:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:36.834140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44b5cb-fc54-446e-bb3f-7215489e0b7d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:36.916602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:36.934864 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44b5cb-fc54-446e-bb3f-7215489e0b7d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:36.968499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb669b80-d433-4852-bc36-dfd61bb84f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:36.969101 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb669b80-d433-4852-bc36-dfd61bb84f19 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:36.969379 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb669b80-d433-4852-bc36-dfd61bb84f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:36.969650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb669b80-d433-4852-bc36-dfd61bb84f19 None admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:36.970302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb669b80-d433-4852-bc36-dfd61bb84f19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:36.970605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb669b80-d433-4852-bc36-dfd61bb84f19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:36.971982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb669b80-d433-4852-bc36-dfd61bb84f19 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:36.980648 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 633/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Sep 9 20:46:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:36.986653 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90580b-4775-4604-b512-d760fabb65c5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:37.082686 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90580b-4775-4604-b512-d760fabb65c5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:37.115796 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9cefd-def8-4c98-b684-b8d9d6b78160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:37.116433 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9cefd-def8-4c98-b684-b8d9d6b78160 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:37.116709 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9cefd-def8-4c98-b684-b8d9d6b78160 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:37.116979 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9cefd-def8-4c98-b684-b8d9d6b78160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:37.127120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9cefd-def8-4c98-b684-b8d9d6b78160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:37.128582 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9cefd-def8-4c98-b684-b8d9d6b78160 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:37.143015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-49c9cefd-def8-4c98-b684-b8d9d6b78160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:37.143015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:37.143015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:37.143015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:37.143015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:37.143015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:37.143015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:37.143015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:37.143015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:37.143015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:37.143015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:37.143015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:37.143015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:46:37.143015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:46:37.143015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:46:37.143015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:46:37.144189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:37.144189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:37.144189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:37.144189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:37.144189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:37.144189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:37.144189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:37.144189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:37.144189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:37.144189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:37.144189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:37.144189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:37.144189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:37.144189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:37.144189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:37.144189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:37.144189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:46:37.145092 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:46:37.145092 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:37.145092 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:37.145092 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 645/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:37.150426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb669b80-d433-4852-bc36-dfd61bb84f19 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:37.248549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb669b80-d433-4852-bc36-dfd61bb84f19 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:37.281838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bcd67-204d-4699-9b80-568c61809902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:37.282435 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bcd67-204d-4699-9b80-568c61809902 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:37.282715 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bcd67-204d-4699-9b80-568c61809902 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:37.282989 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bcd67-204d-4699-9b80-568c61809902 None admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:37.283623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bcd67-204d-4699-9b80-568c61809902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:37.283925 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bcd67-204d-4699-9b80-568c61809902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:37.285332 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bcd67-204d-4699-9b80-568c61809902 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:37.299077 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 634/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:37.305454 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9cefd-def8-4c98-b684-b8d9d6b78160 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:37.335437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:37.404726 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9cefd-def8-4c98-b684-b8d9d6b78160 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:37.436561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7553b0e-7e6b-455a-a6ed-a6602391475f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:37.437171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7553b0e-7e6b-455a-a6ed-a6602391475f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:37.437446 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7553b0e-7e6b-455a-a6ed-a6602391475f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:37.437713 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7553b0e-7e6b-455a-a6ed-a6602391475f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:37.444785 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7553b0e-7e6b-455a-a6ed-a6602391475f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:37.446786 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7553b0e-7e6b-455a-a6ed-a6602391475f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:37.457450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-c7553b0e-7e6b-455a-a6ed-a6602391475f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 09 20:46:37.457450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:37.457450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:37.457450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:37.457450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:37.457450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:37.457450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:37.457450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:37.457450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:37.457450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:37.457450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:37.457450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:37.457450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 09 20:46:37.457450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 09 20:46:37.457450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 09 20:46:37.457450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 09 20:46:37.462682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:37.462682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:37.462682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 09 20:46:37.462682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:46:37.462682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 09 20:46:37.462682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 09 20:46:37.462682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:37.462682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:37.462682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:37.462682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:37.462682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:37.462682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:37.462682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:37.462682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:37.462682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:37.462682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:37.462682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:37.462682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:37.463895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:37.463895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:37.463895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 09 20:46:37.463895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 09 20:46:37.463895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 09 20:46:37.463895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 09 20:46:37.463895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 09 20:46:37.463895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 09 20:46:37.463895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 09 20:46:37.463895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:37.463895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 646/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:46:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:37.464952 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bcd67-204d-4699-9b80-568c61809902 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:37.468743 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:37.561892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bcd67-204d-4699-9b80-568c61809902 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:37.594737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e7e76-ca87-49e4-8953-883d49b5e588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:37.595332 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e7e76-ca87-49e4-8953-883d49b5e588 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:37.595607 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e7e76-ca87-49e4-8953-883d49b5e588 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:37.595874 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2e7e76-ca87-49e4-8953-883d49b5e588 None admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:37.596607 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e7e76-ca87-49e4-8953-883d49b5e588 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:37.596902 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e7e76-ca87-49e4-8953-883d49b5e588 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:37.598326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2e7e76-ca87-49e4-8953-883d49b5e588 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:37.614757 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 635/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Sep 9 20:46:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:37.621217 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7553b0e-7e6b-455a-a6ed-a6602391475f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:37.708147 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:37.718361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7553b0e-7e6b-455a-a6ed-a6602391475f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:37.750580 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45602ca2-8e7d-4bb5-80be-c928abc3417d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:37.751249 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45602ca2-8e7d-4bb5-80be-c928abc3417d None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:37.751523 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45602ca2-8e7d-4bb5-80be-c928abc3417d None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:37.751789 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45602ca2-8e7d-4bb5-80be-c928abc3417d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:37.820566 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45602ca2-8e7d-4bb5-80be-c928abc3417d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:37.822193 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45602ca2-8e7d-4bb5-80be-c928abc3417d None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:37.907377 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:37.918208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 647/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Sep 9 20:46:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 09 20:46:37.924198 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e7e76-ca87-49e4-8953-883d49b5e588 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:37.984752 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:38.022812 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2e7e76-ca87-49e4-8953-883d49b5e588 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:38.056785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada274cc-f4ec-4f25-a96c-81be02548aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:38.057410 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada274cc-f4ec-4f25-a96c-81be02548aec None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:38.057688 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada274cc-f4ec-4f25-a96c-81be02548aec None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:38.057959 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada274cc-f4ec-4f25-a96c-81be02548aec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:38.067675 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada274cc-f4ec-4f25-a96c-81be02548aec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:38.069154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada274cc-f4ec-4f25-a96c-81be02548aec None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:38.083971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-ada274cc-f4ec-4f25-a96c-81be02548aec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:38.083971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:38.083971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:38.083971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:38.083971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:38.083971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:38.083971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:38.083971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:38.083971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:38.083971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:38.083971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:38.083971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:38.083971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 09 20:46:38.083971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 09 20:46:38.083971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 09 20:46:38.083971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 09 20:46:38.085114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:38.085114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:38.085114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:38.085114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:38.085114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:38.085114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:38.085114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:38.085114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:38.085114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:38.085114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:38.085114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:38.085114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:38.085114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:38.085114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:38.085114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:38.085114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:38.085114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 09 20:46:38.086613 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 09 20:46:38.086613 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 09 20:46:38.086613 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:46:38.086613 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 636/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:46:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:38.091657 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45602ca2-8e7d-4bb5-80be-c928abc3417d None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:38.188155 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45602ca2-8e7d-4bb5-80be-c928abc3417d None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:38.220308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e79a65-9eca-4b8c-a1e5-4baad80c261f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:38.220918 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e79a65-9eca-4b8c-a1e5-4baad80c261f None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:38.221199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e79a65-9eca-4b8c-a1e5-4baad80c261f None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:38.221475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e79a65-9eca-4b8c-a1e5-4baad80c261f None admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:38.222112 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e79a65-9eca-4b8c-a1e5-4baad80c261f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:38.222415 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e79a65-9eca-4b8c-a1e5-4baad80c261f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:38.223782 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e79a65-9eca-4b8c-a1e5-4baad80c261f None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:38.235284 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 648/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Sep 9 20:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:38.240847 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada274cc-f4ec-4f25-a96c-81be02548aec None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:38.340676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada274cc-f4ec-4f25-a96c-81be02548aec None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:38.354355 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:38.374786 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0327a80-17d0-43b9-8900-ec7698ad5651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:38.375409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0327a80-17d0-43b9-8900-ec7698ad5651 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:38.375688 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0327a80-17d0-43b9-8900-ec7698ad5651 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:38.375957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0327a80-17d0-43b9-8900-ec7698ad5651 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:38.382396 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0327a80-17d0-43b9-8900-ec7698ad5651 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:38.384899 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0327a80-17d0-43b9-8900-ec7698ad5651 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:38.396663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application [None req-b0327a80-17d0-43b9-8900-ec7698ad5651 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:46:38.396663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:38.396663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:38.396663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:38.396663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:38.396663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:38.396663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:38.396663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:38.396663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:38.396663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:38.396663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:38.396663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:38.396663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 09 20:46:38.396663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 09 20:46:38.396663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 09 20:46:38.397659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 09 20:46:38.397659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:38.397659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:38.397659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:38.397659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:38.397659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:38.397659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:38.397659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:38.397659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:38.397659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:38.397659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:38.397659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:38.397659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:38.397659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:38.397659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:38.397659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:38.397659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:38.398724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 09 20:46:38.398724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 09 20:46:38.398724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 09 20:46:38.398724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 09 20:46:38.398724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 09 20:46:38.398724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 09 20:46:38.398724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 09 20:46:38.398724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: ERROR keystone.server.flask.application Sep 09 20:46:38.398724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 637/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Sep 9 20:46:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:38.404012 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e79a65-9eca-4b8c-a1e5-4baad80c261f None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:38.453135 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:38.502907 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e79a65-9eca-4b8c-a1e5-4baad80c261f None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:38.535303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea3d43-01a6-4b7f-8cb0-3ae8508c7094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:38.535900 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea3d43-01a6-4b7f-8cb0-3ae8508c7094 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:38.536204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea3d43-01a6-4b7f-8cb0-3ae8508c7094 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:38.536478 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea3d43-01a6-4b7f-8cb0-3ae8508c7094 None admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:38.537156 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea3d43-01a6-4b7f-8cb0-3ae8508c7094 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:38.537461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea3d43-01a6-4b7f-8cb0-3ae8508c7094 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:38.538876 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea3d43-01a6-4b7f-8cb0-3ae8508c7094 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:38.550321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 649/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Sep 9 20:46:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:38.556978 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0327a80-17d0-43b9-8900-ec7698ad5651 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:38.655744 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0327a80-17d0-43b9-8900-ec7698ad5651 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:38.688816 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fdf7b-6d0a-4883-9f2e-af998dd05a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:38.689411 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fdf7b-6d0a-4883-9f2e-af998dd05a64 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:38.689694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fdf7b-6d0a-4883-9f2e-af998dd05a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:38.689968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fdf7b-6d0a-4883-9f2e-af998dd05a64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:38.690679 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fdf7b-6d0a-4883-9f2e-af998dd05a64 None admin] RBAC: Adding query filter params (role.id=be620fc7968740269d233c5ace94a563, scope.project.id=a57df41195d240fe8f28ac49bfd37921, user.id=0fc28d9a1b3f4feca0deeb5f266f8b37) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:38.690988 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fdf7b-6d0a-4883-9f2e-af998dd05a64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:38.692595 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38fdf7b-6d0a-4883-9f2e-af998dd05a64 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:38.698868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 638/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Sep 9 20:46:38 2022] GET /identity/v3/role_assignments?user.id=0fc28d9a1b3f4feca0deeb5f266f8b37&scope.project.id=a57df41195d240fe8f28ac49bfd37921&role.id=be620fc7968740269d233c5ace94a563 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:40.905693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27462111-b21f-4eb7-aa79-24edf1f07dd7 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:40.906247 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27462111-b21f-4eb7-aa79-24edf1f07dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:40.906247 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27462111-b21f-4eb7-aa79-24edf1f07dd7 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:40.907883 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 650/1288] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:46:40.913395 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bfd88-e704-4419-b45e-ebebe455cc8e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:40.913806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bfd88-e704-4419-b45e-ebebe455cc8e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:40.914545 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bfd88-e704-4419-b45e-ebebe455cc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:40.932704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5e9bfd88-e704-4419-b45e-ebebe455cc8e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:46:40.933891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5e9bfd88-e704-4419-b45e-ebebe455cc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:46:40.963221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:40.999652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 639/1289] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:46:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 09 20:46:41.266753 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27462111-b21f-4eb7-aa79-24edf1f07dd7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:41.365662 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27462111-b21f-4eb7-aa79-24edf1f07dd7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:41.376394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:41.399550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7b47c-6398-4e98-b164-842c860b2646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:41.400194 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7b47c-6398-4e98-b164-842c860b2646 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:41.400472 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7b47c-6398-4e98-b164-842c860b2646 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:41.400745 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7b47c-6398-4e98-b164-842c860b2646 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:41.401326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7b47c-6398-4e98-b164-842c860b2646 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:41.402941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7b47c-6398-4e98-b164-842c860b2646 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:41.411347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-58c7b47c-6398-4e98-b164-842c860b2646 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 20:46:41.411347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:41.411347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:46:41.411347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:46:41.411347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:46:41.411347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:46:41.411347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:46:41.411347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:46:41.411347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 20:46:41.411347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:41.411347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:46:41.411347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:41.411347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:41.411347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:41.411347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:41.411347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:41.411347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:41.412558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:41.412558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:41.412558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:41.412558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:41.412558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:41.412558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:41.412558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:46:41.412558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:46:41.412558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:46:41.412558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:46:41.412558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:41.412558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:41.412558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:41.412558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:41.412558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:41.412558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:41.413658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:41.413658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:41.413658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:41.413658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:41.413658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:41.413658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:41.413658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:41.413658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:41.413658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:41.413658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:41.413658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:46:41.413658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:46:41.413658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 20:46:41.413658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:41.413658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 651/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Sep 9 20:46:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:41.418476 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bfd88-e704-4419-b45e-ebebe455cc8e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:41.515118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bfd88-e704-4419-b45e-ebebe455cc8e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:41.548267 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d1dc4-0190-48e0-944b-017d9f8be2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:41.548805 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d1dc4-0190-48e0-944b-017d9f8be2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:41.549079 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d1dc4-0190-48e0-944b-017d9f8be2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:41.549345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d1dc4-0190-48e0-944b-017d9f8be2b2 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:41.549955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d1dc4-0190-48e0-944b-017d9f8be2b2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:41.550250 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d1dc4-0190-48e0-944b-017d9f8be2b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:41.551606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d1dc4-0190-48e0-944b-017d9f8be2b2 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:41.556750 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 640/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Fri Sep 9 20:46:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:41.562354 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7b47c-6398-4e98-b164-842c860b2646 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:41.657489 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7b47c-6398-4e98-b164-842c860b2646 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:41.689314 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8160b44-bc1b-4691-ba34-c54a2af249cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:41.689932 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8160b44-bc1b-4691-ba34-c54a2af249cb None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:41.690206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8160b44-bc1b-4691-ba34-c54a2af249cb None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:41.690472 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8160b44-bc1b-4691-ba34-c54a2af249cb None admin] PATH_INFO: `/v3/services` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:41.691082 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8160b44-bc1b-4691-ba34-c54a2af249cb None admin] RBAC: Adding query filter params (type=placement) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:41.691377 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8160b44-bc1b-4691-ba34-c54a2af249cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:41.692742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8160b44-bc1b-4691-ba34-c54a2af249cb None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:41.697453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 652/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Fri Sep 9 20:46:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:43.826979 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91df09-4299-4345-8098-f542abfb35cc None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:43.827511 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91df09-4299-4345-8098-f542abfb35cc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:43.827511 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91df09-4299-4345-8098-f542abfb35cc None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:43.828888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 641/1293] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:46:43.833918 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba4e29-bd5d-4f51-81c0-3070f0b99f54 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:43.834345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba4e29-bd5d-4f51-81c0-3070f0b99f54 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:43.834444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba4e29-bd5d-4f51-81c0-3070f0b99f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:43.853341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-deba4e29-bd5d-4f51-81c0-3070f0b99f54 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:46:43.854513 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-deba4e29-bd5d-4f51-81c0-3070f0b99f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:46:43.882306 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:43.919358 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 653/1294] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:46:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:46:44.184753 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91df09-4299-4345-8098-f542abfb35cc None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:44.215009 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:44.283981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91df09-4299-4345-8098-f542abfb35cc None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:44.318695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abbdd67-d935-4e9a-b659-25d6209ae6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:44.319301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbdd67-d935-4e9a-b659-25d6209ae6fb None admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:44.319582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbdd67-d935-4e9a-b659-25d6209ae6fb None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:44.319857 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abbdd67-d935-4e9a-b659-25d6209ae6fb None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:44.320615 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbdd67-d935-4e9a-b659-25d6209ae6fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:44.321979 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abbdd67-d935-4e9a-b659-25d6209ae6fb None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:44.337490 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 642/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Sep 9 20:46:44 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:46:46.488782 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc92711-6dd8-42c2-a7b8-6995c8ecbb6c None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:46.489323 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc92711-6dd8-42c2-a7b8-6995c8ecbb6c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:46.489323 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc92711-6dd8-42c2-a7b8-6995c8ecbb6c None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:46.490656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 654/1296] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:46:46.496029 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153b455-dc16-4481-b9b0-97e80017f917 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:46.496440 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153b455-dc16-4481-b9b0-97e80017f917 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:46.496587 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153b455-dc16-4481-b9b0-97e80017f917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:46.515135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a153b455-dc16-4481-b9b0-97e80017f917 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:46:46.516469 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a153b455-dc16-4481-b9b0-97e80017f917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:46:46.588278 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 643/1297] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:46:46 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:46:46.854333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc92711-6dd8-42c2-a7b8-6995c8ecbb6c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:46.951260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc92711-6dd8-42c2-a7b8-6995c8ecbb6c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:46.983631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c5454-c647-4553-8208-426ea1d73e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:46.984264 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c5454-c647-4553-8208-426ea1d73e1b None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:46.984538 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c5454-c647-4553-8208-426ea1d73e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:46.984807 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c5454-c647-4553-8208-426ea1d73e1b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:46.985380 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c5454-c647-4553-8208-426ea1d73e1b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:46.986726 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c5454-c647-4553-8208-426ea1d73e1b None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:46.995758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-468c5454-c647-4553-8208-426ea1d73e1b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 20:46:46.995758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:46.995758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:46:46.995758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:46:46.995758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:46:46.995758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:46:46.995758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:46:46.995758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:46:46.995758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 20:46:46.995758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:46.995758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:46:46.995758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:46.995758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:46.995758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:46.995758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:46.995758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:46.995758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:46.997091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:46.997091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:46.997091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:46.997091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:46.997091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:46.997091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:46.997091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:46:46.997091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:46:46.997091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:46:46.997091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:46:46.997091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:46.997091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:46.997091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:46.997091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:46.997091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:46.997091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:46.998241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:46.998241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:46.998241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:46.998241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:46.998241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:46.998241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:46.998241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:46.998241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:46.998241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:46.998241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:46.998241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:46:46.998241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:46:46.998241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 20:46:46.998241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:46.998241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 655/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Sep 9 20:46:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:47.002648 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153b455-dc16-4481-b9b0-97e80017f917 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:47.020793 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:47.100109 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153b455-dc16-4481-b9b0-97e80017f917 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:47.134398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee8562-a16b-45dd-9f62-599c3147b802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:47.134936 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee8562-a16b-45dd-9f62-599c3147b802 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:47.135214 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee8562-a16b-45dd-9f62-599c3147b802 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:47.135485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee8562-a16b-45dd-9f62-599c3147b802 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:47.136129 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee8562-a16b-45dd-9f62-599c3147b802 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:47.136430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee8562-a16b-45dd-9f62-599c3147b802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:47.137799 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee8562-a16b-45dd-9f62-599c3147b802 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:47.142750 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 644/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Fri Sep 9 20:46:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:47.149090 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c5454-c647-4553-8208-426ea1d73e1b None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:47.180885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:47.246204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c5454-c647-4553-8208-426ea1d73e1b None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:47.278302 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35b418-5038-42b9-ba1f-f419811da838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:47.278896 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35b418-5038-42b9-ba1f-f419811da838 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:47.279177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35b418-5038-42b9-ba1f-f419811da838 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:47.279446 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35b418-5038-42b9-ba1f-f419811da838 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:47.280164 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35b418-5038-42b9-ba1f-f419811da838 None admin] RBAC: Adding query filter params (interface=public, service_id=c56222bca6474c9ba89e0ae21d1f2902, region_id=RegionOne) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:47.280469 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35b418-5038-42b9-ba1f-f419811da838 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:47.281816 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35b418-5038-42b9-ba1f-f419811da838 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:47.286770 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 656/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Sep 9 20:46:47 2022] GET /identity/v3/endpoints?service_id=c56222bca6474c9ba89e0ae21d1f2902&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:47.292968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee8562-a16b-45dd-9f62-599c3147b802 None admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:47.373810 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:47.392117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee8562-a16b-45dd-9f62-599c3147b802 None admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:47.424935 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b88af-e210-49d0-96f8-d332803be8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:47.425535 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b88af-e210-49d0-96f8-d332803be8fe None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:47.425817 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b88af-e210-49d0-96f8-d332803be8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:47.426091 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b88af-e210-49d0-96f8-d332803be8fe None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:47.426683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b88af-e210-49d0-96f8-d332803be8fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:47.428104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b88af-e210-49d0-96f8-d332803be8fe None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:47.440489 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 645/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Sep 9 20:46:47 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:46:49.560321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3fa15-722d-444b-9372-e70b87802caf None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:49.560835 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3fa15-722d-444b-9372-e70b87802caf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:49.560835 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3fa15-722d-444b-9372-e70b87802caf None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:49.562120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 657/1302] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:46:49.567137 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08972dfa-2484-4640-9553-54713d316db5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:49.567499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08972dfa-2484-4640-9553-54713d316db5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:49.567677 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08972dfa-2484-4640-9553-54713d316db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:49.585997 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-08972dfa-2484-4640-9553-54713d316db5 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:46:49.587157 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-08972dfa-2484-4640-9553-54713d316db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:46:49.652530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 646/1303] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:46:49 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 09 20:46:49.919371 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3fa15-722d-444b-9372-e70b87802caf None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:50.011579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:50.018712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b3fa15-722d-444b-9372-e70b87802caf None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:50.051570 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536a7fb-0ff9-4866-baae-ea9ef96222b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:50.052205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a7fb-0ff9-4866-baae-ea9ef96222b5 None admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:50.052481 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a7fb-0ff9-4866-baae-ea9ef96222b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:50.052748 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a7fb-0ff9-4866-baae-ea9ef96222b5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:50.053318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536a7fb-0ff9-4866-baae-ea9ef96222b5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:50.055409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536a7fb-0ff9-4866-baae-ea9ef96222b5 None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:50.063687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application [None req-1536a7fb-0ff9-4866-baae-ea9ef96222b5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 20:46:50.063687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:50.063687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 09 20:46:50.063687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 09 20:46:50.063687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 09 20:46:50.063687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 09 20:46:50.063687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 09 20:46:50.063687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:46:50.063687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 20:46:50.063687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:50.063687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 09 20:46:50.063687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:50.063687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 09 20:46:50.063687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 09 20:46:50.063687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 09 20:46:50.063687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 09 20:46:50.063687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 09 20:46:50.064881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 09 20:46:50.064881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 09 20:46:50.064881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 09 20:46:50.064881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 09 20:46:50.064881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 09 20:46:50.064881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 09 20:46:50.064881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 09 20:46:50.064881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 09 20:46:50.064881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 09 20:46:50.064881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 09 20:46:50.064881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 09 20:46:50.064881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 09 20:46:50.064881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 09 20:46:50.064881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 09 20:46:50.064881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 09 20:46:50.064881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.get_or_create( Sep 09 20:46:50.065891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 09 20:46:50.065891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application with Lock( Sep 09 20:46:50.065891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 09 20:46:50.065891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self._enter() Sep 09 20:46:50.065891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 09 20:46:50.065891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 09 20:46:50.065891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 09 20:46:50.065891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application return self.creator() Sep 09 20:46:50.065891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 09 20:46:50.065891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application created_value = creator( Sep 09 20:46:50.065891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 09 20:46:50.065891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 09 20:46:50.065891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 09 20:46:50.065891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: ERROR keystone.server.flask.application Sep 09 20:46:50.065891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 658/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Sep 9 20:46:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 09 20:46:50.070923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08972dfa-2484-4640-9553-54713d316db5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:50.144166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:46:50.167124 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08972dfa-2484-4640-9553-54713d316db5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:50.200341 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac78f3-6c23-41a3-aa9e-434ed1df6907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:50.200886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac78f3-6c23-41a3-aa9e-434ed1df6907 None admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:50.201162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac78f3-6c23-41a3-aa9e-434ed1df6907 None admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:50.201433 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac78f3-6c23-41a3-aa9e-434ed1df6907 None admin] PATH_INFO: `/v3/services` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:50.202046 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac78f3-6c23-41a3-aa9e-434ed1df6907 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:46:50.202346 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac78f3-6c23-41a3-aa9e-434ed1df6907 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:50.203707 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac78f3-6c23-41a3-aa9e-434ed1df6907 None admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:50.208665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 647/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Fri Sep 9 20:46:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:46:50.214449 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536a7fb-0ff9-4866-baae-ea9ef96222b5 None admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:46:50.312760 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536a7fb-0ff9-4866-baae-ea9ef96222b5 None admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:46:50.345134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab21dc8-3dfd-485c-8713-f49dd318164a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:46:50.345727 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab21dc8-3dfd-485c-8713-f49dd318164a None admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:46:50.346004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab21dc8-3dfd-485c-8713-f49dd318164a None admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:46:50.346276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab21dc8-3dfd-485c-8713-f49dd318164a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:46:50.346940 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab21dc8-3dfd-485c-8713-f49dd318164a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:46:50.348323 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab21dc8-3dfd-485c-8713-f49dd318164a None admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:46:50.367464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 659/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:46:50 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:47:00.206191 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=30 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:47:00.363267 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:47:54.254761 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae1059-a436-42bf-a54f-dd9143438ba2 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:47:54.255253 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae1059-a436-42bf-a54f-dd9143438ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:47:54.255474 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae1059-a436-42bf-a54f-dd9143438ba2 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:47:54.260823 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 648/1307] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:47:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:47:54.263325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3c4fe-257e-469c-ba70-de5859645858 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:47:54.263778 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3c4fe-257e-469c-ba70-de5859645858 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:47:54.263871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3c4fe-257e-469c-ba70-de5859645858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:47:54.370684 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-53d3c4fe-257e-469c-ba70-de5859645858 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:47:54.372030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-53d3c4fe-257e-469c-ba70-de5859645858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:47:54.516597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 660/1308] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:47:54.815367 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9aa40-151e-4715-8763-1074381ae662 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:47:54.815749 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9aa40-151e-4715-8763-1074381ae662 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:47:54.815924 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac9aa40-151e-4715-8763-1074381ae662 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:47:54.817583 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 649/1309] 10.222.0.15 () {54 vars in 965 bytes} [Fri Sep 9 20:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:47:54.824015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926a1f9-312e-48c2-b9a9-190947107d82 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:47:54.824598 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926a1f9-312e-48c2-b9a9-190947107d82 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:47:54.825098 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926a1f9-312e-48c2-b9a9-190947107d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:47:54.924183 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4926a1f9-312e-48c2-b9a9-190947107d82 None None] MFA Rules not processed for user `27e2be33ebdc4c5a97befcbd4d09ee4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:47:54.925780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4926a1f9-312e-48c2-b9a9-190947107d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:47:54.953180 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:47:55.034316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 661/1310] 10.222.0.15 () {58 vars in 1062 bytes} [Fri Sep 9 20:47:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:47:55.043963 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9aa40-151e-4715-8763-1074381ae662 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:47:55.045961 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-aac9aa40-151e-4715-8763-1074381ae662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:47:55.180759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac9aa40-151e-4715-8763-1074381ae662 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:47:55.266665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1160a-8957-4fb1-bcf5-7ba6cf3caf97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:47:55.267294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1160a-8957-4fb1-bcf5-7ba6cf3caf97 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:47:55.267570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1160a-8957-4fb1-bcf5-7ba6cf3caf97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:47:55.267819 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1160a-8957-4fb1-bcf5-7ba6cf3caf97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:47:55.269571 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d5b1160a-8957-4fb1-bcf5-7ba6cf3caf97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:47:55.338854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:47:55.418746 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1160a-8957-4fb1-bcf5-7ba6cf3caf97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:47:55.420650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1160a-8957-4fb1-bcf5-7ba6cf3caf97 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:47:55.442637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 650/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:47:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:47:57.992333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ae70f-2fe3-4079-8917-a5f02bf4cf39 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:47:57.992863 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ae70f-2fe3-4079-8917-a5f02bf4cf39 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:47:57.992863 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ae70f-2fe3-4079-8917-a5f02bf4cf39 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:47:57.994230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 662/1312] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:47:57.999337 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce2628-5570-4473-8afb-ba3aac93e834 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:47:57.999755 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce2628-5570-4473-8afb-ba3aac93e834 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:47:57.999897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce2628-5570-4473-8afb-ba3aac93e834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:47:58.071047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2cce2628-5570-4473-8afb-ba3aac93e834 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:47:58.072301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2cce2628-5570-4473-8afb-ba3aac93e834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:47:58.168605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 651/1313] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:47:58.454441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ae70f-2fe3-4079-8917-a5f02bf4cf39 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:47:58.455973 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ab9ae70f-2fe3-4079-8917-a5f02bf4cf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:47:58.558108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ae70f-2fe3-4079-8917-a5f02bf4cf39 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:47:58.627803 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:47:58.629820 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590beb8d-940e-417a-b17f-ce224343471d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:47:58.631198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590beb8d-940e-417a-b17f-ce224343471d service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:47:58.631690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590beb8d-940e-417a-b17f-ce224343471d service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:47:58.632192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590beb8d-940e-417a-b17f-ce224343471d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:47:58.633979 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-590beb8d-940e-417a-b17f-ce224343471d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:47:58.740576 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590beb8d-940e-417a-b17f-ce224343471d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:47:58.741945 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590beb8d-940e-417a-b17f-ce224343471d service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:47:58.760884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 663/1314] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:47:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:48:01.227142 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b59592-0129-4448-9fb7-d91d4bcd218a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:01.227681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b59592-0129-4448-9fb7-d91d4bcd218a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:01.227681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b59592-0129-4448-9fb7-d91d4bcd218a None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:01.229065 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 652/1315] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:48:01.234214 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a698f-d515-43ee-9e9f-3c5ce7cb237b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:01.234626 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a698f-d515-43ee-9e9f-3c5ce7cb237b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:01.234762 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a698f-d515-43ee-9e9f-3c5ce7cb237b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:01.301263 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f54a698f-d515-43ee-9e9f-3c5ce7cb237b None None] MFA Rules not processed for user `2230c53133ec4c828215f6a48adbb673`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:48:01.302667 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f54a698f-d515-43ee-9e9f-3c5ce7cb237b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:01.353809 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:01.398425 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 664/1316] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:48:01 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:48:01.684116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b59592-0129-4448-9fb7-d91d4bcd218a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:48:01.685707 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a8b59592-0129-4448-9fb7-d91d4bcd218a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:01.696246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:01.789962 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b59592-0129-4448-9fb7-d91d4bcd218a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:48:01.862926 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ed6d7-4476-4f13-a4ad-8ecc4cfb8916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:48:01.863527 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ed6d7-4476-4f13-a4ad-8ecc4cfb8916 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:01.863800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ed6d7-4476-4f13-a4ad-8ecc4cfb8916 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:01.864100 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ed6d7-4476-4f13-a4ad-8ecc4cfb8916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:01.865747 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-821ed6d7-4476-4f13-a4ad-8ecc4cfb8916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:01.928673 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:01.975457 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ed6d7-4476-4f13-a4ad-8ecc4cfb8916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:48:01.976938 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ed6d7-4476-4f13-a4ad-8ecc4cfb8916 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:48:01.995075 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 653/1317] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:48:01 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:48:04.665437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928bd1a-7bdc-4497-868b-56af11ee6377 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:04.665953 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928bd1a-7bdc-4497-868b-56af11ee6377 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:04.666071 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928bd1a-7bdc-4497-868b-56af11ee6377 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:04.667312 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 665/1318] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:48:04.672542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e3a04-ff85-4b1b-81b5-bc335476830f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:04.672941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e3a04-ff85-4b1b-81b5-bc335476830f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:04.673086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e3a04-ff85-4b1b-81b5-bc335476830f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:04.737556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-405e3a04-ff85-4b1b-81b5-bc335476830f None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:48:04.738747 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-405e3a04-ff85-4b1b-81b5-bc335476830f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:04.836273 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 654/1319] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:48:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:48:05.130076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928bd1a-7bdc-4497-868b-56af11ee6377 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:48:05.131629 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f928bd1a-7bdc-4497-868b-56af11ee6377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:05.233658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928bd1a-7bdc-4497-868b-56af11ee6377 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:48:05.307316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf087a02-7ce2-41a0-9058-b886cecf0d7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:48:05.308128 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf087a02-7ce2-41a0-9058-b886cecf0d7a service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:05.308220 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf087a02-7ce2-41a0-9058-b886cecf0d7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:05.308476 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf087a02-7ce2-41a0-9058-b886cecf0d7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:05.310080 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cf087a02-7ce2-41a0-9058-b886cecf0d7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:05.316989 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:05.418230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf087a02-7ce2-41a0-9058-b886cecf0d7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:48:05.419656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf087a02-7ce2-41a0-9058-b886cecf0d7a service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:48:05.437948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 666/1320] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:48:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:48:08.294008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dab3d9-1882-4016-b5dd-4fe3e43d7e00 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:08.294598 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dab3d9-1882-4016-b5dd-4fe3e43d7e00 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:08.294598 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dab3d9-1882-4016-b5dd-4fe3e43d7e00 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:08.297454 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 655/1321] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:48:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:48:08.301738 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933d170-31ba-4927-9d97-d526c2cd2e3d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:08.302902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933d170-31ba-4927-9d97-d526c2cd2e3d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:08.303017 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933d170-31ba-4927-9d97-d526c2cd2e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:08.376336 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3933d170-31ba-4927-9d97-d526c2cd2e3d None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:48:08.377587 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3933d170-31ba-4927-9d97-d526c2cd2e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:08.441086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:08.482922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 667/1322] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:48:08.778212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82698813-d2f0-4cfd-bf12-f8b2efe94f86 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:08.778604 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82698813-d2f0-4cfd-bf12-f8b2efe94f86 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:08.778965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82698813-d2f0-4cfd-bf12-f8b2efe94f86 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:08.780410 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 656/1323] 10.222.0.15 () {54 vars in 965 bytes} [Fri Sep 9 20:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:48:08.786639 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866933a-f873-4306-a81c-194d0f059b0d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:08.786928 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866933a-f873-4306-a81c-194d0f059b0d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:08.787205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866933a-f873-4306-a81c-194d0f059b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:08.862610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2866933a-f873-4306-a81c-194d0f059b0d None None] MFA Rules not processed for user `27e2be33ebdc4c5a97befcbd4d09ee4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:48:08.863818 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2866933a-f873-4306-a81c-194d0f059b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:08.940570 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 668/1324] 10.222.0.15 () {58 vars in 1062 bytes} [Fri Sep 9 20:48:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:48:08.949647 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82698813-d2f0-4cfd-bf12-f8b2efe94f86 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:48:08.951190 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-82698813-d2f0-4cfd-bf12-f8b2efe94f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:08.971282 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:09.059250 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82698813-d2f0-4cfd-bf12-f8b2efe94f86 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:48:09.132218 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a45886-c99a-44e9-9fd7-b0d542706620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:48:09.132831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a45886-c99a-44e9-9fd7-b0d542706620 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:09.133113 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a45886-c99a-44e9-9fd7-b0d542706620 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:09.133386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a45886-c99a-44e9-9fd7-b0d542706620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:09.135048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e9a45886-c99a-44e9-9fd7-b0d542706620 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:09.206305 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:09.245183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a45886-c99a-44e9-9fd7-b0d542706620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:48:09.246637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a45886-c99a-44e9-9fd7-b0d542706620 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:48:09.264706 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 657/1325] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:48:11.715691 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e72a91-72ae-4686-b25e-eeedcd463784 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:11.716231 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e72a91-72ae-4686-b25e-eeedcd463784 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:11.716231 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e72a91-72ae-4686-b25e-eeedcd463784 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:11.717799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 669/1326] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:48:11.723323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6963c-47a6-4052-83f1-a55dfeb2cf44 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:11.724240 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6963c-47a6-4052-83f1-a55dfeb2cf44 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:11.724552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6963c-47a6-4052-83f1-a55dfeb2cf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:11.790359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2dc6963c-47a6-4052-83f1-a55dfeb2cf44 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:48:11.791575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2dc6963c-47a6-4052-83f1-a55dfeb2cf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:11.890222 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 658/1327] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:48:12.171205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e72a91-72ae-4686-b25e-eeedcd463784 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:48:12.172854 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-12e72a91-72ae-4686-b25e-eeedcd463784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:12.234022 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:12.279450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e72a91-72ae-4686-b25e-eeedcd463784 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:48:12.353241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52190ca4-aab8-472d-807f-33e7abd068f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:48:12.353845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52190ca4-aab8-472d-807f-33e7abd068f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:12.354138 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52190ca4-aab8-472d-807f-33e7abd068f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:12.354392 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52190ca4-aab8-472d-807f-33e7abd068f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:12.355971 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-52190ca4-aab8-472d-807f-33e7abd068f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:12.465016 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:12.467281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52190ca4-aab8-472d-807f-33e7abd068f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:48:12.468902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52190ca4-aab8-472d-807f-33e7abd068f1 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:48:12.488431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 670/1328] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:48:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:48:14.732977 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02d5c8-8e02-46ab-9e9c-ac6c6443afa6 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:14.733475 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02d5c8-8e02-46ab-9e9c-ac6c6443afa6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:14.733590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02d5c8-8e02-46ab-9e9c-ac6c6443afa6 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:14.734859 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 659/1329] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:48:14.741161 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74db566-1cc5-4d81-8dcb-ee0e1b785fee None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:14.741638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74db566-1cc5-4d81-8dcb-ee0e1b785fee None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:14.741749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74db566-1cc5-4d81-8dcb-ee0e1b785fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:14.812602 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d74db566-1cc5-4d81-8dcb-ee0e1b785fee None None] MFA Rules not processed for user `2230c53133ec4c828215f6a48adbb673`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:48:14.813862 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d74db566-1cc5-4d81-8dcb-ee0e1b785fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:14.915485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 671/1330] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:48:14 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:48:15.196719 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02d5c8-8e02-46ab-9e9c-ac6c6443afa6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:48:15.198322 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ad02d5c8-8e02-46ab-9e9c-ac6c6443afa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:15.230622 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:15.304171 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02d5c8-8e02-46ab-9e9c-ac6c6443afa6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:48:15.377567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc3a720-e47d-4f20-b8ac-721f02c13496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:48:15.378181 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3a720-e47d-4f20-b8ac-721f02c13496 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:15.378459 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3a720-e47d-4f20-b8ac-721f02c13496 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:15.378729 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc3a720-e47d-4f20-b8ac-721f02c13496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:15.380474 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0fc3a720-e47d-4f20-b8ac-721f02c13496 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:15.467415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:15.500301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3a720-e47d-4f20-b8ac-721f02c13496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:48:15.501764 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc3a720-e47d-4f20-b8ac-721f02c13496 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:48:15.521573 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 660/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:48:15 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:48:17.898994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aca11-ee98-40dd-8a08-1661f4b384a9 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:17.899483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aca11-ee98-40dd-8a08-1661f4b384a9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:17.899598 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aca11-ee98-40dd-8a08-1661f4b384a9 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:17.900907 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 672/1332] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:48:17.906334 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bd320-5298-4006-95b1-d84da35f1a77 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:17.906763 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bd320-5298-4006-95b1-d84da35f1a77 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:17.906915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13bd320-5298-4006-95b1-d84da35f1a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:17.973023 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b13bd320-5298-4006-95b1-d84da35f1a77 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:48:17.974799 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b13bd320-5298-4006-95b1-d84da35f1a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:18.071273 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 661/1333] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:48:18.354053 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aca11-ee98-40dd-8a08-1661f4b384a9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:48:18.355587 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-771aca11-ee98-40dd-8a08-1661f4b384a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:18.425077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:18.460445 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aca11-ee98-40dd-8a08-1661f4b384a9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:48:18.532573 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e758c-09bb-4892-a9e4-35f472f82497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:48:18.533205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e758c-09bb-4892-a9e4-35f472f82497 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:18.533485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e758c-09bb-4892-a9e4-35f472f82497 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:18.533761 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e758c-09bb-4892-a9e4-35f472f82497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:18.535368 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-790e758c-09bb-4892-a9e4-35f472f82497 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:18.650791 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e758c-09bb-4892-a9e4-35f472f82497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:48:18.652180 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e758c-09bb-4892-a9e4-35f472f82497 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:48:18.662802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:18.671277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 673/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:48:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:48:20.867286 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd93ef8-5d3e-4f81-89b1-32a99c4bfef2 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:20.867819 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd93ef8-5d3e-4f81-89b1-32a99c4bfef2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:20.867819 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd93ef8-5d3e-4f81-89b1-32a99c4bfef2 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:20.869191 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 662/1335] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:48:20.874550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3d0fc-7ecc-477e-b604-0dd13d657846 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:20.874936 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3d0fc-7ecc-477e-b604-0dd13d657846 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:20.875103 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3d0fc-7ecc-477e-b604-0dd13d657846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:20.945879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c1a3d0fc-7ecc-477e-b604-0dd13d657846 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:48:20.947108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c1a3d0fc-7ecc-477e-b604-0dd13d657846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:21.042724 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 674/1336] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:48:21.328696 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd93ef8-5d3e-4f81-89b1-32a99c4bfef2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:48:21.330238 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1bd93ef8-5d3e-4f81-89b1-32a99c4bfef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:21.371230 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:21.435521 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd93ef8-5d3e-4f81-89b1-32a99c4bfef2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:48:21.509451 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3899db-f9d4-429a-ac8a-56834de88f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:48:21.510055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3899db-f9d4-429a-ac8a-56834de88f6f service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:21.510334 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3899db-f9d4-429a-ac8a-56834de88f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:21.510605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3899db-f9d4-429a-ac8a-56834de88f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:21.512215 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ec3899db-f9d4-429a-ac8a-56834de88f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:21.596575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:21.622358 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3899db-f9d4-429a-ac8a-56834de88f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:48:21.623803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3899db-f9d4-429a-ac8a-56834de88f6f service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:48:21.642399 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 663/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:48:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:48:24.404728 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaca656-438c-42ed-a919-7bd078bb5ce2 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:24.405254 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaca656-438c-42ed-a919-7bd078bb5ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:24.405254 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaca656-438c-42ed-a919-7bd078bb5ce2 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:24.406602 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 675/1338] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:48:24.411713 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee116ce5-ae85-4efe-84e3-369a98992bb7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:24.412120 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee116ce5-ae85-4efe-84e3-369a98992bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:24.412295 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee116ce5-ae85-4efe-84e3-369a98992bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:24.478523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ee116ce5-ae85-4efe-84e3-369a98992bb7 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:48:24.479730 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ee116ce5-ae85-4efe-84e3-369a98992bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:24.576677 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 664/1339] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:48:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:48:24.866768 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaca656-438c-42ed-a919-7bd078bb5ce2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:48:24.868352 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dcaca656-438c-42ed-a919-7bd078bb5ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:24.943481 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:24.970728 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaca656-438c-42ed-a919-7bd078bb5ce2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:48:25.042661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c0680-04e6-4188-aec8-430ed70ba28c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:48:25.043259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c0680-04e6-4188-aec8-430ed70ba28c service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:25.043535 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c0680-04e6-4188-aec8-430ed70ba28c service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:25.043805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c0680-04e6-4188-aec8-430ed70ba28c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:25.045421 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e53c0680-04e6-4188-aec8-430ed70ba28c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:25.154340 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c0680-04e6-4188-aec8-430ed70ba28c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:48:25.155788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c0680-04e6-4188-aec8-430ed70ba28c service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:48:25.173465 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 676/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:48:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:48:29.482370 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8b621-8548-4985-a7c9-c176dce2ceac None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:29.482900 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8b621-8548-4985-a7c9-c176dce2ceac None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:29.482900 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8b621-8548-4985-a7c9-c176dce2ceac None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:29.484444 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 665/1341] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:48:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:48:29.490070 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a5c63-a406-4bb8-9321-19dc182d54cc None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:29.490566 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a5c63-a406-4bb8-9321-19dc182d54cc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:29.490741 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a5c63-a406-4bb8-9321-19dc182d54cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:29.496557 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:29.572821 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-159a5c63-a406-4bb8-9321-19dc182d54cc None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:48:29.574047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-159a5c63-a406-4bb8-9321-19dc182d54cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:29.673962 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 677/1342] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:48:29.962113 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8b621-8548-4985-a7c9-c176dce2ceac None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:48:29.963648 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-08c8b621-8548-4985-a7c9-c176dce2ceac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:30.013292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:30.070618 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8b621-8548-4985-a7c9-c176dce2ceac None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:48:30.146673 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f8fe0-d2cb-4b6c-8022-570a374b4ef8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:48:30.147221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f8fe0-d2cb-4b6c-8022-570a374b4ef8 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:30.147508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f8fe0-d2cb-4b6c-8022-570a374b4ef8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:30.147782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f8fe0-d2cb-4b6c-8022-570a374b4ef8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:30.149408 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-704f8fe0-d2cb-4b6c-8022-570a374b4ef8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:30.247702 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:30.265552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f8fe0-d2cb-4b6c-8022-570a374b4ef8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:48:30.267062 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f8fe0-d2cb-4b6c-8022-570a374b4ef8 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:48:30.291361 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 666/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:48:33.075455 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef176c2-b8d5-41cb-a118-d44940ee014a None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:33.076061 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef176c2-b8d5-41cb-a118-d44940ee014a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:33.076061 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef176c2-b8d5-41cb-a118-d44940ee014a None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:33.077367 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 678/1344] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:48:33.083183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c7892-c49e-4c5d-9a58-71c2b0b8beab None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:33.083605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c7892-c49e-4c5d-9a58-71c2b0b8beab None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:33.083861 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c7892-c49e-4c5d-9a58-71c2b0b8beab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:33.163953 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c37c7892-c49e-4c5d-9a58-71c2b0b8beab None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:48:33.165187 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c37c7892-c49e-4c5d-9a58-71c2b0b8beab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:33.269746 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 667/1345] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:48:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:48:33.566299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef176c2-b8d5-41cb-a118-d44940ee014a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:48:33.568939 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1ef176c2-b8d5-41cb-a118-d44940ee014a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:33.656630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:33.674431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef176c2-b8d5-41cb-a118-d44940ee014a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:48:33.750940 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1478a6d-cdaa-4eaa-a90c-037521bda981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:48:33.751456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1478a6d-cdaa-4eaa-a90c-037521bda981 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:33.751727 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1478a6d-cdaa-4eaa-a90c-037521bda981 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:33.752018 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1478a6d-cdaa-4eaa-a90c-037521bda981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:33.753601 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a1478a6d-cdaa-4eaa-a90c-037521bda981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:33.882464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1478a6d-cdaa-4eaa-a90c-037521bda981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:48:33.883911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1478a6d-cdaa-4eaa-a90c-037521bda981 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:48:33.903346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 679/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:48:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:48:38.022387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0af75e-7b84-41dc-92b7-9c7e6b35611c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:38.022940 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0af75e-7b84-41dc-92b7-9c7e6b35611c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:38.022940 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0af75e-7b84-41dc-92b7-9c7e6b35611c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:38.026036 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 668/1347] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:48:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:48:38.030332 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36b151-59f9-4ad1-9648-3239c28b6b2a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:38.030794 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36b151-59f9-4ad1-9648-3239c28b6b2a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:38.030906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36b151-59f9-4ad1-9648-3239c28b6b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:38.047688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:38.107805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ac36b151-59f9-4ad1-9648-3239c28b6b2a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:48:38.109137 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ac36b151-59f9-4ad1-9648-3239c28b6b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:38.218249 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 680/1348] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:48:38.507667 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0af75e-7b84-41dc-92b7-9c7e6b35611c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:48:38.509240 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bf0af75e-7b84-41dc-92b7-9c7e6b35611c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:38.567650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:38.611848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0af75e-7b84-41dc-92b7-9c7e6b35611c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:48:38.685653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca37f2-64db-43cd-8457-372f6e4ea7fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:48:38.686252 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca37f2-64db-43cd-8457-372f6e4ea7fd service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:38.686526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca37f2-64db-43cd-8457-372f6e4ea7fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:38.686793 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca37f2-64db-43cd-8457-372f6e4ea7fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:38.688394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9bca37f2-64db-43cd-8457-372f6e4ea7fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:38.794484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:38.798013 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca37f2-64db-43cd-8457-372f6e4ea7fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:48:38.799869 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca37f2-64db-43cd-8457-372f6e4ea7fd service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:48:38.818880 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 669/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:48:43.745251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8291819-dac0-40c5-8e79-72ac21578a54 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:43.746303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8291819-dac0-40c5-8e79-72ac21578a54 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:43.746734 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8291819-dac0-40c5-8e79-72ac21578a54 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:43.748623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 681/1350] 10.222.0.15 () {54 vars in 921 bytes} [Fri Sep 9 20:48:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:48:43.756538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee73341-b135-470b-ab06-beb7d7a77996 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:43.757123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee73341-b135-470b-ab06-beb7d7a77996 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:43.760851 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee73341-b135-470b-ab06-beb7d7a77996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:43.889663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-dee73341-b135-470b-ab06-beb7d7a77996 None None] MFA Rules not processed for user `0fc28d9a1b3f4feca0deeb5f266f8b37`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:48:43.890893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-dee73341-b135-470b-ab06-beb7d7a77996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:44.008560 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 670/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Sep 9 20:48:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:48:48.111921 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3da6d-e422-4333-a41f-978dd3b0b8e8 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:48.112485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3da6d-e422-4333-a41f-978dd3b0b8e8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:48.112568 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3da6d-e422-4333-a41f-978dd3b0b8e8 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:48.114196 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 682/1352] 10.222.0.15 () {54 vars in 921 bytes} [Fri Sep 9 20:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:48:48.119043 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff729413-714d-4238-8a14-5ceab4c8cbf9 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:48.119498 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff729413-714d-4238-8a14-5ceab4c8cbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:48.119602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff729413-714d-4238-8a14-5ceab4c8cbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:48.178178 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:48.202772 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ff729413-714d-4238-8a14-5ceab4c8cbf9 None None] MFA Rules not processed for user `0fc28d9a1b3f4feca0deeb5f266f8b37`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:48:48.204017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ff729413-714d-4238-8a14-5ceab4c8cbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:48.216596 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=59 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:48.325274 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 671/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Sep 9 20:48:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:48:49.719094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c23876-1f81-4078-bcb1-9a9ef2bbc00a None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:49.719616 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c23876-1f81-4078-bcb1-9a9ef2bbc00a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:49.719712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c23876-1f81-4078-bcb1-9a9ef2bbc00a None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:49.721019 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 683/1354] 10.222.0.15 () {54 vars in 921 bytes} [Fri Sep 9 20:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:48:49.726440 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a2e99-df84-449c-9f79-505ea943be67 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:49.726913 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a2e99-df84-449c-9f79-505ea943be67 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:49.727125 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a2e99-df84-449c-9f79-505ea943be67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:49.807234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6d8a2e99-df84-449c-9f79-505ea943be67 None None] MFA Rules not processed for user `0fc28d9a1b3f4feca0deeb5f266f8b37`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:48:49.808476 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6d8a2e99-df84-449c-9f79-505ea943be67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:49.852399 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:49.919947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 672/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Sep 9 20:48:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:48:53.452947 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dd00c-3867-4539-a321-644d58d41a4c None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:53.453932 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dd00c-3867-4539-a321-644d58d41a4c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:53.454421 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dd00c-3867-4539-a321-644d58d41a4c None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:53.456319 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 684/1356] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:48:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:48:53.461724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbe66a-2cd8-4578-af65-a62248b4d677 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:53.462190 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbe66a-2cd8-4578-af65-a62248b4d677 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:53.462286 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbe66a-2cd8-4578-af65-a62248b4d677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:53.535434 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b0cbe66a-2cd8-4578-af65-a62248b4d677 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:48:53.537237 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b0cbe66a-2cd8-4578-af65-a62248b4d677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:53.641285 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 673/1357] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:48:53.943769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1d177-e193-4c29-8af0-8737193824a0 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:53.944382 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1d177-e193-4c29-8af0-8737193824a0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:53.944894 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1d177-e193-4c29-8af0-8737193824a0 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:53.946871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 685/1358] 10.222.0.15 () {54 vars in 962 bytes} [Fri Sep 9 20:48:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:48:53.953644 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0ff43-dece-4416-ad43-f441093c09c8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:53.953937 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0ff43-dece-4416-ad43-f441093c09c8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:53.954211 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0ff43-dece-4416-ad43-f441093c09c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:53.971029 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:54.038591 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-81e0ff43-dece-4416-ad43-f441093c09c8 None None] MFA Rules not processed for user `dc210376e57a41e6b3812110db249099`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:48:54.039945 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-81e0ff43-dece-4416-ad43-f441093c09c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:54.163713 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 674/1359] 10.222.0.15 () {58 vars in 1059 bytes} [Fri Sep 9 20:48:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:48:54.171501 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1d177-e193-4c29-8af0-8737193824a0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:48:54.173257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4ee1d177-e193-4c29-8af0-8737193824a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:54.354782 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1d177-e193-4c29-8af0-8737193824a0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:48:54.432257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:54.474605 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20c443-8fe8-4613-8a17-461ecdc9424f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:48:54.475221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20c443-8fe8-4613-8a17-461ecdc9424f service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:54.475486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20c443-8fe8-4613-8a17-461ecdc9424f service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:54.475759 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20c443-8fe8-4613-8a17-461ecdc9424f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:54.477364 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1b20c443-8fe8-4613-8a17-461ecdc9424f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:54.580495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20c443-8fe8-4613-8a17-461ecdc9424f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:48:54.583234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20c443-8fe8-4613-8a17-461ecdc9424f service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:48:54.605093 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 686/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:48:57.015803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740e25c-5f78-4105-9fa6-b364ef26cdc1 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:57.016376 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740e25c-5f78-4105-9fa6-b364ef26cdc1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:57.016376 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740e25c-5f78-4105-9fa6-b364ef26cdc1 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:57.017660 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 675/1361] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:48:57.023307 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47f374-0de2-4d71-b245-fb83599309fb None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:57.023779 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47f374-0de2-4d71-b245-fb83599309fb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:57.023911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47f374-0de2-4d71-b245-fb83599309fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:57.103023 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ab47f374-0de2-4d71-b245-fb83599309fb None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:48:57.103023 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ab47f374-0de2-4d71-b245-fb83599309fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:57.163750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:57.252141 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 687/1362] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:48:57.529459 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740e25c-5f78-4105-9fa6-b364ef26cdc1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:48:57.531159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9740e25c-5f78-4105-9fa6-b364ef26cdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:57.604298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:57.713701 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740e25c-5f78-4105-9fa6-b364ef26cdc1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:48:57.867255 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce03fd-e0e8-470f-a1fa-f43265639573 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:48:57.867811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce03fd-e0e8-470f-a1fa-f43265639573 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:48:57.868188 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce03fd-e0e8-470f-a1fa-f43265639573 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:48:57.868466 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce03fd-e0e8-470f-a1fa-f43265639573 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:48:57.870109 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ddce03fd-e0e8-470f-a1fa-f43265639573 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:48:57.897475 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:48:57.971421 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce03fd-e0e8-470f-a1fa-f43265639573 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:48:57.973083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce03fd-e0e8-470f-a1fa-f43265639573 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:48:57.992290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 676/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:48:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:49:00.507400 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb53ae4-3687-4e65-a37f-bdfb8f9ed2ae None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:00.507953 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb53ae4-3687-4e65-a37f-bdfb8f9ed2ae None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:00.507953 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb53ae4-3687-4e65-a37f-bdfb8f9ed2ae None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:00.509465 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 688/1364] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:00.514502 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4d314-1ebb-4681-8662-5434695ca2cf None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:00.514890 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4d314-1ebb-4681-8662-5434695ca2cf None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:00.515090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4d314-1ebb-4681-8662-5434695ca2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:00.585438 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-67b4d314-1ebb-4681-8662-5434695ca2cf None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:00.586579 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-67b4d314-1ebb-4681-8662-5434695ca2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:00.691429 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:00.700071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 677/1365] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:00.986641 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b99b4-91b6-461d-9ab9-d8c4f54b50e1 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:00.986919 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b99b4-91b6-461d-9ab9-d8c4f54b50e1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:00.987198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b99b4-91b6-461d-9ab9-d8c4f54b50e1 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:00.989206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 689/1366] 10.222.0.15 () {54 vars in 962 bytes} [Fri Sep 9 20:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:00.994257 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa97ce-d0fb-4de5-b96d-8f24a8b16653 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:00.994741 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa97ce-d0fb-4de5-b96d-8f24a8b16653 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:00.995146 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa97ce-d0fb-4de5-b96d-8f24a8b16653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:01.075206 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-58fa97ce-d0fb-4de5-b96d-8f24a8b16653 None None] MFA Rules not processed for user `dc210376e57a41e6b3812110db249099`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:01.076599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-58fa97ce-d0fb-4de5-b96d-8f24a8b16653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:01.198458 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 678/1367] 10.222.0.15 () {58 vars in 1059 bytes} [Fri Sep 9 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:01.206474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b99b4-91b6-461d-9ab9-d8c4f54b50e1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:49:01.208427 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d96b99b4-91b6-461d-9ab9-d8c4f54b50e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:01.370079 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b99b4-91b6-461d-9ab9-d8c4f54b50e1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:49:01.391718 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:01.492530 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbfb9f-75b5-4e76-a5e0-094e92a6d030 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:49:01.493308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbfb9f-75b5-4e76-a5e0-094e92a6d030 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:01.493685 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbfb9f-75b5-4e76-a5e0-094e92a6d030 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:01.494055 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbfb9f-75b5-4e76-a5e0-094e92a6d030 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:01.495821 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-93fbfb9f-75b5-4e76-a5e0-094e92a6d030 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:01.591321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbfb9f-75b5-4e76-a5e0-094e92a6d030 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:49:01.592889 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbfb9f-75b5-4e76-a5e0-094e92a6d030 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:49:01.612166 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 690/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:49:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:49:01.757956 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6978070-4ec9-4201-a026-169dcdaab45a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:01.758523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6978070-4ec9-4201-a026-169dcdaab45a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:01.758523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6978070-4ec9-4201-a026-169dcdaab45a None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:01.760108 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 679/1369] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:49:01.765796 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e744fff-3bb0-4cfa-b4da-2ab7eb588b9b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:01.766099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e744fff-3bb0-4cfa-b4da-2ab7eb588b9b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:01.766362 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e744fff-3bb0-4cfa-b4da-2ab7eb588b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:01.804505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:01.848596 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8e744fff-3bb0-4cfa-b4da-2ab7eb588b9b None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:01.849779 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8e744fff-3bb0-4cfa-b4da-2ab7eb588b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:01.971587 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 691/1370] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:49:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:02.272000 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e00562-cc92-4ad3-bf2e-d5d3981d6780 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:02.272309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e00562-cc92-4ad3-bf2e-d5d3981d6780 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:02.272589 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e00562-cc92-4ad3-bf2e-d5d3981d6780 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:02.274073 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 680/1371] 10.222.0.15 () {54 vars in 964 bytes} [Fri Sep 9 20:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:02.279295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f469b2-1415-4444-8368-527a02f6010b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:02.279590 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f469b2-1415-4444-8368-527a02f6010b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:02.279870 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f469b2-1415-4444-8368-527a02f6010b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:02.359604 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-40f469b2-1415-4444-8368-527a02f6010b None None] MFA Rules not processed for user `cf65c58c74fc49e4ba7605f3c6c27f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:02.360889 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-40f469b2-1415-4444-8368-527a02f6010b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:02.410243 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:02.441639 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 692/1372] 10.222.0.15 () {58 vars in 1061 bytes} [Fri Sep 9 20:49:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:02.448976 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e00562-cc92-4ad3-bf2e-d5d3981d6780 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:49:02.450484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-04e00562-cc92-4ad3-bf2e-d5d3981d6780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:02.504576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:02.572119 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e00562-cc92-4ad3-bf2e-d5d3981d6780 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:49:02.666247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844bf9c-7a53-4505-8911-822393e8def7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:49:02.666911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844bf9c-7a53-4505-8911-822393e8def7 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:02.667134 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844bf9c-7a53-4505-8911-822393e8def7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:02.667399 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844bf9c-7a53-4505-8911-822393e8def7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:02.670484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3844bf9c-7a53-4505-8911-822393e8def7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:02.790245 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:02.807454 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844bf9c-7a53-4505-8911-822393e8def7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:49:02.808951 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844bf9c-7a53-4505-8911-822393e8def7 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:49:02.830435 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 681/1373] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:49:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:49:03.875171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7446db-fcf2-4bdd-84de-07ac2864457b None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:03.876335 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7446db-fcf2-4bdd-84de-07ac2864457b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:03.876620 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7446db-fcf2-4bdd-84de-07ac2864457b None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:03.877986 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 693/1374] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:49:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:03.883931 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea62434-0385-4fe6-9fa1-15e7d52cb00e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:03.884576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea62434-0385-4fe6-9fa1-15e7d52cb00e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:03.884576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea62434-0385-4fe6-9fa1-15e7d52cb00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:03.950636 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-eea62434-0385-4fe6-9fa1-15e7d52cb00e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:03.951850 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-eea62434-0385-4fe6-9fa1-15e7d52cb00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:04.049535 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 682/1375] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:04.341885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7446db-fcf2-4bdd-84de-07ac2864457b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:49:04.343452 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aa7446db-fcf2-4bdd-84de-07ac2864457b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:04.518124 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7446db-fcf2-4bdd-84de-07ac2864457b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:49:04.576056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:04.641031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0f4a4-67a1-4eaa-828a-003645e859b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:49:04.641644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0f4a4-67a1-4eaa-828a-003645e859b0 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:04.641923 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0f4a4-67a1-4eaa-828a-003645e859b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:04.642193 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0f4a4-67a1-4eaa-828a-003645e859b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:04.643867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fbd0f4a4-67a1-4eaa-828a-003645e859b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:04.739733 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0f4a4-67a1-4eaa-828a-003645e859b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:49:04.741388 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0f4a4-67a1-4eaa-828a-003645e859b0 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:49:04.760849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 694/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:49:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:49:07.005708 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51108b98-b4e7-4e78-a318-a57d1484203b None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:07.006239 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51108b98-b4e7-4e78-a318-a57d1484203b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:07.006239 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51108b98-b4e7-4e78-a318-a57d1484203b None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:07.007648 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 683/1377] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:49:07.012976 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6e89c-9558-4178-bfce-f53353cc6b3d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:07.013387 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6e89c-9558-4178-bfce-f53353cc6b3d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:07.013593 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6e89c-9558-4178-bfce-f53353cc6b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:07.082974 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-65f6e89c-9558-4178-bfce-f53353cc6b3d None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:07.084215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-65f6e89c-9558-4178-bfce-f53353cc6b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:07.091579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:07.189415 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 695/1378] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:07.482877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51108b98-b4e7-4e78-a318-a57d1484203b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:49:07.484526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-51108b98-b4e7-4e78-a318-a57d1484203b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:07.549850 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:07.644213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51108b98-b4e7-4e78-a318-a57d1484203b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:49:07.769273 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69569e69-4ea8-4ce0-b878-25c4cf0ea929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:49:07.769878 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69569e69-4ea8-4ce0-b878-25c4cf0ea929 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:07.770155 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69569e69-4ea8-4ce0-b878-25c4cf0ea929 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:07.770425 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69569e69-4ea8-4ce0-b878-25c4cf0ea929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:07.771982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-69569e69-4ea8-4ce0-b878-25c4cf0ea929 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:07.791885 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:07.885563 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69569e69-4ea8-4ce0-b878-25c4cf0ea929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:49:07.887183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69569e69-4ea8-4ce0-b878-25c4cf0ea929 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:49:07.908784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 684/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:49:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:49:10.137391 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e774dd-f3a6-4370-be27-558e88f6407e None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:10.137916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e774dd-f3a6-4370-be27-558e88f6407e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:10.138010 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e774dd-f3a6-4370-be27-558e88f6407e None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:10.139442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 696/1380] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:10.145125 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560a1a5-3734-42c0-bb33-9b7f3643069c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:10.145585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560a1a5-3734-42c0-bb33-9b7f3643069c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:10.145689 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560a1a5-3734-42c0-bb33-9b7f3643069c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:10.217298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9560a1a5-3734-42c0-bb33-9b7f3643069c None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:10.218724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9560a1a5-3734-42c0-bb33-9b7f3643069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:10.338912 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:10.357134 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 685/1381] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:49:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:10.638980 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e774dd-f3a6-4370-be27-558e88f6407e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:49:10.641054 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-00e774dd-f3a6-4370-be27-558e88f6407e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:10.794596 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:10.805851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e774dd-f3a6-4370-be27-558e88f6407e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:49:10.926214 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41992caf-2975-4099-b584-1cb27e281702 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:49:10.926827 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41992caf-2975-4099-b584-1cb27e281702 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:10.927104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41992caf-2975-4099-b584-1cb27e281702 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:10.927380 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41992caf-2975-4099-b584-1cb27e281702 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:10.929180 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-41992caf-2975-4099-b584-1cb27e281702 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:11.024491 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41992caf-2975-4099-b584-1cb27e281702 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:49:11.026103 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41992caf-2975-4099-b584-1cb27e281702 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:49:11.036688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:11.047639 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 697/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:49:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:49:13.270403 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332033cf-1921-4605-9660-a1081e63433a None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:13.271098 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332033cf-1921-4605-9660-a1081e63433a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:13.271098 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332033cf-1921-4605-9660-a1081e63433a None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:13.272336 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 686/1383] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:13.277693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2b546-abd3-4d45-a36f-0e692dcd47d9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:13.278504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2b546-abd3-4d45-a36f-0e692dcd47d9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:13.278504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2b546-abd3-4d45-a36f-0e692dcd47d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:13.355303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1fc2b546-abd3-4d45-a36f-0e692dcd47d9 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:13.356645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1fc2b546-abd3-4d45-a36f-0e692dcd47d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:13.457909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 698/1384] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:49:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:13.834632 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332033cf-1921-4605-9660-a1081e63433a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:49:13.836247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-332033cf-1921-4605-9660-a1081e63433a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:14.002436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332033cf-1921-4605-9660-a1081e63433a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:49:14.072822 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:14.125244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb75995-61ed-40cb-a0c1-c893eab3b6cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:49:14.125856 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb75995-61ed-40cb-a0c1-c893eab3b6cf service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:14.126143 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb75995-61ed-40cb-a0c1-c893eab3b6cf service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:14.126421 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb75995-61ed-40cb-a0c1-c893eab3b6cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:14.128136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ccb75995-61ed-40cb-a0c1-c893eab3b6cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:14.241340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb75995-61ed-40cb-a0c1-c893eab3b6cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:49:14.242969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb75995-61ed-40cb-a0c1-c893eab3b6cf service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:49:14.261467 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 687/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:49:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:49:16.444412 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf2d3d-04a1-44f5-8e26-54a2d69e72b0 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:16.444937 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf2d3d-04a1-44f5-8e26-54a2d69e72b0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:16.444937 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf2d3d-04a1-44f5-8e26-54a2d69e72b0 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:16.446298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 699/1386] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:16.451644 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062fbb6-f481-4ccf-836b-662a6e3a1406 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:16.452102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062fbb6-f481-4ccf-836b-662a6e3a1406 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:16.452225 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062fbb6-f481-4ccf-836b-662a6e3a1406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:16.519918 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c062fbb6-f481-4ccf-836b-662a6e3a1406 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:16.521203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c062fbb6-f481-4ccf-836b-662a6e3a1406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:16.555414 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:16.621411 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 688/1387] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:16.915201 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf2d3d-04a1-44f5-8e26-54a2d69e72b0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:49:16.916865 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ebbf2d3d-04a1-44f5-8e26-54a2d69e72b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:16.993105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:17.063358 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf2d3d-04a1-44f5-8e26-54a2d69e72b0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:49:17.177485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76844cfb-5ba5-4af2-99ae-f3b4b2262a1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:49:17.178089 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76844cfb-5ba5-4af2-99ae-f3b4b2262a1f service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:17.178366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76844cfb-5ba5-4af2-99ae-f3b4b2262a1f service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:17.178638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76844cfb-5ba5-4af2-99ae-f3b4b2262a1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:17.180260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-76844cfb-5ba5-4af2-99ae-f3b4b2262a1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:17.219295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:17.271969 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76844cfb-5ba5-4af2-99ae-f3b4b2262a1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:49:17.273629 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76844cfb-5ba5-4af2-99ae-f3b4b2262a1f service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:49:17.296141 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 700/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:49:18.195132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8de10-62c9-4f47-8dd3-5bed815b5b7c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:18.195683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8de10-62c9-4f47-8dd3-5bed815b5b7c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:18.195683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8de10-62c9-4f47-8dd3-5bed815b5b7c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:18.197189 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 689/1389] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:18.202579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70508f5a-83d8-48fb-8558-772fdf2017e1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:18.202995 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70508f5a-83d8-48fb-8558-772fdf2017e1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:18.203133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70508f5a-83d8-48fb-8558-772fdf2017e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:18.271241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-70508f5a-83d8-48fb-8558-772fdf2017e1 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:18.272470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-70508f5a-83d8-48fb-8558-772fdf2017e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:18.373227 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 701/1390] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:18.679528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cbb7d-cc47-4900-b428-4da1597eaa4c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:18.679813 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cbb7d-cc47-4900-b428-4da1597eaa4c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:18.680122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cbb7d-cc47-4900-b428-4da1597eaa4c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:18.681449 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 690/1391] 10.222.0.15 () {54 vars in 966 bytes} [Fri Sep 9 20:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:18.686743 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e85b4-0b19-426c-a4cd-74257c9f496d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:18.687035 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e85b4-0b19-426c-a4cd-74257c9f496d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:18.687307 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e85b4-0b19-426c-a4cd-74257c9f496d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:18.703248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:18.763971 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-737e85b4-0b19-426c-a4cd-74257c9f496d None None] MFA Rules not processed for user `8d298efe48464956b7a03cba1001060b`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:18.765218 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-737e85b4-0b19-426c-a4cd-74257c9f496d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:18.842373 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 702/1392] 10.222.0.15 () {58 vars in 1063 bytes} [Fri Sep 9 20:49:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:18.852524 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cbb7d-cc47-4900-b428-4da1597eaa4c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:49:18.854124 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8d0cbb7d-cc47-4900-b428-4da1597eaa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:18.959016 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cbb7d-cc47-4900-b428-4da1597eaa4c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:49:19.019725 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:19.036523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b49ebc-55e2-4104-9e40-ef3066780826 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d298efe48464956b7a03cba1001060b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:49:19.037135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b49ebc-55e2-4104-9e40-ef3066780826 service glance] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:19.037412 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b49ebc-55e2-4104-9e40-ef3066780826 service glance] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:19.037682 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b49ebc-55e2-4104-9e40-ef3066780826 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:19.039265 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d7b49ebc-55e2-4104-9e40-ef3066780826 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:19.149169 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b49ebc-55e2-4104-9e40-ef3066780826 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:49:19.150615 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b49ebc-55e2-4104-9e40-ef3066780826 service glance] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:49:19.169856 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 691/1393] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:49:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:49:19.529611 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d6898-835f-4958-9a9c-9ad3862f3087 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:19.530183 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d6898-835f-4958-9a9c-9ad3862f3087 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:19.530472 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d6898-835f-4958-9a9c-9ad3862f3087 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:19.531839 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 703/1394] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:49:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:19.537576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb497bd-09e2-4edf-8449-b8eec872157c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:19.538044 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb497bd-09e2-4edf-8449-b8eec872157c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:19.538348 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb497bd-09e2-4edf-8449-b8eec872157c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:19.617909 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4cb497bd-09e2-4edf-8449-b8eec872157c None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:19.619117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4cb497bd-09e2-4edf-8449-b8eec872157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:19.662438 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:19.722440 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 692/1395] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:19.929341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547cfd3-01df-4849-8824-98b0b31300ac None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:19.929693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547cfd3-01df-4849-8824-98b0b31300ac None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:19.930034 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547cfd3-01df-4849-8824-98b0b31300ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:20.005402 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d547cfd3-01df-4849-8824-98b0b31300ac None None] MFA Rules not processed for user `e51ae6959aac49898e75c6786c5dbdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:20.006936 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d547cfd3-01df-4849-8824-98b0b31300ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:20.019255 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb497bd-09e2-4edf-8449-b8eec872157c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:49:20.020496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4cb497bd-09e2-4edf-8449-b8eec872157c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:20.063409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:20.095586 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 704/1396] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Sep 9 20:49:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:49:20.137650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb497bd-09e2-4edf-8449-b8eec872157c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:49:20.143137 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d2849-ee23-4dc7-a987-df962b8fed91 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:20.143424 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d2849-ee23-4dc7-a987-df962b8fed91 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:20.143700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d2849-ee23-4dc7-a987-df962b8fed91 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:20.145088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 705/1397] 10.222.0.15 () {54 vars in 943 bytes} [Fri Sep 9 20:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:49:20.151180 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9686a5b-4bad-4d1f-899e-7686a1ec294a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:20.151470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9686a5b-4bad-4d1f-899e-7686a1ec294a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:20.151921 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9686a5b-4bad-4d1f-899e-7686a1ec294a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:20.198016 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:20.233159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e9686a5b-4bad-4d1f-899e-7686a1ec294a None None] MFA Rules not processed for user `9570eaa112de460cb9e371278bfb300b`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:20.234508 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e9686a5b-4bad-4d1f-899e-7686a1ec294a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:20.259221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5a562-4438-44fb-a178-6a1c273af24a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:49:20.259838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5a562-4438-44fb-a178-6a1c273af24a service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:20.260194 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5a562-4438-44fb-a178-6a1c273af24a service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:20.260473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5a562-4438-44fb-a178-6a1c273af24a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:20.262069 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7af5a562-4438-44fb-a178-6a1c273af24a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:20.353046 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 706/1398] 10.222.0.15 () {58 vars in 1040 bytes} [Fri Sep 9 20:49:20 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:20.357865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5a562-4438-44fb-a178-6a1c273af24a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:49:20.359514 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5a562-4438-44fb-a178-6a1c273af24a service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:49:20.362918 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9686a5b-4bad-4d1f-899e-7686a1ec294a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:49:20.372363 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9686a5b-4bad-4d1f-899e-7686a1ec294a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:49:20.378462 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 693/1399] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 20:49:20.400820 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:20.500986 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d512fc-6cdb-4866-a422-e4b73dd4422b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9570eaa112de460cb9e371278bfb300b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:49:20.501617 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d512fc-6cdb-4866-a422-e4b73dd4422b service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:20.501898 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d512fc-6cdb-4866-a422-e4b73dd4422b service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:20.502173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d512fc-6cdb-4866-a422-e4b73dd4422b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:20.504650 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-78d512fc-6cdb-4866-a422-e4b73dd4422b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:20.599012 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d512fc-6cdb-4866-a422-e4b73dd4422b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:49:20.600701 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d512fc-6cdb-4866-a422-e4b73dd4422b service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:49:20.609633 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 707/1400] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Sep 9 20:49:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 20:49:22.613001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063dc04-6223-46d9-9d5c-729ec79cc73e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:22.613556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063dc04-6223-46d9-9d5c-729ec79cc73e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:22.613556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063dc04-6223-46d9-9d5c-729ec79cc73e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:22.616347 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 694/1401] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:49:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:22.620070 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31b48e-9e07-41f8-8704-e349536c5f5d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:22.621482 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31b48e-9e07-41f8-8704-e349536c5f5d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:22.622021 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d31b48e-9e07-41f8-8704-e349536c5f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:22.698769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8d31b48e-9e07-41f8-8704-e349536c5f5d None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:22.700333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8d31b48e-9e07-41f8-8704-e349536c5f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:22.710092 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:22.812814 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 708/1402] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:23.108813 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063dc04-6223-46d9-9d5c-729ec79cc73e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:49:23.110847 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c063dc04-6223-46d9-9d5c-729ec79cc73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:23.188877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:23.280755 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063dc04-6223-46d9-9d5c-729ec79cc73e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:49:23.419151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1c787-dff3-4906-b399-d43e08b20735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:49:23.419941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1c787-dff3-4906-b399-d43e08b20735 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:23.420326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1c787-dff3-4906-b399-d43e08b20735 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:23.420684 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1c787-dff3-4906-b399-d43e08b20735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:23.422397 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6ae1c787-dff3-4906-b399-d43e08b20735 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:23.452290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:23.530655 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1c787-dff3-4906-b399-d43e08b20735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:49:23.532321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1c787-dff3-4906-b399-d43e08b20735 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:49:23.551763 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 695/1403] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:49:25.832247 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103577f5-e466-4538-ae96-4a61ae4d24b6 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:25.832793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103577f5-e466-4538-ae96-4a61ae4d24b6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:25.832967 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103577f5-e466-4538-ae96-4a61ae4d24b6 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:25.834320 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 709/1404] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:49:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:25.840118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbc425-9246-4f4e-91a8-be6149f61b39 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:25.840551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbc425-9246-4f4e-91a8-be6149f61b39 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:25.840705 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbc425-9246-4f4e-91a8-be6149f61b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:25.922970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-52dbc425-9246-4f4e-91a8-be6149f61b39 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:25.924321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-52dbc425-9246-4f4e-91a8-be6149f61b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:26.043171 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 696/1405] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:49:26.358845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103577f5-e466-4538-ae96-4a61ae4d24b6 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:49:26.361281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-103577f5-e466-4538-ae96-4a61ae4d24b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:26.515395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:26.526759 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103577f5-e466-4538-ae96-4a61ae4d24b6 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:49:26.649312 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b884f61-a945-42e0-b780-9e3b8087f384 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:49:26.649841 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b884f61-a945-42e0-b780-9e3b8087f384 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:26.650123 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b884f61-a945-42e0-b780-9e3b8087f384 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:26.650394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b884f61-a945-42e0-b780-9e3b8087f384 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:26.652041 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4b884f61-a945-42e0-b780-9e3b8087f384 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:26.753388 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b884f61-a945-42e0-b780-9e3b8087f384 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:49:26.755099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b884f61-a945-42e0-b780-9e3b8087f384 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:49:26.765924 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:26.775636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 710/1406] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:49:28.998105 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b4e60-6dd8-4f2f-bfc6-8a73acb06c2f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:28.998660 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b4e60-6dd8-4f2f-bfc6-8a73acb06c2f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:28.998660 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b4e60-6dd8-4f2f-bfc6-8a73acb06c2f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:29.000027 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 697/1407] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:29.006005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c75e8-3cea-485a-8fe9-14d58966bf65 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:29.006419 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c75e8-3cea-485a-8fe9-14d58966bf65 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:29.006571 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c75e8-3cea-485a-8fe9-14d58966bf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:29.078462 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8d4c75e8-3cea-485a-8fe9-14d58966bf65 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:29.079701 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8d4c75e8-3cea-485a-8fe9-14d58966bf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:29.186184 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 711/1408] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:49:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:29.479369 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b4e60-6dd8-4f2f-bfc6-8a73acb06c2f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:49:29.481301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-290b4e60-6dd8-4f2f-bfc6-8a73acb06c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:29.484455 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:29.652412 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b4e60-6dd8-4f2f-bfc6-8a73acb06c2f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:49:29.740332 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:29.786607 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddd23e-02f5-4c8a-b224-7bffdc6fff93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:49:29.787253 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddd23e-02f5-4c8a-b224-7bffdc6fff93 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:29.787531 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddd23e-02f5-4c8a-b224-7bffdc6fff93 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:29.787802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddd23e-02f5-4c8a-b224-7bffdc6fff93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:29.789457 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-01ddd23e-02f5-4c8a-b224-7bffdc6fff93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:29.900530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddd23e-02f5-4c8a-b224-7bffdc6fff93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:49:29.902193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddd23e-02f5-4c8a-b224-7bffdc6fff93 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:49:29.923313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 698/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:49:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:49:39.184477 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=67 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:39.923415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=61 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:43.471882 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1105042-13f4-4164-b60e-aba0bc83b406 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:43.472477 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1105042-13f4-4164-b60e-aba0bc83b406 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:43.472477 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1105042-13f4-4164-b60e-aba0bc83b406 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:43.473828 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 712/1410] 10.222.0.15 () {54 vars in 918 bytes} [Fri Sep 9 20:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:43.478757 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26edacc-ae4b-4b2e-a5aa-5432910a6837 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:43.479150 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26edacc-ae4b-4b2e-a5aa-5432910a6837 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:43.479300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26edacc-ae4b-4b2e-a5aa-5432910a6837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:43.556326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f26edacc-ae4b-4b2e-a5aa-5432910a6837 None None] MFA Rules not processed for user `0fc28d9a1b3f4feca0deeb5f266f8b37`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:43.557569 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f26edacc-ae4b-4b2e-a5aa-5432910a6837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:43.664647 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 699/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Fri Sep 9 20:49:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:43.679328 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58b3b6-0e8a-4ce4-a234-d2b3c1466f59 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:43.679610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58b3b6-0e8a-4ce4-a234-d2b3c1466f59 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:43.679882 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58b3b6-0e8a-4ce4-a234-d2b3c1466f59 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:43.681236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 713/1412] 10.222.0.15 () {54 vars in 918 bytes} [Fri Sep 9 20:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:43.685923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8160d8-9a3b-4176-9d36-756d2e1c2474 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:43.686211 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8160d8-9a3b-4176-9d36-756d2e1c2474 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:43.686486 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8160d8-9a3b-4176-9d36-756d2e1c2474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:43.759244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:43.761880 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6d8160d8-9a3b-4176-9d36-756d2e1c2474 None None] MFA Rules not processed for user `dc210376e57a41e6b3812110db249099`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:43.763688 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6d8160d8-9a3b-4176-9d36-756d2e1c2474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:43.881149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 700/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Fri Sep 9 20:49:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:46.449214 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e4a38-b650-494e-a1b2-f75c28013e17 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:46.449765 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e4a38-b650-494e-a1b2-f75c28013e17 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:46.449765 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e4a38-b650-494e-a1b2-f75c28013e17 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:46.451123 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 20:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:46.457468 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebf7c0-f80a-47b3-9118-2162438f0085 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:46.457901 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebf7c0-f80a-47b3-9118-2162438f0085 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:46.458022 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebf7c0-f80a-47b3-9118-2162438f0085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:46.524611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-89ebf7c0-f80a-47b3-9118-2162438f0085 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:46.525821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-89ebf7c0-f80a-47b3-9118-2162438f0085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:46.580864 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:46.622986 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 20:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:46.915565 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e4a38-b650-494e-a1b2-f75c28013e17 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:49:46.917185 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ed1e4a38-b650-494e-a1b2-f75c28013e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:47.062576 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e4a38-b650-494e-a1b2-f75c28013e17 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:49:47.133726 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:47.173764 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae51e2a-dcb0-438c-9b90-f0fe8a0feb53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:49:47.175109 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae51e2a-dcb0-438c-9b90-f0fe8a0feb53 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:47.175401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae51e2a-dcb0-438c-9b90-f0fe8a0feb53 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:47.175669 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae51e2a-dcb0-438c-9b90-f0fe8a0feb53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:47.177340 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fae51e2a-dcb0-438c-9b90-f0fe8a0feb53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:47.266575 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae51e2a-dcb0-438c-9b90-f0fe8a0feb53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:49:47.268300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae51e2a-dcb0-438c-9b90-f0fe8a0feb53 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:49:47.286771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 715/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:49:48.427750 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a04d33-6908-430f-a041-fd4a0bf19c9f None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:48.428345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a04d33-6908-430f-a041-fd4a0bf19c9f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:48.428345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a04d33-6908-430f-a041-fd4a0bf19c9f None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:48.429682 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 20:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:48.435854 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c7a40-1f85-4bec-a5f3-981c55c5e2af None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:48.436322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c7a40-1f85-4bec-a5f3-981c55c5e2af None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:48.436447 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c7a40-1f85-4bec-a5f3-981c55c5e2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:48.513374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-027c7a40-1f85-4bec-a5f3-981c55c5e2af None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:48.514623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-027c7a40-1f85-4bec-a5f3-981c55c5e2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:48.541954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:48.610500 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 20:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:48.758492 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a04d33-6908-430f-a041-fd4a0bf19c9f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:49:48.760056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-31a04d33-6908-430f-a041-fd4a0bf19c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:48.907126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a04d33-6908-430f-a041-fd4a0bf19c9f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:49:48.947185 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:49.021154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab2c2d-2d50-4dfd-a1bd-4a563fbef446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:49:49.021761 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab2c2d-2d50-4dfd-a1bd-4a563fbef446 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:49.022042 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab2c2d-2d50-4dfd-a1bd-4a563fbef446 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:49.022317 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab2c2d-2d50-4dfd-a1bd-4a563fbef446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:49.023902 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4cab2c2d-2d50-4dfd-a1bd-4a563fbef446 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:49.113268 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab2c2d-2d50-4dfd-a1bd-4a563fbef446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:49:49.114875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab2c2d-2d50-4dfd-a1bd-4a563fbef446 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:49:49.132610 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 703/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:49:50.265361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32ef62-3db2-4104-a806-8c127a242850 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:50.265884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32ef62-3db2-4104-a806-8c127a242850 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:50.265884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32ef62-3db2-4104-a806-8c127a242850 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:50.267177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 20:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:50.273673 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331ec03-b6eb-42de-9920-83c77beb36fd None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:50.274089 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331ec03-b6eb-42de-9920-83c77beb36fd None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:50.274213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331ec03-b6eb-42de-9920-83c77beb36fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:50.330009 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:50.352035 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b331ec03-b6eb-42de-9920-83c77beb36fd None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:50.353293 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b331ec03-b6eb-42de-9920-83c77beb36fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:50.452998 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 20:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:50.601742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32ef62-3db2-4104-a806-8c127a242850 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:49:50.603209 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4b32ef62-3db2-4104-a806-8c127a242850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:50.748952 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32ef62-3db2-4104-a806-8c127a242850 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:49:50.760773 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:50.863879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f080f-36a5-4b17-ae6d-9bab8aef8d99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:49:50.864671 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f080f-36a5-4b17-ae6d-9bab8aef8d99 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:50.865061 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f080f-36a5-4b17-ae6d-9bab8aef8d99 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:50.866309 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f080f-36a5-4b17-ae6d-9bab8aef8d99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:50.866911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e43f080f-36a5-4b17-ae6d-9bab8aef8d99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:50.958949 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f080f-36a5-4b17-ae6d-9bab8aef8d99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:49:50.960569 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f080f-36a5-4b17-ae6d-9bab8aef8d99 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:49:50.979029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 718/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:49:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:49:52.092502 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125342-056e-4569-8b69-67f6c01547a7 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:52.093055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125342-056e-4569-8b69-67f6c01547a7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:52.093055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d125342-056e-4569-8b69-67f6c01547a7 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:52.094423 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 20:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:52.100904 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d38a94-4f7f-43ef-8d61-9affea003d2e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:52.101366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d38a94-4f7f-43ef-8d61-9affea003d2e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:52.101464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d38a94-4f7f-43ef-8d61-9affea003d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:52.121668 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:52.178852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-20d38a94-4f7f-43ef-8d61-9affea003d2e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:52.180076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-20d38a94-4f7f-43ef-8d61-9affea003d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:52.273913 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 20:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:52.428885 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d125342-056e-4569-8b69-67f6c01547a7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:49:52.430432 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8d125342-056e-4569-8b69-67f6c01547a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:52.541233 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:52.578374 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d125342-056e-4569-8b69-67f6c01547a7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:49:52.693552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd785b95-4092-4de6-95e3-95cf92dc6c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:49:52.694156 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd785b95-4092-4de6-95e3-95cf92dc6c98 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:52.694432 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd785b95-4092-4de6-95e3-95cf92dc6c98 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:52.694702 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd785b95-4092-4de6-95e3-95cf92dc6c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:52.696306 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bd785b95-4092-4de6-95e3-95cf92dc6c98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:52.770663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:52.784377 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd785b95-4092-4de6-95e3-95cf92dc6c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:49:52.786151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd785b95-4092-4de6-95e3-95cf92dc6c98 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:49:52.804881 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 706/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:49:53.917153 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f372100-37af-42dd-b5a2-6e87fba5e260 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:53.917719 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f372100-37af-42dd-b5a2-6e87fba5e260 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:53.917719 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f372100-37af-42dd-b5a2-6e87fba5e260 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:53.919063 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 20:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:53.925246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c952639-679d-4d85-a5a2-7c12ee5f1df7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:53.925684 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c952639-679d-4d85-a5a2-7c12ee5f1df7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:53.925841 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c952639-679d-4d85-a5a2-7c12ee5f1df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:54.001673 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2c952639-679d-4d85-a5a2-7c12ee5f1df7 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:54.002874 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2c952639-679d-4d85-a5a2-7c12ee5f1df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:54.100495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 20:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:54.248631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f372100-37af-42dd-b5a2-6e87fba5e260 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:49:54.250074 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8f372100-37af-42dd-b5a2-6e87fba5e260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:54.336367 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:54.398696 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f372100-37af-42dd-b5a2-6e87fba5e260 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:49:54.511003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ca892-e153-49b2-bec7-7f68d7c15507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:49:54.511525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ca892-e153-49b2-bec7-7f68d7c15507 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:54.511799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ca892-e153-49b2-bec7-7f68d7c15507 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:54.512095 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ca892-e153-49b2-bec7-7f68d7c15507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:54.513687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-db8ca892-e153-49b2-bec7-7f68d7c15507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:54.565686 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:54.607333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ca892-e153-49b2-bec7-7f68d7c15507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:49:54.608955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ca892-e153-49b2-bec7-7f68d7c15507 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:49:54.627317 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 721/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:49:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:49:55.676256 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26154fb-a26a-4656-9e12-ca9ad157e777 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:55.676783 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26154fb-a26a-4656-9e12-ca9ad157e777 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:55.676783 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26154fb-a26a-4656-9e12-ca9ad157e777 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:55.678136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 20:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:55.684310 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db806e71-2004-4bf8-8bea-94ff4bfcad49 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:55.684722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db806e71-2004-4bf8-8bea-94ff4bfcad49 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:55.684866 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db806e71-2004-4bf8-8bea-94ff4bfcad49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:55.760759 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-db806e71-2004-4bf8-8bea-94ff4bfcad49 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:55.761963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-db806e71-2004-4bf8-8bea-94ff4bfcad49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:55.858959 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 20:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:56.008077 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26154fb-a26a-4656-9e12-ca9ad157e777 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:49:56.009610 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d26154fb-a26a-4656-9e12-ca9ad157e777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:56.060196 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:56.156809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26154fb-a26a-4656-9e12-ca9ad157e777 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:49:56.280874 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e7069-8eea-4e4c-8f39-5f1ba5839e95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:49:56.281407 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e7069-8eea-4e4c-8f39-5f1ba5839e95 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:56.281689 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e7069-8eea-4e4c-8f39-5f1ba5839e95 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:56.281964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e7069-8eea-4e4c-8f39-5f1ba5839e95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:56.283573 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-244e7069-8eea-4e4c-8f39-5f1ba5839e95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:56.291489 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:56.375592 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e7069-8eea-4e4c-8f39-5f1ba5839e95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:49:56.377242 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e7069-8eea-4e4c-8f39-5f1ba5839e95 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:49:56.395817 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 709/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:49:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:49:57.445825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b690c4-4cee-426b-ad44-c037dcd12300 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:57.446358 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b690c4-4cee-426b-ad44-c037dcd12300 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:57.446358 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b690c4-4cee-426b-ad44-c037dcd12300 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:57.447718 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 20:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:57.454079 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683834c8-81bc-4658-994b-7bfb6586fa2a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:57.454515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683834c8-81bc-4658-994b-7bfb6586fa2a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:57.454755 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683834c8-81bc-4658-994b-7bfb6586fa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:57.537182 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-683834c8-81bc-4658-994b-7bfb6586fa2a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:57.538395 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-683834c8-81bc-4658-994b-7bfb6586fa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:57.613936 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:57.645169 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 20:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:49:57.796519 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b690c4-4cee-426b-ad44-c037dcd12300 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:49:57.798055 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c9b690c4-4cee-426b-ad44-c037dcd12300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:57.817689 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:57.947539 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b690c4-4cee-426b-ad44-c037dcd12300 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:49:58.034584 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:58.060765 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c18fe-6fa8-4393-8f70-da9563af94e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:49:58.061362 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c18fe-6fa8-4393-8f70-da9563af94e0 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:58.061636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c18fe-6fa8-4393-8f70-da9563af94e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:58.061904 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c18fe-6fa8-4393-8f70-da9563af94e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:58.063475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ea4c18fe-6fa8-4393-8f70-da9563af94e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:58.269872 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c18fe-6fa8-4393-8f70-da9563af94e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:49:58.271370 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c18fe-6fa8-4393-8f70-da9563af94e0 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:49:58.290731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 724/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:49:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:49:59.351060 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e966708-ab1f-4be6-8f22-4ee40e535195 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:59.351568 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e966708-ab1f-4be6-8f22-4ee40e535195 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:59.351667 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e966708-ab1f-4be6-8f22-4ee40e535195 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:59.353007 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 20:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:49:59.359320 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e8e26-5520-4627-a1d5-a4dd5331e141 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:59.359771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e8e26-5520-4627-a1d5-a4dd5331e141 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:59.359877 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e8e26-5520-4627-a1d5-a4dd5331e141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:59.435453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-893e8e26-5520-4627-a1d5-a4dd5331e141 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:49:59.436692 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-893e8e26-5520-4627-a1d5-a4dd5331e141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:59.478595 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:59.537195 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 20:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:49:59.689252 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e966708-ab1f-4be6-8f22-4ee40e535195 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:49:59.690768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9e966708-ab1f-4be6-8f22-4ee40e535195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:49:59.839140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e966708-ab1f-4be6-8f22-4ee40e535195 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:49:59.893397 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:49:59.953312 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c483a8-2d1b-4e57-a8b6-cf2a33c3b3ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:49:59.953929 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c483a8-2d1b-4e57-a8b6-cf2a33c3b3ee service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:49:59.954212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c483a8-2d1b-4e57-a8b6-cf2a33c3b3ee service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:49:59.954484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c483a8-2d1b-4e57-a8b6-cf2a33c3b3ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:49:59.956111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-13c483a8-2d1b-4e57-a8b6-cf2a33c3b3ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:00.046833 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c483a8-2d1b-4e57-a8b6-cf2a33c3b3ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:50:00.048478 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c483a8-2d1b-4e57-a8b6-cf2a33c3b3ee service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:50:00.067145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 712/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:49:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:50:01.117090 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff8d75-c5c6-4c35-a40b-004b5b7f2173 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:01.117661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff8d75-c5c6-4c35-a40b-004b5b7f2173 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:01.117661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff8d75-c5c6-4c35-a40b-004b5b7f2173 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:01.119031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 20:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:50:01.125330 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ba765-28c9-4a00-9730-1a01b28772f7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:01.125745 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ba765-28c9-4a00-9730-1a01b28772f7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:01.125902 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ba765-28c9-4a00-9730-1a01b28772f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:01.203829 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-913ba765-28c9-4a00-9730-1a01b28772f7 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:50:01.205081 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-913ba765-28c9-4a00-9730-1a01b28772f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:01.207951 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:01.302916 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 20:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:50:01.452161 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff8d75-c5c6-4c35-a40b-004b5b7f2173 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:50:01.453669 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6dff8d75-c5c6-4c35-a40b-004b5b7f2173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:01.596119 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff8d75-c5c6-4c35-a40b-004b5b7f2173 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:50:01.623966 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:01.709152 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad74bbee-f34a-4e34-bad6-0c3bc35b1c7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:50:01.709681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74bbee-f34a-4e34-bad6-0c3bc35b1c7e service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:01.709956 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74bbee-f34a-4e34-bad6-0c3bc35b1c7e service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:01.710223 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74bbee-f34a-4e34-bad6-0c3bc35b1c7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:01.711828 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ad74bbee-f34a-4e34-bad6-0c3bc35b1c7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:01.798584 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74bbee-f34a-4e34-bad6-0c3bc35b1c7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:50:01.800200 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad74bbee-f34a-4e34-bad6-0c3bc35b1c7e service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:50:01.819704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 727/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:50:03.880117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2607e4d-e685-4e0a-afa5-2ac8c5e3e8b5 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:03.880688 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2607e4d-e685-4e0a-afa5-2ac8c5e3e8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:03.880688 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2607e4d-e685-4e0a-afa5-2ac8c5e3e8b5 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:03.882006 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 20:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:50:03.887247 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846c801-e8cd-4fcb-8246-6f38f0d01973 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:03.887646 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846c801-e8cd-4fcb-8246-6f38f0d01973 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:03.887791 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846c801-e8cd-4fcb-8246-6f38f0d01973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:03.928992 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:03.954385 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c846c801-e8cd-4fcb-8246-6f38f0d01973 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:50:03.955583 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c846c801-e8cd-4fcb-8246-6f38f0d01973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:04.054721 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 20:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:50:04.342289 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2607e4d-e685-4e0a-afa5-2ac8c5e3e8b5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:50:04.343854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f2607e4d-e685-4e0a-afa5-2ac8c5e3e8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:04.447623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2607e4d-e685-4e0a-afa5-2ac8c5e3e8b5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:50:04.480164 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:04.522146 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f5001-574c-450f-8630-e994d2819bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:50:04.522750 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f5001-574c-450f-8630-e994d2819bcf service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:04.523030 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f5001-574c-450f-8630-e994d2819bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:04.523301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f5001-574c-450f-8630-e994d2819bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:04.524922 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3a1f5001-574c-450f-8630-e994d2819bcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:04.632719 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f5001-574c-450f-8630-e994d2819bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:50:04.634088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f5001-574c-450f-8630-e994d2819bcf service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:50:04.652271 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 715/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:50:06.928112 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccec022-5dd5-4a72-bfc7-cdf1efa2db4c None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:06.928706 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccec022-5dd5-4a72-bfc7-cdf1efa2db4c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:06.928706 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccec022-5dd5-4a72-bfc7-cdf1efa2db4c None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:06.929988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 20:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:50:06.935245 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ad05f-e4de-495f-89cb-1f65495ad471 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:06.935683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ad05f-e4de-495f-89cb-1f65495ad471 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:06.935789 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ad05f-e4de-495f-89cb-1f65495ad471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:07.002243 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ff9ad05f-e4de-495f-89cb-1f65495ad471 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:50:07.004069 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ff9ad05f-e4de-495f-89cb-1f65495ad471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:07.016775 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:07.099557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 20:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:50:07.386969 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccec022-5dd5-4a72-bfc7-cdf1efa2db4c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:50:07.388542 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5ccec022-5dd5-4a72-bfc7-cdf1efa2db4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:07.491241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccec022-5dd5-4a72-bfc7-cdf1efa2db4c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:50:07.504080 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:07.565117 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521d1dc-29e1-45ca-8dab-c0388c7e0d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:50:07.565636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521d1dc-29e1-45ca-8dab-c0388c7e0d79 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:07.565919 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521d1dc-29e1-45ca-8dab-c0388c7e0d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:07.566187 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521d1dc-29e1-45ca-8dab-c0388c7e0d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:07.567955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4521d1dc-29e1-45ca-8dab-c0388c7e0d79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:07.679457 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521d1dc-29e1-45ca-8dab-c0388c7e0d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:50:07.680969 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521d1dc-29e1-45ca-8dab-c0388c7e0d79 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:50:07.699429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 730/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:50:10.174537 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976af41-3ae5-412c-a95c-aa2c9ad91d2b None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:10.175138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976af41-3ae5-412c-a95c-aa2c9ad91d2b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:10.175138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976af41-3ae5-412c-a95c-aa2c9ad91d2b None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:10.177102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 20:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:50:10.182608 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c7fe5-ac3e-40b8-8892-a21c6c18ff73 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:10.183031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c7fe5-ac3e-40b8-8892-a21c6c18ff73 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:10.183181 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c7fe5-ac3e-40b8-8892-a21c6c18ff73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:10.229882 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:10.248886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-987c7fe5-ac3e-40b8-8892-a21c6c18ff73 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:50:10.250085 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-987c7fe5-ac3e-40b8-8892-a21c6c18ff73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:10.346012 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 20:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:50:10.631555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976af41-3ae5-412c-a95c-aa2c9ad91d2b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:50:10.633150 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9976af41-3ae5-412c-a95c-aa2c9ad91d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:10.737732 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976af41-3ae5-412c-a95c-aa2c9ad91d2b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:50:10.777450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:10.812261 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97a2ec9-83a4-42d2-82a7-0bdc76146cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:50:10.812889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a2ec9-83a4-42d2-82a7-0bdc76146cfd service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:10.813165 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a2ec9-83a4-42d2-82a7-0bdc76146cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:10.813432 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a2ec9-83a4-42d2-82a7-0bdc76146cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:10.815045 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a97a2ec9-83a4-42d2-82a7-0bdc76146cfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:10.922204 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a2ec9-83a4-42d2-82a7-0bdc76146cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:50:10.923635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97a2ec9-83a4-42d2-82a7-0bdc76146cfd service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:50:10.941980 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 718/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:50:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:50:13.227934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c598d8-6f88-4524-8f60-85bedee7ee9f None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:13.228518 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c598d8-6f88-4524-8f60-85bedee7ee9f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:13.228518 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c598d8-6f88-4524-8f60-85bedee7ee9f None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:13.229887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 20:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:50:13.235228 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdd49d-5bde-4a87-b8b2-63a486115531 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:13.235621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdd49d-5bde-4a87-b8b2-63a486115531 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:13.235782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdd49d-5bde-4a87-b8b2-63a486115531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:13.304680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b8fdd49d-5bde-4a87-b8b2-63a486115531 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:50:13.305911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b8fdd49d-5bde-4a87-b8b2-63a486115531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:13.327393 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:13.521502 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:50:13.808455 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c598d8-6f88-4524-8f60-85bedee7ee9f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:50:13.809992 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-01c598d8-6f88-4524-8f60-85bedee7ee9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:13.915066 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c598d8-6f88-4524-8f60-85bedee7ee9f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:50:13.936187 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:13.990011 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa74b84-91f2-41cc-b345-94db329d3b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:50:13.990613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa74b84-91f2-41cc-b345-94db329d3b18 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:13.990896 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa74b84-91f2-41cc-b345-94db329d3b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:13.991167 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa74b84-91f2-41cc-b345-94db329d3b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:13.992797 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aaa74b84-91f2-41cc-b345-94db329d3b18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:14.100085 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa74b84-91f2-41cc-b345-94db329d3b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:50:14.101465 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa74b84-91f2-41cc-b345-94db329d3b18 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:50:14.119742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 733/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:50:16.473544 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a419a8-3ff5-4571-948a-1ee11ef10aa4 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:16.474099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a419a8-3ff5-4571-948a-1ee11ef10aa4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:16.474099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a419a8-3ff5-4571-948a-1ee11ef10aa4 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:16.475435 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 20:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:50:16.480773 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede751f-2cc5-4ceb-84e2-485526d45815 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:16.481187 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede751f-2cc5-4ceb-84e2-485526d45815 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:16.481318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede751f-2cc5-4ceb-84e2-485526d45815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:16.544911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:16.547839 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-eede751f-2cc5-4ceb-84e2-485526d45815 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:50:16.549444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-eede751f-2cc5-4ceb-84e2-485526d45815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:16.645246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 20:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:50:16.933063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a419a8-3ff5-4571-948a-1ee11ef10aa4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:50:16.934609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c0a419a8-3ff5-4571-948a-1ee11ef10aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:17.037254 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a419a8-3ff5-4571-948a-1ee11ef10aa4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:50:17.085150 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:17.109639 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b10d03-0f6a-4689-969b-fb2f802f7fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:50:17.110237 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b10d03-0f6a-4689-969b-fb2f802f7fcd service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:17.110510 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b10d03-0f6a-4689-969b-fb2f802f7fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:17.110772 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b10d03-0f6a-4689-969b-fb2f802f7fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:17.112376 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a3b10d03-0f6a-4689-969b-fb2f802f7fcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:17.219864 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b10d03-0f6a-4689-969b-fb2f802f7fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:50:17.221267 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b10d03-0f6a-4689-969b-fb2f802f7fcd service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:50:17.240197 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 721/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:50:19.447855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accf2f8-78f9-413b-8bd8-6ce380e6589d None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:19.448445 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accf2f8-78f9-413b-8bd8-6ce380e6589d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:19.448445 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accf2f8-78f9-413b-8bd8-6ce380e6589d None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:19.449776 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 20:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:50:19.454953 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aee49b-6be8-4198-b0fa-10a2905fad9f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:19.455371 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aee49b-6be8-4198-b0fa-10a2905fad9f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:19.455509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aee49b-6be8-4198-b0fa-10a2905fad9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:19.524679 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-93aee49b-6be8-4198-b0fa-10a2905fad9f None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:50:19.525917 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-93aee49b-6be8-4198-b0fa-10a2905fad9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:19.555580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:19.622780 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 20:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:50:19.906797 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accf2f8-78f9-413b-8bd8-6ce380e6589d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:50:19.908372 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7accf2f8-78f9-413b-8bd8-6ce380e6589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:20.014010 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accf2f8-78f9-413b-8bd8-6ce380e6589d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:50:20.043230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:20.089591 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6f56d-98ad-4493-8c23-835800961bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:50:20.090185 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6f56d-98ad-4493-8c23-835800961bbe service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:20.090459 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6f56d-98ad-4493-8c23-835800961bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:20.090727 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6f56d-98ad-4493-8c23-835800961bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:20.092326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f9e6f56d-98ad-4493-8c23-835800961bbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:20.199199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6f56d-98ad-4493-8c23-835800961bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:50:20.200658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e6f56d-98ad-4493-8c23-835800961bbe service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:50:20.219397 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 736/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:50:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:50:22.416132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3e4b7-7c68-4b6c-a76f-1bb865668ac4 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:22.416680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3e4b7-7c68-4b6c-a76f-1bb865668ac4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:22.416680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc3e4b7-7c68-4b6c-a76f-1bb865668ac4 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:22.418017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 20:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:50:22.423384 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09dd79-09d5-44b8-a648-abd36fdc88d6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:22.423782 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09dd79-09d5-44b8-a648-abd36fdc88d6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:22.423953 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c09dd79-09d5-44b8-a648-abd36fdc88d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:22.490202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5c09dd79-09d5-44b8-a648-abd36fdc88d6 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:50:22.491409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5c09dd79-09d5-44b8-a648-abd36fdc88d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:22.499526 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:22.588050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 20:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:50:22.870630 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3e4b7-7c68-4b6c-a76f-1bb865668ac4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:50:22.872255 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3dc3e4b7-7c68-4b6c-a76f-1bb865668ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:22.976209 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc3e4b7-7c68-4b6c-a76f-1bb865668ac4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:50:23.031542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:23.049910 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e1bd1-5833-440f-b9c7-f12b1bda74e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:50:23.050515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e1bd1-5833-440f-b9c7-f12b1bda74e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:23.050795 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e1bd1-5833-440f-b9c7-f12b1bda74e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:23.051066 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e1bd1-5833-440f-b9c7-f12b1bda74e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:23.052681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f05e1bd1-5833-440f-b9c7-f12b1bda74e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:23.161553 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e1bd1-5833-440f-b9c7-f12b1bda74e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:50:23.163032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e1bd1-5833-440f-b9c7-f12b1bda74e8 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:50:23.181241 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 724/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:50:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:50:25.368367 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f750296-ea8a-4691-a947-5dafdc737fbb None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:25.368875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f750296-ea8a-4691-a947-5dafdc737fbb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:25.368971 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f750296-ea8a-4691-a947-5dafdc737fbb None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:25.370254 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 20:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:50:25.375452 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3c8c1-cc82-4293-b543-c26942a7143a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:25.376062 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3c8c1-cc82-4293-b543-c26942a7143a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:25.376340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3c8c1-cc82-4293-b543-c26942a7143a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:25.443489 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-05a3c8c1-cc82-4293-b543-c26942a7143a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:50:25.444773 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-05a3c8c1-cc82-4293-b543-c26942a7143a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:25.487511 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:25.547201 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 20:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:50:25.833002 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f750296-ea8a-4691-a947-5dafdc737fbb None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:50:25.834529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0f750296-ea8a-4691-a947-5dafdc737fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:25.937836 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f750296-ea8a-4691-a947-5dafdc737fbb None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:50:25.975938 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:26.012282 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b325f-acca-4734-b78b-5607823bb46d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:50:26.012885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b325f-acca-4734-b78b-5607823bb46d service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:26.013160 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b325f-acca-4734-b78b-5607823bb46d service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:26.013429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b325f-acca-4734-b78b-5607823bb46d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:26.015036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fd4b325f-acca-4734-b78b-5607823bb46d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:26.124239 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b325f-acca-4734-b78b-5607823bb46d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:50:26.125602 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b325f-acca-4734-b78b-5607823bb46d service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:50:26.143586 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 739/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:50:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:50:28.284844 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd705613-ef98-45af-90a1-89d25dafca19 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:28.285366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd705613-ef98-45af-90a1-89d25dafca19 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:28.285366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd705613-ef98-45af-90a1-89d25dafca19 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:28.286666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 20:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:50:28.292332 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b09ab8-88ba-48b6-bbc3-c425949c4cc0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:28.292742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b09ab8-88ba-48b6-bbc3-c425949c4cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:28.292959 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b09ab8-88ba-48b6-bbc3-c425949c4cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:28.359190 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-54b09ab8-88ba-48b6-bbc3-c425949c4cc0 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:50:28.360419 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-54b09ab8-88ba-48b6-bbc3-c425949c4cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:28.378626 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:28.457186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 20:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:50:28.740122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd705613-ef98-45af-90a1-89d25dafca19 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:50:28.741700 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fd705613-ef98-45af-90a1-89d25dafca19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:28.845127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd705613-ef98-45af-90a1-89d25dafca19 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:50:28.912209 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:28.918791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde6ebe-a24a-4faa-9768-c4a2c9fc4f20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:50:28.919397 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde6ebe-a24a-4faa-9768-c4a2c9fc4f20 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:28.919678 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde6ebe-a24a-4faa-9768-c4a2c9fc4f20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:28.919952 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde6ebe-a24a-4faa-9768-c4a2c9fc4f20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:28.921562 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ebde6ebe-a24a-4faa-9768-c4a2c9fc4f20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:29.028684 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde6ebe-a24a-4faa-9768-c4a2c9fc4f20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:50:29.030317 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde6ebe-a24a-4faa-9768-c4a2c9fc4f20 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:50:29.048732 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 727/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:50:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:50:31.206216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444a56e-9fc9-4c18-b609-f16605c7acf7 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:31.206780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444a56e-9fc9-4c18-b609-f16605c7acf7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:31.207014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444a56e-9fc9-4c18-b609-f16605c7acf7 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:31.208712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 20:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:50:31.213994 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484ca0b-42fc-4616-a837-ea900960f7ff None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:31.214393 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484ca0b-42fc-4616-a837-ea900960f7ff None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:31.214538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4484ca0b-42fc-4616-a837-ea900960f7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:31.279606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4484ca0b-42fc-4616-a837-ea900960f7ff None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:50:31.280831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4484ca0b-42fc-4616-a837-ea900960f7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:31.329953 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:31.382851 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 20:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:50:31.666694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444a56e-9fc9-4c18-b609-f16605c7acf7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:50:31.668279 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5444a56e-9fc9-4c18-b609-f16605c7acf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:31.770243 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444a56e-9fc9-4c18-b609-f16605c7acf7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:50:31.818729 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:31.844115 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ff960-3774-468f-8ee2-21ba74fd0d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:50:31.844719 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ff960-3774-468f-8ee2-21ba74fd0d01 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:31.844995 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ff960-3774-468f-8ee2-21ba74fd0d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:31.845267 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ff960-3774-468f-8ee2-21ba74fd0d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:31.847629 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e03ff960-3774-468f-8ee2-21ba74fd0d01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:31.954045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ff960-3774-468f-8ee2-21ba74fd0d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:50:31.955448 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ff960-3774-468f-8ee2-21ba74fd0d01 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:50:31.974665 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 742/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:50:41.381294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=22 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:41.972229 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=66 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:51.969564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ef73d-eeb6-4569-9da8-a39717dbf51e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:51.969989 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ef73d-eeb6-4569-9da8-a39717dbf51e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:51.970116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ef73d-eeb6-4569-9da8-a39717dbf51e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:51.972284 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 729/1471] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:50:51.977670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9285cf-6541-4aa0-af73-88ae1fd8f7fb None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:51.978103 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9285cf-6541-4aa0-af73-88ae1fd8f7fb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:51.978228 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9285cf-6541-4aa0-af73-88ae1fd8f7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:52.044732 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8c9285cf-6541-4aa0-af73-88ae1fd8f7fb None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:50:52.045940 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8c9285cf-6541-4aa0-af73-88ae1fd8f7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:52.140485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 743/1472] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:50:52.446568 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159083aa-e4fc-47b9-8200-4751ab92a1e5 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:52.446853 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159083aa-e4fc-47b9-8200-4751ab92a1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:52.447129 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159083aa-e4fc-47b9-8200-4751ab92a1e5 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:52.448483 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 730/1473] 10.222.0.15 () {54 vars in 966 bytes} [Fri Sep 9 20:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:50:52.453544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca2105-caab-4a23-a925-8f7f5dbe6170 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:52.453833 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca2105-caab-4a23-a925-8f7f5dbe6170 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:52.454110 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca2105-caab-4a23-a925-8f7f5dbe6170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:52.530800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-61ca2105-caab-4a23-a925-8f7f5dbe6170 None None] MFA Rules not processed for user `8d298efe48464956b7a03cba1001060b`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:50:52.532043 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-61ca2105-caab-4a23-a925-8f7f5dbe6170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:52.553316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:52.608613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 744/1474] 10.222.0.15 () {58 vars in 1063 bytes} [Fri Sep 9 20:50:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:50:52.616401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159083aa-e4fc-47b9-8200-4751ab92a1e5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:50:52.617914 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-159083aa-e4fc-47b9-8200-4751ab92a1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:52.722191 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159083aa-e4fc-47b9-8200-4751ab92a1e5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:50:52.795272 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541ca56-e543-4d8b-8d4b-b2896effa6e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d298efe48464956b7a03cba1001060b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:50:52.795870 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541ca56-e543-4d8b-8d4b-b2896effa6e4 service glance] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:52.796207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541ca56-e543-4d8b-8d4b-b2896effa6e4 service glance] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:52.796461 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541ca56-e543-4d8b-8d4b-b2896effa6e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:52.798048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4541ca56-e543-4d8b-8d4b-b2896effa6e4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:52.852245 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:52.907925 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541ca56-e543-4d8b-8d4b-b2896effa6e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:50:52.909806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541ca56-e543-4d8b-8d4b-b2896effa6e4 service glance] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:50:52.928717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 731/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:50:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:50:55.164152 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00795998-f2b2-429c-9395-3bb8d4e464b6 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:55.164742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00795998-f2b2-429c-9395-3bb8d4e464b6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:55.164742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00795998-f2b2-429c-9395-3bb8d4e464b6 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:55.166100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 745/1476] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:50:55.171412 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c789edc-fb9b-450a-a9f0-72d86cafd04a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:55.171806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c789edc-fb9b-450a-a9f0-72d86cafd04a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:55.171961 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c789edc-fb9b-450a-a9f0-72d86cafd04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:55.237162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1c789edc-fb9b-450a-a9f0-72d86cafd04a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:50:55.238360 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1c789edc-fb9b-450a-a9f0-72d86cafd04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:55.344149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 732/1477] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:50:55.617337 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00795998-f2b2-429c-9395-3bb8d4e464b6 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:50:55.618836 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-00795998-f2b2-429c-9395-3bb8d4e464b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:55.748552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00795998-f2b2-429c-9395-3bb8d4e464b6 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:50:55.799125 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:55.846242 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e48e2b-cf1a-4114-be96-c6f592a81dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:50:55.846902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e48e2b-cf1a-4114-be96-c6f592a81dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:55.847182 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e48e2b-cf1a-4114-be96-c6f592a81dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:55.847455 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e48e2b-cf1a-4114-be96-c6f592a81dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:55.848133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e48e2b-cf1a-4114-be96-c6f592a81dc0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:50:55.849870 dv-cinder-831247-28-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-42e48e2b-cf1a-4114-be96-c6f592a81dc0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 20:50:55.849870 dv-cinder-831247-28-smb devstack@keystone.service[81397]: warnings.warn(msg) Sep 09 20:50:55.849870 dv-cinder-831247-28-smb devstack@keystone.service[81397]: Sep 09 20:50:55.851043 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e48e2b-cf1a-4114-be96-c6f592a81dc0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:50:55.871542 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 746/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Sep 9 20:50:55 2022] GET /identity/v3/projects => generated 2553 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:50:58.026530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8487b-1b2f-4af6-9402-e9278545d730 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:58.027063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8487b-1b2f-4af6-9402-e9278545d730 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:58.027063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8487b-1b2f-4af6-9402-e9278545d730 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:58.028439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 733/1479] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:50:58.034678 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab8f5e-9774-4037-a2ef-fa0f3ec0d407 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:58.035103 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab8f5e-9774-4037-a2ef-fa0f3ec0d407 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:58.035219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab8f5e-9774-4037-a2ef-fa0f3ec0d407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:58.101016 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b4ab8f5e-9774-4037-a2ef-fa0f3ec0d407 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:50:58.102234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b4ab8f5e-9774-4037-a2ef-fa0f3ec0d407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:58.198252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 747/1480] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:50:58.492363 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8487b-1b2f-4af6-9402-e9278545d730 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:50:58.493941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e3e8487b-1b2f-4af6-9402-e9278545d730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:58.504004 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:58.642242 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8487b-1b2f-4af6-9402-e9278545d730 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:50:58.724301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:50:58.757580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80fe11-7f6a-4f6a-9bf0-2c039fbf91e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:50:58.758179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80fe11-7f6a-4f6a-9bf0-2c039fbf91e4 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:50:58.758452 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80fe11-7f6a-4f6a-9bf0-2c039fbf91e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:50:58.758718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80fe11-7f6a-4f6a-9bf0-2c039fbf91e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:50:58.760327 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7a80fe11-7f6a-4f6a-9bf0-2c039fbf91e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:50:58.851806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80fe11-7f6a-4f6a-9bf0-2c039fbf91e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:50:58.853429 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80fe11-7f6a-4f6a-9bf0-2c039fbf91e4 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:50:58.870884 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 734/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:50:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:51:01.199241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8eefbc-f4f9-40f5-a57b-7b9412d739c6 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:51:01.199805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8eefbc-f4f9-40f5-a57b-7b9412d739c6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:51:01.199805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8eefbc-f4f9-40f5-a57b-7b9412d739c6 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:51:01.201192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 748/1482] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:51:01.207278 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f4136-aa69-45b2-b90b-f9d414f04c78 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:51:01.207725 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f4136-aa69-45b2-b90b-f9d414f04c78 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:51:01.207823 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f4136-aa69-45b2-b90b-f9d414f04c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:51:01.273114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ea2f4136-aa69-45b2-b90b-f9d414f04c78 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:51:01.274308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ea2f4136-aa69-45b2-b90b-f9d414f04c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:51:01.321475 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:51:01.372496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 735/1483] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:51:01.663055 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8eefbc-f4f9-40f5-a57b-7b9412d739c6 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:51:01.664690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3e8eefbc-f4f9-40f5-a57b-7b9412d739c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:51:01.688508 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:51:01.767510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8eefbc-f4f9-40f5-a57b-7b9412d739c6 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:51:01.840224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d67bad-c718-44cb-a251-574709747e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:51:01.840823 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d67bad-c718-44cb-a251-574709747e9c service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:51:01.841101 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d67bad-c718-44cb-a251-574709747e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:51:01.841371 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d67bad-c718-44cb-a251-574709747e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:51:01.842984 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-23d67bad-c718-44cb-a251-574709747e9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:51:01.919764 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:51:01.955718 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d67bad-c718-44cb-a251-574709747e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:51:01.957315 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d67bad-c718-44cb-a251-574709747e9c service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:51:01.978559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 749/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:51:04.193313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5e927-40d5-4644-a5ce-211ea72d162e None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:51:04.193903 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5e927-40d5-4644-a5ce-211ea72d162e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:51:04.193903 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5e927-40d5-4644-a5ce-211ea72d162e None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:51:04.195222 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 736/1485] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:51:04.200600 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3fcce-2928-4a2a-999b-2f1060363e93 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:51:04.201078 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3fcce-2928-4a2a-999b-2f1060363e93 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:51:04.201180 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3fcce-2928-4a2a-999b-2f1060363e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:51:04.266452 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6df3fcce-2928-4a2a-999b-2f1060363e93 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:51:04.268252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6df3fcce-2928-4a2a-999b-2f1060363e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:51:04.364135 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 750/1486] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:51:04.660272 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5e927-40d5-4644-a5ce-211ea72d162e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:51:04.661852 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b6d5e927-40d5-4644-a5ce-211ea72d162e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:51:04.763925 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5e927-40d5-4644-a5ce-211ea72d162e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:51:04.835512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:51:04.837262 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b871e0-c7a3-4790-afda-b2bde3c073e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:51:04.837835 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b871e0-c7a3-4790-afda-b2bde3c073e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:51:04.838299 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b871e0-c7a3-4790-afda-b2bde3c073e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:51:04.838738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b871e0-c7a3-4790-afda-b2bde3c073e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:51:04.840524 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-43b871e0-c7a3-4790-afda-b2bde3c073e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:51:04.949666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b871e0-c7a3-4790-afda-b2bde3c073e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:51:04.951108 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b871e0-c7a3-4790-afda-b2bde3c073e2 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:51:04.968652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 737/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:51:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:51:07.249268 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eb367-91cd-43cc-80ab-d9bbb0ec44f2 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:51:07.249834 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eb367-91cd-43cc-80ab-d9bbb0ec44f2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:51:07.249834 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eb367-91cd-43cc-80ab-d9bbb0ec44f2 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:51:07.251132 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 751/1488] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:51:07.256704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63e029-cad0-4878-97fc-fcc6efe29012 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:51:07.257147 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63e029-cad0-4878-97fc-fcc6efe29012 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:51:07.257262 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63e029-cad0-4878-97fc-fcc6efe29012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:51:07.324766 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3a63e029-cad0-4878-97fc-fcc6efe29012 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:51:07.325991 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3a63e029-cad0-4878-97fc-fcc6efe29012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:51:07.378486 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:51:07.422563 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 738/1489] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:51:07.719239 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eb367-91cd-43cc-80ab-d9bbb0ec44f2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:51:07.721062 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-229eb367-91cd-43cc-80ab-d9bbb0ec44f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:51:07.757168 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:51:07.826301 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eb367-91cd-43cc-80ab-d9bbb0ec44f2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:51:07.901682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab33b5c-12f7-4c6c-882b-f160d365f94d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:51:07.902283 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab33b5c-12f7-4c6c-882b-f160d365f94d service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:51:07.902562 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab33b5c-12f7-4c6c-882b-f160d365f94d service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:51:07.902837 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab33b5c-12f7-4c6c-882b-f160d365f94d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:51:07.904498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6ab33b5c-12f7-4c6c-882b-f160d365f94d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:51:07.988123 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:51:08.018060 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab33b5c-12f7-4c6c-882b-f160d365f94d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:51:08.019448 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab33b5c-12f7-4c6c-882b-f160d365f94d service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:51:08.037616 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 752/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:51:10.452628 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207c837-6970-48f3-861b-8f42b60513fb None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:51:10.453180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207c837-6970-48f3-861b-8f42b60513fb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:51:10.453180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207c837-6970-48f3-861b-8f42b60513fb None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:51:10.454529 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 739/1491] 10.222.0.15 () {54 vars in 927 bytes} [Fri Sep 9 20:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:51:10.460401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3692707-6cb3-45a4-b812-5be804f05f7a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:51:10.460846 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3692707-6cb3-45a4-b812-5be804f05f7a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:51:10.460955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3692707-6cb3-45a4-b812-5be804f05f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:51:10.526187 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b3692707-6cb3-45a4-b812-5be804f05f7a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:51:10.527423 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b3692707-6cb3-45a4-b812-5be804f05f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:51:10.622350 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 753/1492] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Sep 9 20:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:51:10.916737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207c837-6970-48f3-861b-8f42b60513fb None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:51:10.918306 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0207c837-6970-48f3-861b-8f42b60513fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:51:11.021041 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207c837-6970-48f3-861b-8f42b60513fb None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:51:11.094048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832ee9c-7728-4acb-a2e6-061386b2f9f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:51:11.094657 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832ee9c-7728-4acb-a2e6-061386b2f9f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:51:11.094940 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832ee9c-7728-4acb-a2e6-061386b2f9f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:51:11.095217 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832ee9c-7728-4acb-a2e6-061386b2f9f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:51:11.096992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5832ee9c-7728-4acb-a2e6-061386b2f9f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:51:11.105821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:51:11.210067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832ee9c-7728-4acb-a2e6-061386b2f9f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:51:11.211432 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832ee9c-7728-4acb-a2e6-061386b2f9f9 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:51:11.229301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 740/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:51:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:51:20.620687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=82 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:51:21.227118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=50 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:52:23.813520 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51695d-d8ca-45d9-a6d5-4b62aa483cb3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:52:23.814285 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51695d-d8ca-45d9-a6d5-4b62aa483cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:52:23.814285 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51695d-d8ca-45d9-a6d5-4b62aa483cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:52:23.890456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ac51695d-d8ca-45d9-a6d5-4b62aa483cb3 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:52:23.891849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ac51695d-d8ca-45d9-a6d5-4b62aa483cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:52:23.988999 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 754/1494] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:52:23.997110 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e7c31-4e8c-4f36-99d2-a95636556934 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:52:23.997587 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e7c31-4e8c-4f36-99d2-a95636556934 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:52:23.997702 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e7c31-4e8c-4f36-99d2-a95636556934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:52:24.074484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c79e7c31-4e8c-4f36-99d2-a95636556934 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:52:24.075631 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c79e7c31-4e8c-4f36-99d2-a95636556934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:52:24.171778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 741/1495] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:52:24.177192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51695d-d8ca-45d9-a6d5-4b62aa483cb3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:52:24.178423 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ac51695d-d8ca-45d9-a6d5-4b62aa483cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:52:24.189979 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51695d-d8ca-45d9-a6d5-4b62aa483cb3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:52:24.251531 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:52:24.287896 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9ed6d-3687-4f02-8ef8-01be7f54bb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:52:24.288532 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9ed6d-3687-4f02-8ef8-01be7f54bb57 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:52:24.288803 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9ed6d-3687-4f02-8ef8-01be7f54bb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:52:24.289065 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9ed6d-3687-4f02-8ef8-01be7f54bb57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:52:24.289698 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9ed6d-3687-4f02-8ef8-01be7f54bb57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:52:24.289993 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9ed6d-3687-4f02-8ef8-01be7f54bb57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:52:24.291071 dv-cinder-831247-28-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-3cf9ed6d-3687-4f02-8ef8-01be7f54bb57 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 20:52:24.291071 dv-cinder-831247-28-smb devstack@keystone.service[81397]: warnings.warn(msg) Sep 09 20:52:24.291071 dv-cinder-831247-28-smb devstack@keystone.service[81397]: Sep 09 20:52:24.291949 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9ed6d-3687-4f02-8ef8-01be7f54bb57 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:52:24.305162 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 755/1496] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:52:24.313813 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e7c31-4e8c-4f36-99d2-a95636556934 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:52:24.323056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e7c31-4e8c-4f36-99d2-a95636556934 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:52:24.386423 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:52:24.420770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a91731-d49b-42b4-a273-4ff5f46cfb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:52:24.421373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a91731-d49b-42b4-a273-4ff5f46cfb48 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:52:24.421649 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a91731-d49b-42b4-a273-4ff5f46cfb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:52:24.422504 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a91731-d49b-42b4-a273-4ff5f46cfb48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:52:24.423262 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a91731-d49b-42b4-a273-4ff5f46cfb48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:52:24.425025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-70a91731-d49b-42b4-a273-4ff5f46cfb48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 20:52:24.425025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: warnings.warn(msg) Sep 09 20:52:24.425025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: Sep 09 20:52:24.426205 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a91731-d49b-42b4-a273-4ff5f46cfb48 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:52:24.482547 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 742/1497] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:52:24 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:52:24.486675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9ed6d-3687-4f02-8ef8-01be7f54bb57 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:52:24.488235 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3cf9ed6d-3687-4f02-8ef8-01be7f54bb57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:52:24.521424 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9ed6d-3687-4f02-8ef8-01be7f54bb57 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:52:24.614631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181276d6-426e-4acc-9cd3-0c203fb82b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:52:24.615223 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181276d6-426e-4acc-9cd3-0c203fb82b44 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:52:24.615501 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181276d6-426e-4acc-9cd3-0c203fb82b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:52:24.615770 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181276d6-426e-4acc-9cd3-0c203fb82b44 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:52:24.616432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181276d6-426e-4acc-9cd3-0c203fb82b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:52:24.617585 dv-cinder-831247-28-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-181276d6-426e-4acc-9cd3-0c203fb82b44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 20:52:24.617585 dv-cinder-831247-28-smb devstack@keystone.service[81397]: warnings.warn(msg) Sep 09 20:52:24.617585 dv-cinder-831247-28-smb devstack@keystone.service[81397]: Sep 09 20:52:24.618836 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181276d6-426e-4acc-9cd3-0c203fb82b44 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:52:24.661027 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 756/1498] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:52:24 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:52:24.665224 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a91731-d49b-42b4-a273-4ff5f46cfb48 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:52:24.666780 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-70a91731-d49b-42b4-a273-4ff5f46cfb48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:52:24.729441 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a91731-d49b-42b4-a273-4ff5f46cfb48 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:52:24.811629 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:52:24.824180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e2333-a958-4a55-bab6-2399b983b1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:52:24.824788 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e2333-a958-4a55-bab6-2399b983b1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:52:24.825064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e2333-a958-4a55-bab6-2399b983b1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:52:24.825330 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e2333-a958-4a55-bab6-2399b983b1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:52:24.825967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e2333-a958-4a55-bab6-2399b983b1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:52:24.827002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-840e2333-a958-4a55-bab6-2399b983b1d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 20:52:24.827002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: warnings.warn(msg) Sep 09 20:52:24.827002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: Sep 09 20:52:24.827880 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e2333-a958-4a55-bab6-2399b983b1d1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:52:24.841133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 743/1499] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:52:24.845283 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181276d6-426e-4acc-9cd3-0c203fb82b44 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:52:24.846841 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-181276d6-426e-4acc-9cd3-0c203fb82b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:52:24.858131 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181276d6-426e-4acc-9cd3-0c203fb82b44 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:52:24.883329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:52:24.954459 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802fe9d-95c5-4028-95cd-725d515cc62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:52:24.954994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802fe9d-95c5-4028-95cd-725d515cc62e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:52:24.955274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802fe9d-95c5-4028-95cd-725d515cc62e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:52:24.955543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802fe9d-95c5-4028-95cd-725d515cc62e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:52:24.956210 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802fe9d-95c5-4028-95cd-725d515cc62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:52:24.957212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-b802fe9d-95c5-4028-95cd-725d515cc62e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 20:52:24.957212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: warnings.warn(msg) Sep 09 20:52:24.957212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: Sep 09 20:52:24.958096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802fe9d-95c5-4028-95cd-725d515cc62e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:52:24.970917 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 757/1500] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:52:24.974721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e2333-a958-4a55-bab6-2399b983b1d1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:52:24.976362 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-840e2333-a958-4a55-bab6-2399b983b1d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:52:25.010101 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e2333-a958-4a55-bab6-2399b983b1d1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:52:25.103694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847efa3a-e7f1-4441-9fad-bdac76818902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:52:25.104388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847efa3a-e7f1-4441-9fad-bdac76818902 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:52:25.104669 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847efa3a-e7f1-4441-9fad-bdac76818902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:52:25.104942 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847efa3a-e7f1-4441-9fad-bdac76818902 admin admin] PATH_INFO: `/v3/projects/47807d9f08f94653be10cd3bc761d0d9/users/6eb99c5ee6fd4df781bb17ad51ae21c1/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:52:25.127832 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847efa3a-e7f1-4441-9fad-bdac76818902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47807d9f08f94653be10cd3bc761d0d9, user_id=6eb99c5ee6fd4df781bb17ad51ae21c1, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:52:25.128889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-847efa3a-e7f1-4441-9fad-bdac76818902 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 20:52:25.128889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: warnings.warn(msg) Sep 09 20:52:25.128889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: Sep 09 20:52:25.130851 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847efa3a-e7f1-4441-9fad-bdac76818902 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:52:25.155153 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 744/1501] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:52:24 2022] PUT /identity/v3/projects/47807d9f08f94653be10cd3bc761d0d9/users/6eb99c5ee6fd4df781bb17ad51ae21c1/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:52:25.168054 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bb5a5-0ca5-4e4e-9d4e-22f7e12b03f3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:52:25.168345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bb5a5-0ca5-4e4e-9d4e-22f7e12b03f3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:52:25.168619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bb5a5-0ca5-4e4e-9d4e-22f7e12b03f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:52:25.226963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e58bb5a5-0ca5-4e4e-9d4e-22f7e12b03f3 None None] MFA Rules not processed for user `6eb99c5ee6fd4df781bb17ad51ae21c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:52:25.228124 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e58bb5a5-0ca5-4e4e-9d4e-22f7e12b03f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:52:25.313086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 758/1502] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:52:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:52:25.322507 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc565c9-8cf0-4129-8ecc-d1d5df3fc029 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:52:25.322801 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc565c9-8cf0-4129-8ecc-d1d5df3fc029 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:52:25.323083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc565c9-8cf0-4129-8ecc-d1d5df3fc029 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:52:25.324477 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 745/1503] 10.222.0.15 () {54 vars in 964 bytes} [Fri Sep 9 20:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:52:25.329423 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cb906-4fd9-4c8e-9949-7770b5d345c8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:52:25.329714 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cb906-4fd9-4c8e-9949-7770b5d345c8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:52:25.329989 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249cb906-4fd9-4c8e-9949-7770b5d345c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:52:25.361682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:52:25.407134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-249cb906-4fd9-4c8e-9949-7770b5d345c8 None None] MFA Rules not processed for user `cf65c58c74fc49e4ba7605f3c6c27f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:52:25.408387 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-249cb906-4fd9-4c8e-9949-7770b5d345c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:52:25.483400 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 759/1504] 10.222.0.15 () {58 vars in 1061 bytes} [Fri Sep 9 20:52:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:52:25.493639 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc565c9-8cf0-4129-8ecc-d1d5df3fc029 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:52:25.495156 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2fc565c9-8cf0-4129-8ecc-d1d5df3fc029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:52:25.548075 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:52:25.603624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc565c9-8cf0-4129-8ecc-d1d5df3fc029 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:52:25.677323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d103d8-e3d0-417c-83f2-a7f1339e4497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:52:25.677926 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d103d8-e3d0-417c-83f2-a7f1339e4497 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:52:25.678202 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d103d8-e3d0-417c-83f2-a7f1339e4497 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:52:25.678466 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d103d8-e3d0-417c-83f2-a7f1339e4497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:52:25.680114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f2d103d8-e3d0-417c-83f2-a7f1339e4497 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:52:25.782850 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d103d8-e3d0-417c-83f2-a7f1339e4497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:52:25.784255 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d103d8-e3d0-417c-83f2-a7f1339e4497 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:52:25.787673 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:52:25.806149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 746/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:52:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:52:25.852077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb36dc0-935f-41f7-b1b2-deab4656a037 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:52:25.852511 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb36dc0-935f-41f7-b1b2-deab4656a037 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:52:25.852653 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb36dc0-935f-41f7-b1b2-deab4656a037 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:52:25.853902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 760/1506] 10.222.0.15 () {52 vars in 830 bytes} [Fri Sep 9 20:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:52:25.857347 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d103d8-e3d0-417c-83f2-a7f1339e4497 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:52:25.858547 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f2d103d8-e3d0-417c-83f2-a7f1339e4497 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:52:25.959269 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d103d8-e3d0-417c-83f2-a7f1339e4497 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:52:26.051743 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d4fd6-55eb-444e-b1c3-2c45133711b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:52:26.052366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d4fd6-55eb-444e-b1c3-2c45133711b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:52:26.052593 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d4fd6-55eb-444e-b1c3-2c45133711b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:52:26.052861 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d4fd6-55eb-444e-b1c3-2c45133711b5 admin admin] PATH_INFO: `/v3/users/6eb99c5ee6fd4df781bb17ad51ae21c1` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:52:26.066184 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d4fd6-55eb-444e-b1c3-2c45133711b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb99c5ee6fd4df781bb17ad51ae21c1)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:52:26.067235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-873d4fd6-55eb-444e-b1c3-2c45133711b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 20:52:26.067235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: warnings.warn(msg) Sep 09 20:52:26.067235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: Sep 09 20:52:26.068482 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d4fd6-55eb-444e-b1c3-2c45133711b5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:52:26.078731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:52:26.134579 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-873d4fd6-55eb-444e-b1c3-2c45133711b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb99c5ee6fd4df781bb17ad51ae21c1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:52:26.144290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-873d4fd6-55eb-444e-b1c3-2c45133711b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb99c5ee6fd4df781bb17ad51ae21c1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:52:26.144718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-873d4fd6-55eb-444e-b1c3-2c45133711b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb99c5ee6fd4df781bb17ad51ae21c1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:52:26.145218 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-873d4fd6-55eb-444e-b1c3-2c45133711b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb99c5ee6fd4df781bb17ad51ae21c1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:52:26.159608 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-873d4fd6-55eb-444e-b1c3-2c45133711b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb99c5ee6fd4df781bb17ad51ae21c1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:52:26.189398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 747/1507] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:52:25 2022] DELETE /identity/v3/users/6eb99c5ee6fd4df781bb17ad51ae21c1 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:52:26.193763 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbcc82-5681-479b-9023-1e40b6aa1df8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:52:26.194049 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbcc82-5681-479b-9023-1e40b6aa1df8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:52:26.194320 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbcc82-5681-479b-9023-1e40b6aa1df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:52:26.250914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-79cbcc82-5681-479b-9023-1e40b6aa1df8 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:52:26.252161 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-79cbcc82-5681-479b-9023-1e40b6aa1df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:52:26.333482 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:52:26.346239 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 761/1508] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:52:26.355964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d4fd6-55eb-444e-b1c3-2c45133711b5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:52:26.357224 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-873d4fd6-55eb-444e-b1c3-2c45133711b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:52:26.457244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d4fd6-55eb-444e-b1c3-2c45133711b5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:52:26.512394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:52:26.533587 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c20a7-62a6-4dcf-ae1f-23da49ec726a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:52:26.534203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c20a7-62a6-4dcf-ae1f-23da49ec726a service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:52:26.534504 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c20a7-62a6-4dcf-ae1f-23da49ec726a service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:52:26.534876 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c20a7-62a6-4dcf-ae1f-23da49ec726a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:52:26.536516 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b76c20a7-62a6-4dcf-ae1f-23da49ec726a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:52:26.648372 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c20a7-62a6-4dcf-ae1f-23da49ec726a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:52:26.649743 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c20a7-62a6-4dcf-ae1f-23da49ec726a service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:52:26.667575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 748/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:52:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:52:26.998188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbcc82-5681-479b-9023-1e40b6aa1df8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:52:26.999439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-79cbcc82-5681-479b-9023-1e40b6aa1df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:52:27.011445 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbcc82-5681-479b-9023-1e40b6aa1df8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:52:27.112616 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e86c9-4a75-4e67-b4d6-deb5c506a5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:52:27.113244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e86c9-4a75-4e67-b4d6-deb5c506a5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:52:27.113517 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e86c9-4a75-4e67-b4d6-deb5c506a5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:52:27.113781 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e86c9-4a75-4e67-b4d6-deb5c506a5a3 admin admin] PATH_INFO: `/v3/projects/47807d9f08f94653be10cd3bc761d0d9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:52:27.123420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e86c9-4a75-4e67-b4d6-deb5c506a5a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47807d9f08f94653be10cd3bc761d0d9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:52:27.124469 dv-cinder-831247-28-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-cb5e86c9-4a75-4e67-b4d6-deb5c506a5a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 20:52:27.124469 dv-cinder-831247-28-smb devstack@keystone.service[81397]: warnings.warn(msg) Sep 09 20:52:27.124469 dv-cinder-831247-28-smb devstack@keystone.service[81397]: Sep 09 20:52:27.126139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e86c9-4a75-4e67-b4d6-deb5c506a5a3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:52:27.182947 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cb5e86c9-4a75-4e67-b4d6-deb5c506a5a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47807d9f08f94653be10cd3bc761d0d9', 'request_id': 'req-cb5e86c9-4a75-4e67-b4d6-deb5c506a5a3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:52:27.192524 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cb5e86c9-4a75-4e67-b4d6-deb5c506a5a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47807d9f08f94653be10cd3bc761d0d9', 'request_id': 'req-cb5e86c9-4a75-4e67-b4d6-deb5c506a5a3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:52:27.198651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cb5e86c9-4a75-4e67-b4d6-deb5c506a5a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47807d9f08f94653be10cd3bc761d0d9', 'request_id': 'req-cb5e86c9-4a75-4e67-b4d6-deb5c506a5a3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:52:27.229276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cb5e86c9-4a75-4e67-b4d6-deb5c506a5a3 admin admin] The token cache is being invalidate because project 47807d9f08f94653be10cd3bc761d0d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:52:27.229549 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cb5e86c9-4a75-4e67-b4d6-deb5c506a5a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:52:27.229972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-cb5e86c9-4a75-4e67-b4d6-deb5c506a5a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:52:27.231348 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 762/1510] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:52:26 2022] DELETE /identity/v3/projects/47807d9f08f94653be10cd3bc761d0d9 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:52:36.665373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=62 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:52:37.227275 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:54:03.320395 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb413f09-18cb-4696-9556-2b600e332861 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:03.320902 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb413f09-18cb-4696-9556-2b600e332861 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:03.321020 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb413f09-18cb-4696-9556-2b600e332861 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:03.322326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 20:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:54:03.327683 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6c911-dfab-4392-a895-3b02bebce6d1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:03.328177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6c911-dfab-4392-a895-3b02bebce6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:03.328444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6c911-dfab-4392-a895-3b02bebce6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:03.410532 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-98c6c911-dfab-4392-a895-3b02bebce6d1 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:54:03.412134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-98c6c911-dfab-4392-a895-3b02bebce6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:54:03.515638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 20:54:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:54:03.673305 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb413f09-18cb-4696-9556-2b600e332861 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:54:03.676148 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-eb413f09-18cb-4696-9556-2b600e332861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:54:03.798745 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb413f09-18cb-4696-9556-2b600e332861 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:54:03.804378 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507cea8-cdc6-40ba-bd91-e3bffead993c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:54:03.805414 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507cea8-cdc6-40ba-bd91-e3bffead993c service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:03.805702 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507cea8-cdc6-40ba-bd91-e3bffead993c service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:03.805976 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507cea8-cdc6-40ba-bd91-e3bffead993c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:03.815769 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507cea8-cdc6-40ba-bd91-e3bffead993c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:54:03.818318 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e507cea8-cdc6-40ba-bd91-e3bffead993c service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:54:03.828677 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 750/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:54:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:54:04.929158 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa11fb-10ce-4add-a593-dd1731ed53be None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:04.929713 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa11fb-10ce-4add-a593-dd1731ed53be None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:04.929713 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa11fb-10ce-4add-a593-dd1731ed53be None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:04.931033 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 20:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:54:04.937633 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b095e1-1b1e-49a7-9a24-330171e849ae None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:04.938118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b095e1-1b1e-49a7-9a24-330171e849ae None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:04.938276 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b095e1-1b1e-49a7-9a24-330171e849ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:04.958649 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e8b095e1-1b1e-49a7-9a24-330171e849ae None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:54:04.959848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e8b095e1-1b1e-49a7-9a24-330171e849ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:54:04.968499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 20:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:54:04.969131 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c1c7c-401d-4f28-840f-3e5d712a1ace None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:04.969467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c1c7c-401d-4f28-840f-3e5d712a1ace None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:04.969748 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c1c7c-401d-4f28-840f-3e5d712a1ace None None] PATH_INFO: `/v3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:04.971002 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 765/1516] 10.222.0.17 () {54 vars in 925 bytes} [Fri Sep 9 20:54:04 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:54:04.976927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a7724-4ca4-4f52-b01c-2ae7cf6bb32d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:04.977218 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a7724-4ca4-4f52-b01c-2ae7cf6bb32d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:04.977490 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a7724-4ca4-4f52-b01c-2ae7cf6bb32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:05.038352 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b86a7724-4ca4-4f52-b01c-2ae7cf6bb32d None None] MFA Rules not processed for user `0fc28d9a1b3f4feca0deeb5f266f8b37`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:54:05.039558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b86a7724-4ca4-4f52-b01c-2ae7cf6bb32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:54:05.092925 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:54:05.112366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 752/1517] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Sep 9 20:54:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:54:05.125391 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c1c7c-401d-4f28-840f-3e5d712a1ace None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:54:05.139335 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c1c7c-401d-4f28-840f-3e5d712a1ace None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:54:05.145263 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ba271-9678-4254-aca8-1c1f3fbf506d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:54:05.145854 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ba271-9678-4254-aca8-1c1f3fbf506d service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:05.146128 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ba271-9678-4254-aca8-1c1f3fbf506d service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:05.146399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ba271-9678-4254-aca8-1c1f3fbf506d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:05.154171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ba271-9678-4254-aca8-1c1f3fbf506d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:54:05.155734 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ba271-9678-4254-aca8-1c1f3fbf506d service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:54:05.165781 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 766/1518] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:54:08.618377 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c623b6-a3dc-4c90-a171-e1fba5772931 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:08.618865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c623b6-a3dc-4c90-a171-e1fba5772931 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:08.619187 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c623b6-a3dc-4c90-a171-e1fba5772931 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:08.620653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 753/1519] 10.222.0.15 () {54 vars in 961 bytes} [Fri Sep 9 20:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:54:08.625812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e9700-3e9f-4b4b-b058-2383494601bd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:08.626268 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e9700-3e9f-4b4b-b058-2383494601bd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:08.626449 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e9700-3e9f-4b4b-b058-2383494601bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:08.646566 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-df0e9700-3e9f-4b4b-b058-2383494601bd None None] MFA Rules not processed for user `0fc28d9a1b3f4feca0deeb5f266f8b37`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:54:08.647775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-df0e9700-3e9f-4b4b-b058-2383494601bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:54:08.656310 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 767/1520] 10.222.0.15 () {58 vars in 1058 bytes} [Fri Sep 9 20:54:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:54:08.664858 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c623b6-a3dc-4c90-a171-e1fba5772931 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:54:08.677927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c623b6-a3dc-4c90-a171-e1fba5772931 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:54:08.682927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c600ec-6a19-4e1d-9147-dbaffa668951 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc28d9a1b3f4feca0deeb5f266f8b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:54:08.683522 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c600ec-6a19-4e1d-9147-dbaffa668951 service placement] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:08.683803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c600ec-6a19-4e1d-9147-dbaffa668951 service placement] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:08.684106 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c600ec-6a19-4e1d-9147-dbaffa668951 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:08.692175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c600ec-6a19-4e1d-9147-dbaffa668951 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:54:08.693758 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c600ec-6a19-4e1d-9147-dbaffa668951 service placement] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:54:08.703196 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 754/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:54:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:54:16.638716 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e684e-09a9-4112-996b-f075f01d2dfd None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:16.639290 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e684e-09a9-4112-996b-f075f01d2dfd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:16.639290 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e684e-09a9-4112-996b-f075f01d2dfd None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:16.640635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 20:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:54:16.647364 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45539d8-db96-4fe7-ab86-08d4875e377c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:16.647815 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45539d8-db96-4fe7-ab86-08d4875e377c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:16.647941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45539d8-db96-4fe7-ab86-08d4875e377c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:16.667385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e45539d8-db96-4fe7-ab86-08d4875e377c None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:54:16.668633 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e45539d8-db96-4fe7-ab86-08d4875e377c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:54:16.676530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 20:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:54:16.831138 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e684e-09a9-4112-996b-f075f01d2dfd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:54:16.845098 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e684e-09a9-4112-996b-f075f01d2dfd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:54:16.850489 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87fa6c5-972b-49c0-b2e3-04ba747f26c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:54:16.851074 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fa6c5-972b-49c0-b2e3-04ba747f26c7 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:16.851348 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fa6c5-972b-49c0-b2e3-04ba747f26c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:16.851617 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87fa6c5-972b-49c0-b2e3-04ba747f26c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:16.860122 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fa6c5-972b-49c0-b2e3-04ba747f26c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:54:16.861696 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87fa6c5-972b-49c0-b2e3-04ba747f26c7 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:54:16.871278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 769/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:54:17.949272 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9e061-f2ea-404b-a41c-5f666b6e6005 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:17.949836 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9e061-f2ea-404b-a41c-5f666b6e6005 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:17.949836 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9e061-f2ea-404b-a41c-5f666b6e6005 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:17.951173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 9 20:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:54:17.957710 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7265bdd-c652-41af-86ea-648a5e460c83 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:17.958136 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7265bdd-c652-41af-86ea-648a5e460c83 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:17.958268 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7265bdd-c652-41af-86ea-648a5e460c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:17.978028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d7265bdd-c652-41af-86ea-648a5e460c83 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:54:17.979267 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d7265bdd-c652-41af-86ea-648a5e460c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:54:17.987108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 9 20:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:54:18.141749 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9e061-f2ea-404b-a41c-5f666b6e6005 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:54:18.156440 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9e061-f2ea-404b-a41c-5f666b6e6005 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:54:18.162883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cf233-2c8f-41df-b47a-a0de4d2dae62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:54:18.163471 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cf233-2c8f-41df-b47a-a0de4d2dae62 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:18.163749 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cf233-2c8f-41df-b47a-a0de4d2dae62 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:18.164050 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cf233-2c8f-41df-b47a-a0de4d2dae62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:18.171795 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cf233-2c8f-41df-b47a-a0de4d2dae62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:54:18.173417 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cf233-2c8f-41df-b47a-a0de4d2dae62 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:54:18.183490 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 757/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:54:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:54:22.219108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ba81b-df69-4546-afd6-aae3766680c5 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:22.219634 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ba81b-df69-4546-afd6-aae3766680c5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:22.219634 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ba81b-df69-4546-afd6-aae3766680c5 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:22.221036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 20:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:54:22.226419 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040ad86-a583-4ce6-a712-36526928eace None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:22.226856 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040ad86-a583-4ce6-a712-36526928eace None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:22.226980 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040ad86-a583-4ce6-a712-36526928eace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:22.246720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7040ad86-a583-4ce6-a712-36526928eace None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:54:22.247918 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7040ad86-a583-4ce6-a712-36526928eace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:54:22.256427 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 20:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:54:22.546254 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ba81b-df69-4546-afd6-aae3766680c5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:54:22.547975 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1e1ba81b-df69-4546-afd6-aae3766680c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:54:22.582479 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:54:22.628883 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ba81b-df69-4546-afd6-aae3766680c5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:54:22.632528 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ceded1-391e-4053-8e20-aca51a82aab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:54:22.633130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ceded1-391e-4053-8e20-aca51a82aab6 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:22.633410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ceded1-391e-4053-8e20-aca51a82aab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:22.633683 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ceded1-391e-4053-8e20-aca51a82aab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:22.642532 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ceded1-391e-4053-8e20-aca51a82aab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:54:22.643963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ceded1-391e-4053-8e20-aca51a82aab6 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:54:22.653585 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 772/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:54:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:54:24.811627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74ac9b-3134-4091-a780-91eaf572620c None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:24.812215 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74ac9b-3134-4091-a780-91eaf572620c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:24.812215 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74ac9b-3134-4091-a780-91eaf572620c None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:24.813541 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 20:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:54:24.819480 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a2c01-513d-443e-8b4b-b32c30cd0e10 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:24.819917 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a2c01-513d-443e-8b4b-b32c30cd0e10 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:24.820050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a2c01-513d-443e-8b4b-b32c30cd0e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:24.840605 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-719a2c01-513d-443e-8b4b-b32c30cd0e10 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:54:24.841748 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-719a2c01-513d-443e-8b4b-b32c30cd0e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:54:24.849649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 20:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:54:25.135353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74ac9b-3134-4091-a780-91eaf572620c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:54:25.146455 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74ac9b-3134-4091-a780-91eaf572620c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:54:25.149871 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610d41f-75f0-4675-bce9-cf1ae69081c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:54:25.150458 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610d41f-75f0-4675-bce9-cf1ae69081c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:25.150734 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610d41f-75f0-4675-bce9-cf1ae69081c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:25.151004 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610d41f-75f0-4675-bce9-cf1ae69081c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:25.160628 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610d41f-75f0-4675-bce9-cf1ae69081c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:54:25.162076 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610d41f-75f0-4675-bce9-cf1ae69081c8 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:54:25.171311 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 760/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:54:28.891235 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae178e0b-0cac-499d-a898-36309d9782d5 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:28.891877 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae178e0b-0cac-499d-a898-36309d9782d5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:28.891877 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae178e0b-0cac-499d-a898-36309d9782d5 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:28.893191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 20:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:54:28.898811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e7e7a-0737-4d3f-b6e8-6f5a11793e12 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:28.899246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e7e7a-0737-4d3f-b6e8-6f5a11793e12 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:28.899364 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e7e7a-0737-4d3f-b6e8-6f5a11793e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:28.919788 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-599e7e7a-0737-4d3f-b6e8-6f5a11793e12 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:54:28.921011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-599e7e7a-0737-4d3f-b6e8-6f5a11793e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:54:28.928778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 20:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:54:29.233989 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae178e0b-0cac-499d-a898-36309d9782d5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:54:29.235701 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ae178e0b-0cac-499d-a898-36309d9782d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:54:29.314702 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae178e0b-0cac-499d-a898-36309d9782d5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:54:29.319084 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990147bb-eb0a-4dea-ac65-d029c9defd27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:54:29.319689 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990147bb-eb0a-4dea-ac65-d029c9defd27 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:29.319967 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990147bb-eb0a-4dea-ac65-d029c9defd27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:29.320270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990147bb-eb0a-4dea-ac65-d029c9defd27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:29.329289 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990147bb-eb0a-4dea-ac65-d029c9defd27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:54:29.330715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990147bb-eb0a-4dea-ac65-d029c9defd27 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:54:29.340595 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 775/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:54:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:54:31.502657 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cfc86-3e37-450b-9ab5-39f11aa28c37 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:31.503231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cfc86-3e37-450b-9ab5-39f11aa28c37 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:31.503809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cfc86-3e37-450b-9ab5-39f11aa28c37 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:31.505194 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 9 20:54:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:54:31.510339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8da997-663c-4957-9416-208f3212a147 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:31.510766 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8da997-663c-4957-9416-208f3212a147 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:31.510873 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8da997-663c-4957-9416-208f3212a147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:31.530955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fd8da997-663c-4957-9416-208f3212a147 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:54:31.532459 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fd8da997-663c-4957-9416-208f3212a147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:54:31.540733 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 9 20:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:54:31.860318 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cfc86-3e37-450b-9ab5-39f11aa28c37 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:54:31.861998 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-502cfc86-3e37-450b-9ab5-39f11aa28c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:54:31.883603 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cfc86-3e37-450b-9ab5-39f11aa28c37 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:54:31.893802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cfe413-abfb-4b34-840a-c76ab85befb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:54:31.894414 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfe413-abfb-4b34-840a-c76ab85befb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:54:31.894692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfe413-abfb-4b34-840a-c76ab85befb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:54:31.894963 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cfe413-abfb-4b34-840a-c76ab85befb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:54:31.904991 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfe413-abfb-4b34-840a-c76ab85befb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:54:31.906811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cfe413-abfb-4b34-840a-c76ab85befb1 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:54:31.922270 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 763/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:54:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:54:41.524733 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=63 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:54:41.917367 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=37 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:55:58.297321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599379b-605d-40a0-8f9b-e89771a75cb0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:58.298001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599379b-605d-40a0-8f9b-e89771a75cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:58.298001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599379b-605d-40a0-8f9b-e89771a75cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:58.324526 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0599379b-605d-40a0-8f9b-e89771a75cb0 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:55:58.326007 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0599379b-605d-40a0-8f9b-e89771a75cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:55:58.340477 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 777/1540] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:55:58.350499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6baf8-0a00-4cf6-9e29-deaba2ce8af1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:58.351091 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6baf8-0a00-4cf6-9e29-deaba2ce8af1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:58.351091 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6baf8-0a00-4cf6-9e29-deaba2ce8af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:58.376300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b7f6baf8-0a00-4cf6-9e29-deaba2ce8af1 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:55:58.377725 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b7f6baf8-0a00-4cf6-9e29-deaba2ce8af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:55:58.392772 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 764/1541] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:55:58.398392 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599379b-605d-40a0-8f9b-e89771a75cb0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:58.414736 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599379b-605d-40a0-8f9b-e89771a75cb0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:58.422106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762d1c7-0e22-4c48-b291-45e92cfc9b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:58.422766 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762d1c7-0e22-4c48-b291-45e92cfc9b85 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:58.423027 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762d1c7-0e22-4c48-b291-45e92cfc9b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:58.423461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762d1c7-0e22-4c48-b291-45e92cfc9b85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:58.424504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762d1c7-0e22-4c48-b291-45e92cfc9b85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:55:58.424867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762d1c7-0e22-4c48-b291-45e92cfc9b85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:58.426689 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762d1c7-0e22-4c48-b291-45e92cfc9b85 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:58.445953 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 778/1542] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:55:58.454743 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6baf8-0a00-4cf6-9e29-deaba2ce8af1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:58.469953 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6baf8-0a00-4cf6-9e29-deaba2ce8af1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:58.479609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e3e12-f0bc-4f3c-94d6-c3e8e51fcef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:58.480284 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e3e12-f0bc-4f3c-94d6-c3e8e51fcef5 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:58.480567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e3e12-f0bc-4f3c-94d6-c3e8e51fcef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:58.480842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e3e12-f0bc-4f3c-94d6-c3e8e51fcef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:58.481500 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e3e12-f0bc-4f3c-94d6-c3e8e51fcef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:58.483437 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e3e12-f0bc-4f3c-94d6-c3e8e51fcef5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:58.537283 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 765/1543] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:55:58 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:55:58.541854 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762d1c7-0e22-4c48-b291-45e92cfc9b85 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:58.553852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762d1c7-0e22-4c48-b291-45e92cfc9b85 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:58.629565 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1749e9-f7d0-424f-9e28-c6b955e7d5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:58.630288 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1749e9-f7d0-424f-9e28-c6b955e7d5e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:58.630621 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1749e9-f7d0-424f-9e28-c6b955e7d5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:58.630900 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1749e9-f7d0-424f-9e28-c6b955e7d5e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:58.632173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1749e9-f7d0-424f-9e28-c6b955e7d5e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:58.634251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1749e9-f7d0-424f-9e28-c6b955e7d5e5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:58.671764 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 779/1544] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:55:58 2022] POST /identity/v3/users => generated 294 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:55:58.681168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e3e12-f0bc-4f3c-94d6-c3e8e51fcef5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:58.689635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e3e12-f0bc-4f3c-94d6-c3e8e51fcef5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:58.702511 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ed9b9-fe17-444d-ba87-ca52cacbaf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:58.703520 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ed9b9-fe17-444d-ba87-ca52cacbaf4c admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:58.704102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ed9b9-fe17-444d-ba87-ca52cacbaf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:58.704613 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ed9b9-fe17-444d-ba87-ca52cacbaf4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:58.705496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ed9b9-fe17-444d-ba87-ca52cacbaf4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:58.710388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63ed9b9-fe17-444d-ba87-ca52cacbaf4c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:58.713822 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac41751-2490-40aa-b706-d754254646c0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:58.714114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac41751-2490-40aa-b706-d754254646c0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:58.714394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac41751-2490-40aa-b706-d754254646c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:58.723165 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 766/1545] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:55:58.729833 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ed9b9-fe17-444d-ba87-ca52cacbaf4c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:58.756975 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5ac41751-2490-40aa-b706-d754254646c0 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:55:58.757918 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ed9b9-fe17-444d-ba87-ca52cacbaf4c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:58.758230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5ac41751-2490-40aa-b706-d754254646c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:55:58.769619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11bf46-678e-424d-87ec-55113c402d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:58.771038 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11bf46-678e-424d-87ec-55113c402d33 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:58.771333 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11bf46-678e-424d-87ec-55113c402d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:58.771726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11bf46-678e-424d-87ec-55113c402d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:58.772547 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11bf46-678e-424d-87ec-55113c402d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:58.775789 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 780/1546] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:55:58.779600 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b8d07-0ce0-46d3-a900-614dfa511d7b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:58.779887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b8d07-0ce0-46d3-a900-614dfa511d7b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:58.780192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b8d07-0ce0-46d3-a900-614dfa511d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:58.781861 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11bf46-678e-424d-87ec-55113c402d33 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:58.805110 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 767/1547] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:55:58.809397 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589186ea-a315-4630-b78f-09e736079a1a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:58.809692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589186ea-a315-4630-b78f-09e736079a1a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:58.809975 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589186ea-a315-4630-b78f-09e736079a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:58.812838 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5d3b8d07-0ce0-46d3-a900-614dfa511d7b None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:55:58.814049 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5d3b8d07-0ce0-46d3-a900-614dfa511d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:55:58.831413 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 781/1548] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:55:58.832546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b8d07-0ce0-46d3-a900-614dfa511d7b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:58.857075 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-589186ea-a315-4630-b78f-09e736079a1a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:55:58.857622 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b8d07-0ce0-46d3-a900-614dfa511d7b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:58.859060 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-589186ea-a315-4630-b78f-09e736079a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:55:58.867962 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be40f08-8b34-4fac-a436-4d0a0d20f54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:58.868663 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be40f08-8b34-4fac-a436-4d0a0d20f54a admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:58.868941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be40f08-8b34-4fac-a436-4d0a0d20f54a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:58.869837 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be40f08-8b34-4fac-a436-4d0a0d20f54a admin admin] PATH_INFO: `/v3/projects/a20f62de3f094d1e8a5b80dcb30a8e2f/users/ef5e046f57cc4389818835ba68ad8157/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:58.882498 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 768/1549] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:55:58.884273 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0be0a-6719-41d5-8f68-43f69913a4f5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:58.884774 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0be0a-6719-41d5-8f68-43f69913a4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:58.885309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0be0a-6719-41d5-8f68-43f69913a4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:58.896280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be40f08-8b34-4fac-a436-4d0a0d20f54a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a20f62de3f094d1e8a5b80dcb30a8e2f, user_id=ef5e046f57cc4389818835ba68ad8157, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:58.897327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-2be40f08-8b34-4fac-a436-4d0a0d20f54a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 20:55:58.897327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: warnings.warn(msg) Sep 09 20:55:58.897327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: Sep 09 20:55:58.899287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be40f08-8b34-4fac-a436-4d0a0d20f54a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:58.922114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-41d0be0a-6719-41d5-8f68-43f69913a4f5 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:55:58.923662 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-41d0be0a-6719-41d5-8f68-43f69913a4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:55:58.950438 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 769/1550] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:55:58.955784 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 782/1551] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:55:58 2022] PUT /identity/v3/projects/a20f62de3f094d1e8a5b80dcb30a8e2f/users/ef5e046f57cc4389818835ba68ad8157/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:55:58.956958 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be40f08-8b34-4fac-a436-4d0a0d20f54a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:58.960014 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eea23-0f52-42e2-a758-cec0a158bcc7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:58.960014 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eea23-0f52-42e2-a758-cec0a158bcc7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:58.960014 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20eea23-0f52-42e2-a758-cec0a158bcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.013737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c20eea23-0f52-42e2-a758-cec0a158bcc7 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:55:59.014760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c20eea23-0f52-42e2-a758-cec0a158bcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:55:59.073319 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be40f08-8b34-4fac-a436-4d0a0d20f54a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:59.080242 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404fd0e3-b38f-4619-9b9b-2e2e663fdf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:59.080861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fd0e3-b38f-4619-9b9b-2e2e663fdf6a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.081144 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fd0e3-b38f-4619-9b9b-2e2e663fdf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.081421 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404fd0e3-b38f-4619-9b9b-2e2e663fdf6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.082075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404fd0e3-b38f-4619-9b9b-2e2e663fdf6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:55:59.082380 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404fd0e3-b38f-4619-9b9b-2e2e663fdf6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:59.084111 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404fd0e3-b38f-4619-9b9b-2e2e663fdf6a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:59.097760 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 783/1552] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:55:59.101303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc5601-b704-4f79-ad1d-a46ae4399cd0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.101588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc5601-b704-4f79-ad1d-a46ae4399cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.101860 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc5601-b704-4f79-ad1d-a46ae4399cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.104724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 770/1553] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:55:59.105881 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d399f09-6ca3-4145-8a4f-68458c0e904f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.106166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d399f09-6ca3-4145-8a4f-68458c0e904f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.106440 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d399f09-6ca3-4145-8a4f-68458c0e904f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.125955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0efc5601-b704-4f79-ad1d-a46ae4399cd0 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:55:59.127146 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0efc5601-b704-4f79-ad1d-a46ae4399cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:55:59.130521 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1d399f09-6ca3-4145-8a4f-68458c0e904f None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:55:59.135321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1d399f09-6ca3-4145-8a4f-68458c0e904f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:55:59.135551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 784/1554] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:55:59.142959 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f0947-29bc-4ff5-ab6f-7c1d885a9905 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.143238 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f0947-29bc-4ff5-ab6f-7c1d885a9905 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.143511 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f0947-29bc-4ff5-ab6f-7c1d885a9905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.144180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 771/1555] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:55:59.145424 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adeff3-acfe-4a4a-8661-75d584de3656 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.145709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adeff3-acfe-4a4a-8661-75d584de3656 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.146019 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adeff3-acfe-4a4a-8661-75d584de3656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.170173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-32adeff3-acfe-4a4a-8661-75d584de3656 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:55:59.171394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-32adeff3-acfe-4a4a-8661-75d584de3656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:55:59.171879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fc2f0947-29bc-4ff5-ab6f-7c1d885a9905 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:55:59.173308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fc2f0947-29bc-4ff5-ab6f-7c1d885a9905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:55:59.180689 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 772/1556] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:55:59.181992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afe924-98b7-4d43-bf77-982167399c94 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.182289 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afe924-98b7-4d43-bf77-982167399c94 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.182565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afe924-98b7-4d43-bf77-982167399c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.192406 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 785/1557] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:55:59.192406 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869ecea-c448-4afc-9c50-9ddcce51a8f5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.192406 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869ecea-c448-4afc-9c50-9ddcce51a8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.192406 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869ecea-c448-4afc-9c50-9ddcce51a8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.207737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-07afe924-98b7-4d43-bf77-982167399c94 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:55:59.209228 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-07afe924-98b7-4d43-bf77-982167399c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:55:59.217854 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b869ecea-c448-4afc-9c50-9ddcce51a8f5 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:55:59.218022 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 773/1558] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:55:59.218986 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afe924-98b7-4d43-bf77-982167399c94 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:59.219118 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b869ecea-c448-4afc-9c50-9ddcce51a8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:55:59.229134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 786/1559] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:55:59.229628 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afe924-98b7-4d43-bf77-982167399c94 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:59.229953 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869ecea-c448-4afc-9c50-9ddcce51a8f5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:59.235530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ef0bb-193e-4584-9424-2ef6428ef831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:59.236477 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ef0bb-193e-4584-9424-2ef6428ef831 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.236761 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ef0bb-193e-4584-9424-2ef6428ef831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.237037 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ef0bb-193e-4584-9424-2ef6428ef831 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.237679 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ef0bb-193e-4584-9424-2ef6428ef831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:59.241879 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ef0bb-193e-4584-9424-2ef6428ef831 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:59.242935 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869ecea-c448-4afc-9c50-9ddcce51a8f5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:59.248357 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220c43e7-1c45-44be-9edb-c0e7862a2d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:59.248970 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c43e7-1c45-44be-9edb-c0e7862a2d89 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.249250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c43e7-1c45-44be-9edb-c0e7862a2d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.249528 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c43e7-1c45-44be-9edb-c0e7862a2d89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.250178 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c43e7-1c45-44be-9edb-c0e7862a2d89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:55:59.250985 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c43e7-1c45-44be-9edb-c0e7862a2d89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:59.253155 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220c43e7-1c45-44be-9edb-c0e7862a2d89 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:59.255699 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:55:59.267893 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 787/1560] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:55:59.278828 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 774/1561] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:55:59 2022] POST /identity/v3/projects => generated 355 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:55:59.279029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c96692-86b0-4fcf-bf51-e4b8fc241111 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.279029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c96692-86b0-4fcf-bf51-e4b8fc241111 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.279029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c96692-86b0-4fcf-bf51-e4b8fc241111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.280463 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ef0bb-193e-4584-9424-2ef6428ef831 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:59.297719 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e7c96692-86b0-4fcf-bf51-e4b8fc241111 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:55:59.298943 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e7c96692-86b0-4fcf-bf51-e4b8fc241111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:55:59.338054 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:55:59.355375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ef0bb-193e-4584-9424-2ef6428ef831 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:59.360079 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249ab95-ad85-4901-9aee-d2916daeba9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:59.360695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249ab95-ad85-4901-9aee-d2916daeba9b admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.360982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249ab95-ad85-4901-9aee-d2916daeba9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.361244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 788/1562] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:55:59.361359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249ab95-ad85-4901-9aee-d2916daeba9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.361888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249ab95-ad85-4901-9aee-d2916daeba9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:55:59.362381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249ab95-ad85-4901-9aee-d2916daeba9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:59.362490 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c3d49-c33a-4df9-b317-903ba107d418 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.362752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c3d49-c33a-4df9-b317-903ba107d418 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.363022 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c3d49-c33a-4df9-b317-903ba107d418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.363413 dv-cinder-831247-28-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-2249ab95-ad85-4901-9aee-d2916daeba9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 09 20:55:59.363413 dv-cinder-831247-28-smb devstack@keystone.service[81398]: warnings.warn(msg) Sep 09 20:55:59.363413 dv-cinder-831247-28-smb devstack@keystone.service[81398]: Sep 09 20:55:59.364960 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249ab95-ad85-4901-9aee-d2916daeba9b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:59.378101 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 775/1563] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:55:59.378997 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249ab95-ad85-4901-9aee-d2916daeba9b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:59.380755 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2249ab95-ad85-4901-9aee-d2916daeba9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:55:59.384955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2d4c3d49-c33a-4df9-b317-903ba107d418 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:55:59.386607 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2d4c3d49-c33a-4df9-b317-903ba107d418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:55:59.395014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 789/1564] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:55:59.396880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3a583-0b6e-407f-801f-65ce6d51f3e8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.397276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3a583-0b6e-407f-801f-65ce6d51f3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.397541 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3a583-0b6e-407f-801f-65ce6d51f3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.418523 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-67b3a583-0b6e-407f-801f-65ce6d51f3e8 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:55:59.419739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-67b3a583-0b6e-407f-801f-65ce6d51f3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:55:59.429017 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 790/1565] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:55:59.430291 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ada47-3ac1-4b8d-bb0b-889c52a8f920 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.430520 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ada47-3ac1-4b8d-bb0b-889c52a8f920 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.430801 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ada47-3ac1-4b8d-bb0b-889c52a8f920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.439488 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249ab95-ad85-4901-9aee-d2916daeba9b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:59.443261 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2fce1-c370-45df-87c3-13a3e69c045c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:59.443872 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2fce1-c370-45df-87c3-13a3e69c045c service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.444307 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2fce1-c370-45df-87c3-13a3e69c045c service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.444583 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf2fce1-c370-45df-87c3-13a3e69c045c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.449814 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5e2ada47-3ac1-4b8d-bb0b-889c52a8f920 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:55:59.450999 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5e2ada47-3ac1-4b8d-bb0b-889c52a8f920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:55:59.453764 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2fce1-c370-45df-87c3-13a3e69c045c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:59.455245 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf2fce1-c370-45df-87c3-13a3e69c045c service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:59.459565 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 791/1566] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:55:59.460507 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ada47-3ac1-4b8d-bb0b-889c52a8f920 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:59.469048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 776/1567] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:55:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:55:59.469846 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2fce1-c370-45df-87c3-13a3e69c045c service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:59.469995 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ada47-3ac1-4b8d-bb0b-889c52a8f920 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:59.475076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f45eb-4475-4d58-8722-10f27264d496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:59.475675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f45eb-4475-4d58-8722-10f27264d496 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.475958 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f45eb-4475-4d58-8722-10f27264d496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.476262 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f45eb-4475-4d58-8722-10f27264d496 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.477028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f45eb-4475-4d58-8722-10f27264d496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:59.478054 dv-cinder-831247-28-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-e11f45eb-4475-4d58-8722-10f27264d496 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 20:55:59.478054 dv-cinder-831247-28-smb devstack@keystone.service[81397]: warnings.warn(msg) Sep 09 20:55:59.478054 dv-cinder-831247-28-smb devstack@keystone.service[81397]: Sep 09 20:55:59.479254 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f45eb-4475-4d58-8722-10f27264d496 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:59.479540 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf2fce1-c370-45df-87c3-13a3e69c045c service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:59.486078 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfeec6b-103e-4dbf-9ecc-00318237a23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:59.486679 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfeec6b-103e-4dbf-9ecc-00318237a23a admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.486959 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfeec6b-103e-4dbf-9ecc-00318237a23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.487227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfeec6b-103e-4dbf-9ecc-00318237a23a admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.488029 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfeec6b-103e-4dbf-9ecc-00318237a23a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:59.489061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-adfeec6b-103e-4dbf-9ecc-00318237a23a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 20:55:59.489061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: warnings.warn(msg) Sep 09 20:55:59.489061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: Sep 09 20:55:59.490342 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfeec6b-103e-4dbf-9ecc-00318237a23a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:59.511109 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 792/1568] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:55:59 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:55:59.512337 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f45eb-4475-4d58-8722-10f27264d496 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:59.523149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 777/1569] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:55:59 2022] POST /identity/v3/users => generated 278 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:55:59.523149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfeec6b-103e-4dbf-9ecc-00318237a23a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:59.531730 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfeec6b-103e-4dbf-9ecc-00318237a23a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:59.595069 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f45eb-4475-4d58-8722-10f27264d496 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:59.601213 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88477d-fa92-4e88-869d-40ce653584ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:59.601900 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88477d-fa92-4e88-869d-40ce653584ba admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.602251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88477d-fa92-4e88-869d-40ce653584ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.602373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648cb74-2133-402e-ae7d-b201c00eda95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:59.602638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88477d-fa92-4e88-869d-40ce653584ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.602979 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648cb74-2133-402e-ae7d-b201c00eda95 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.603199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648cb74-2133-402e-ae7d-b201c00eda95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.603489 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1648cb74-2133-402e-ae7d-b201c00eda95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.603646 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88477d-fa92-4e88-869d-40ce653584ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:55:59.603952 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88477d-fa92-4e88-869d-40ce653584ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:59.604301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648cb74-2133-402e-ae7d-b201c00eda95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:59.606434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f88477d-fa92-4e88-869d-40ce653584ba admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:59.607137 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1648cb74-2133-402e-ae7d-b201c00eda95 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:59.620987 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 793/1570] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:55:59.621918 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88477d-fa92-4e88-869d-40ce653584ba admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:59.639174 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88477d-fa92-4e88-869d-40ce653584ba admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:59.644887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb9f26-8d8b-438e-95e1-dc970f01d22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:59.646259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb9f26-8d8b-438e-95e1-dc970f01d22b admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.646493 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 778/1571] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:55:59 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:55:59.646984 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb9f26-8d8b-438e-95e1-dc970f01d22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.647361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb9f26-8d8b-438e-95e1-dc970f01d22b admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.647501 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648cb74-2133-402e-ae7d-b201c00eda95 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:59.648242 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb9f26-8d8b-438e-95e1-dc970f01d22b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:55:59.648676 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb9f26-8d8b-438e-95e1-dc970f01d22b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:59.650653 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb9f26-8d8b-438e-95e1-dc970f01d22b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:59.665331 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 794/1572] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:55:59.666133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb9f26-8d8b-438e-95e1-dc970f01d22b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:59.683712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb9f26-8d8b-438e-95e1-dc970f01d22b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:59.714576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:55:59.726592 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:55:59.729037 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1648cb74-2133-402e-ae7d-b201c00eda95 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:59.736468 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5324f47-bf3f-4b7b-a353-046e15167ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:59.737145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5324f47-bf3f-4b7b-a353-046e15167ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.737474 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5324f47-bf3f-4b7b-a353-046e15167ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.737793 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5324f47-bf3f-4b7b-a353-046e15167ba1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.738686 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5324f47-bf3f-4b7b-a353-046e15167ba1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:55:59.738823 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5324f47-bf3f-4b7b-a353-046e15167ba1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:59.740996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5324f47-bf3f-4b7b-a353-046e15167ba1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:59.757057 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 779/1573] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:55:59.758085 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5324f47-bf3f-4b7b-a353-046e15167ba1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:59.769534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5324f47-bf3f-4b7b-a353-046e15167ba1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:59.769743 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54b8a5-71e9-4146-89c6-5c1c577748e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:59.770803 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54b8a5-71e9-4146-89c6-5c1c577748e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.771266 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54b8a5-71e9-4146-89c6-5c1c577748e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.771654 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54b8a5-71e9-4146-89c6-5c1c577748e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.772388 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54b8a5-71e9-4146-89c6-5c1c577748e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:55:59.772796 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54b8a5-71e9-4146-89c6-5c1c577748e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:59.774334 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54b8a5-71e9-4146-89c6-5c1c577748e1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:59.775922 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c2397-f0b9-433c-ac18-08af0992c305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:59.776680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c2397-f0b9-433c-ac18-08af0992c305 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.777064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c2397-f0b9-433c-ac18-08af0992c305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.777452 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c2397-f0b9-433c-ac18-08af0992c305 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.778184 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c2397-f0b9-433c-ac18-08af0992c305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:59.780240 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c2397-f0b9-433c-ac18-08af0992c305 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:59.787886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 795/1574] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:55:59.788616 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54b8a5-71e9-4146-89c6-5c1c577748e1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:59.800645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54b8a5-71e9-4146-89c6-5c1c577748e1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:59.811962 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 780/1575] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:55:59 2022] POST /identity/v3/users => generated 287 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:55:59.811962 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c2397-f0b9-433c-ac18-08af0992c305 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:59.813535 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11126d-5f96-45d0-91bf-1445fcb7d060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:59.814186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11126d-5f96-45d0-91bf-1445fcb7d060 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.814520 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11126d-5f96-45d0-91bf-1445fcb7d060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.814799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11126d-5f96-45d0-91bf-1445fcb7d060 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.815479 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11126d-5f96-45d0-91bf-1445fcb7d060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:59.817716 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11126d-5f96-45d0-91bf-1445fcb7d060 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:59.823537 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c2397-f0b9-433c-ac18-08af0992c305 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:59.829527 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e1be7-a3d8-4749-85ab-f7b6d2e44afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:59.830244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e1be7-a3d8-4749-85ab-f7b6d2e44afc admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.830582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e1be7-a3d8-4749-85ab-f7b6d2e44afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.830927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e1be7-a3d8-4749-85ab-f7b6d2e44afc admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.831642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e1be7-a3d8-4749-85ab-f7b6d2e44afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:59.834647 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e1be7-a3d8-4749-85ab-f7b6d2e44afc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:59.842308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 796/1576] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:55:59.843615 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11126d-5f96-45d0-91bf-1445fcb7d060 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:59.858191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11126d-5f96-45d0-91bf-1445fcb7d060 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:59.863857 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895350f-43d6-48cd-8b41-2374c0029d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:59.864906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895350f-43d6-48cd-8b41-2374c0029d7d admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.865392 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895350f-43d6-48cd-8b41-2374c0029d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.865820 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b895350f-43d6-48cd-8b41-2374c0029d7d admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.866622 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895350f-43d6-48cd-8b41-2374c0029d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:59.869148 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b895350f-43d6-48cd-8b41-2374c0029d7d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:59.870460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 781/1577] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:55:59 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:55:59.871856 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e1be7-a3d8-4749-85ab-f7b6d2e44afc admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:59.902258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 797/1578] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:55:59 2022] POST /identity/v3/users => generated 290 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:55:59.903583 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895350f-43d6-48cd-8b41-2374c0029d7d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:59.916622 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b895350f-43d6-48cd-8b41-2374c0029d7d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:59.948555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e1be7-a3d8-4749-85ab-f7b6d2e44afc admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:55:59.953983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0223483-4198-4c76-a009-8280cf88cbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:59.954720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0223483-4198-4c76-a009-8280cf88cbe9 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.955074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0223483-4198-4c76-a009-8280cf88cbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.955427 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0223483-4198-4c76-a009-8280cf88cbe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.956362 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0223483-4198-4c76-a009-8280cf88cbe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:59.959152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0223483-4198-4c76-a009-8280cf88cbe9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:55:59.987555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 782/1579] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:55:59 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:55:59.988486 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0223483-4198-4c76-a009-8280cf88cbe9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:55:59.988639 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5a6d0-e4fa-4e99-8c41-d3c8a146e716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:55:59.989463 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5a6d0-e4fa-4e99-8c41-d3c8a146e716 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:55:59.989788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5a6d0-e4fa-4e99-8c41-d3c8a146e716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:55:59.990110 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5a6d0-e4fa-4e99-8c41-d3c8a146e716 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:55:59.991277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5a6d0-e4fa-4e99-8c41-d3c8a146e716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:55:59.993238 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5a6d0-e4fa-4e99-8c41-d3c8a146e716 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:00.022926 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 798/1580] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:55:59 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:00.024139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5a6d0-e4fa-4e99-8c41-d3c8a146e716 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:00.073883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0223483-4198-4c76-a009-8280cf88cbe9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:00.102795 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5a6d0-e4fa-4e99-8c41-d3c8a146e716 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:00.108835 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffe024-96b3-478d-9e1e-fd2d6e451a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:00.110217 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:00.110348 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffe024-96b3-478d-9e1e-fd2d6e451a09 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.110636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffe024-96b3-478d-9e1e-fd2d6e451a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.110916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffe024-96b3-478d-9e1e-fd2d6e451a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.111729 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffe024-96b3-478d-9e1e-fd2d6e451a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:00.113365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffe024-96b3-478d-9e1e-fd2d6e451a09 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:00.126698 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 799/1581] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:00.127618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffe024-96b3-478d-9e1e-fd2d6e451a09 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:00.139342 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffe024-96b3-478d-9e1e-fd2d6e451a09 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:00.144255 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34d20c-d11e-4f96-bba8-a5474df4c677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:00.144909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34d20c-d11e-4f96-bba8-a5474df4c677 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.145134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34d20c-d11e-4f96-bba8-a5474df4c677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.146032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34d20c-d11e-4f96-bba8-a5474df4c677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.146771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34d20c-d11e-4f96-bba8-a5474df4c677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:00.148421 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34d20c-d11e-4f96-bba8-a5474df4c677 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:00.149838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce553f7e-8ca2-47a0-a615-07184a69040f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:00.151184 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce553f7e-8ca2-47a0-a615-07184a69040f admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.151511 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce553f7e-8ca2-47a0-a615-07184a69040f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.151845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce553f7e-8ca2-47a0-a615-07184a69040f admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.152650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce553f7e-8ca2-47a0-a615-07184a69040f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:00.155284 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce553f7e-8ca2-47a0-a615-07184a69040f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:00.162377 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 800/1582] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:00.162377 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34d20c-d11e-4f96-bba8-a5474df4c677 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:00.172231 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34d20c-d11e-4f96-bba8-a5474df4c677 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:00.178931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e172e-2ec8-46e9-83f9-e0981c204e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:00.179607 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e172e-2ec8-46e9-83f9-e0981c204e47 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.180035 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e172e-2ec8-46e9-83f9-e0981c204e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.180323 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e172e-2ec8-46e9-83f9-e0981c204e47 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.181002 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e172e-2ec8-46e9-83f9-e0981c204e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:00.182972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e172e-2ec8-46e9-83f9-e0981c204e47 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:00.191181 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 783/1583] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:55:59 2022] POST /identity/v3/projects => generated 383 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:00.194308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce553f7e-8ca2-47a0-a615-07184a69040f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:00.200736 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:00.216950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 801/1584] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:00 2022] POST /identity/v3/users => generated 288 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:00.217906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e172e-2ec8-46e9-83f9-e0981c204e47 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:00.231478 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e172e-2ec8-46e9-83f9-e0981c204e47 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:00.288548 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce553f7e-8ca2-47a0-a615-07184a69040f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:00.294030 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd740ef2-003c-4833-95ae-88ee8a213aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:00.295129 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd740ef2-003c-4833-95ae-88ee8a213aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.295587 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd740ef2-003c-4833-95ae-88ee8a213aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.296291 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd740ef2-003c-4833-95ae-88ee8a213aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.297456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd740ef2-003c-4833-95ae-88ee8a213aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:00.299572 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd740ef2-003c-4833-95ae-88ee8a213aa6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:00.315000 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 784/1585] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:00.316071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd740ef2-003c-4833-95ae-88ee8a213aa6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:00.319607 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222699c-76e6-4920-a267-def7c52bde00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:00.320865 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222699c-76e6-4920-a267-def7c52bde00 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.321311 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222699c-76e6-4920-a267-def7c52bde00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.321737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222699c-76e6-4920-a267-def7c52bde00 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.322528 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222699c-76e6-4920-a267-def7c52bde00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:00.325172 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222699c-76e6-4920-a267-def7c52bde00 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:00.328990 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd740ef2-003c-4833-95ae-88ee8a213aa6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:00.335363 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50563200-4381-4424-a222-c7ee1495896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:00.336166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50563200-4381-4424-a222-c7ee1495896a admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.336938 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50563200-4381-4424-a222-c7ee1495896a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.337371 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50563200-4381-4424-a222-c7ee1495896a admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.338580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50563200-4381-4424-a222-c7ee1495896a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:00.342580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50563200-4381-4424-a222-c7ee1495896a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:00.355869 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 802/1586] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:00 2022] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:00.360578 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222699c-76e6-4920-a267-def7c52bde00 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:00.374293 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222699c-76e6-4920-a267-def7c52bde00 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:00.378969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 785/1587] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:00 2022] POST /identity/v3/users => generated 292 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:00.381184 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5eac52-a688-47f6-b51e-91aebfcbf6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:00.381409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50563200-4381-4424-a222-c7ee1495896a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:00.381864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5eac52-a688-47f6-b51e-91aebfcbf6ca admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.382297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5eac52-a688-47f6-b51e-91aebfcbf6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.382625 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5eac52-a688-47f6-b51e-91aebfcbf6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.383283 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5eac52-a688-47f6-b51e-91aebfcbf6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:00.385024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5eac52-a688-47f6-b51e-91aebfcbf6ca admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:00.392249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50563200-4381-4424-a222-c7ee1495896a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:00.398556 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 803/1588] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:00.399811 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5eac52-a688-47f6-b51e-91aebfcbf6ca admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:00.400441 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4426c-cfdf-4cb2-b0e0-6f004a12b722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:00.401213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4426c-cfdf-4cb2-b0e0-6f004a12b722 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.401890 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4426c-cfdf-4cb2-b0e0-6f004a12b722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.402168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4426c-cfdf-4cb2-b0e0-6f004a12b722 admin admin] PATH_INFO: `/v3/projects/b62c2e013806475b8a5afe666d530744/users/c09627123f8e409fadd35bca01ea80dd/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.412931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5eac52-a688-47f6-b51e-91aebfcbf6ca admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:00.418852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387238bb-413b-4160-bce0-d0bed9758e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:00.419729 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387238bb-413b-4160-bce0-d0bed9758e9f admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.420033 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387238bb-413b-4160-bce0-d0bed9758e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.420360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387238bb-413b-4160-bce0-d0bed9758e9f admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.421108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387238bb-413b-4160-bce0-d0bed9758e9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:00.423111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4426c-cfdf-4cb2-b0e0-6f004a12b722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b62c2e013806475b8a5afe666d530744, user_id=c09627123f8e409fadd35bca01ea80dd, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:00.423327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387238bb-413b-4160-bce0-d0bed9758e9f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:00.429072 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4426c-cfdf-4cb2-b0e0-6f004a12b722 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:00.455810 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 786/1589] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:00 2022] PUT /identity/v3/projects/b62c2e013806475b8a5afe666d530744/users/c09627123f8e409fadd35bca01ea80dd/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:00.456804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4426c-cfdf-4cb2-b0e0-6f004a12b722 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:00.469031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 804/1590] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:00 2022] POST /identity/v3/users => generated 292 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:00.470345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387238bb-413b-4160-bce0-d0bed9758e9f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:00.481936 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387238bb-413b-4160-bce0-d0bed9758e9f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:00.543921 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4426c-cfdf-4cb2-b0e0-6f004a12b722 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:00.550230 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b0222-e04a-4258-8cba-31f5d8084f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:00.550507 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5305f-7451-4da6-9421-1a74a8221c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:00.550913 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b0222-e04a-4258-8cba-31f5d8084f96 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.551198 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b0222-e04a-4258-8cba-31f5d8084f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.552197 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b0222-e04a-4258-8cba-31f5d8084f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.552545 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5305f-7451-4da6-9421-1a74a8221c15 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.552825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5305f-7451-4da6-9421-1a74a8221c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.553123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b0222-e04a-4258-8cba-31f5d8084f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:00.553233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5305f-7451-4da6-9421-1a74a8221c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.553853 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5305f-7451-4da6-9421-1a74a8221c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:00.555089 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b0222-e04a-4258-8cba-31f5d8084f96 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:00.555582 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5305f-7451-4da6-9421-1a74a8221c15 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:00.572957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 805/1591] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:00.573173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 787/1592] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:00.573173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b0222-e04a-4258-8cba-31f5d8084f96 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:00.573359 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5305f-7451-4da6-9421-1a74a8221c15 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:00.579766 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b0222-e04a-4258-8cba-31f5d8084f96 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:00.579944 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5305f-7451-4da6-9421-1a74a8221c15 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:00.590871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d9c80-8db3-45e6-9320-e8e46179116b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:00.591540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d9c80-8db3-45e6-9320-e8e46179116b admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.591823 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d9c80-8db3-45e6-9320-e8e46179116b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.592265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d9c80-8db3-45e6-9320-e8e46179116b admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.593117 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d9c80-8db3-45e6-9320-e8e46179116b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:00.593862 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089808a6-3c0e-4b1d-8df5-736e51f3397d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:00.594731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089808a6-3c0e-4b1d-8df5-736e51f3397d admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.594938 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d9c80-8db3-45e6-9320-e8e46179116b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:00.595048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089808a6-3c0e-4b1d-8df5-736e51f3397d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.595269 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089808a6-3c0e-4b1d-8df5-736e51f3397d admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.595909 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089808a6-3c0e-4b1d-8df5-736e51f3397d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:00.597680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089808a6-3c0e-4b1d-8df5-736e51f3397d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:00.607418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 806/1593] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:00.611529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d9c80-8db3-45e6-9320-e8e46179116b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:00.612619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 788/1594] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:00.615371 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faea86-51b2-44bd-af27-beb9857d15d2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.615664 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faea86-51b2-44bd-af27-beb9857d15d2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.615943 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faea86-51b2-44bd-af27-beb9857d15d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.623685 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:00.625540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d9c80-8db3-45e6-9320-e8e46179116b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:00.632332 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b0206-454f-4fb5-88c6-f39460831474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:00.633126 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b0206-454f-4fb5-88c6-f39460831474 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.633469 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b0206-454f-4fb5-88c6-f39460831474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.633820 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b0206-454f-4fb5-88c6-f39460831474 admin admin] PATH_INFO: `/v3/projects/a2f0ff717a2f46bfa727a3d13e232266/users/e54c64f1a9c54942a6d096b8ec4012b7/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.651511 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-29faea86-51b2-44bd-af27-beb9857d15d2 None None] MFA Rules not processed for user `c09627123f8e409fadd35bca01ea80dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:00.652768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-29faea86-51b2-44bd-af27-beb9857d15d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:00.659285 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b0206-454f-4fb5-88c6-f39460831474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f0ff717a2f46bfa727a3d13e232266, user_id=e54c64f1a9c54942a6d096b8ec4012b7, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:00.662746 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b0206-454f-4fb5-88c6-f39460831474 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:00.682214 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 807/1595] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:00 2022] PUT /identity/v3/projects/a2f0ff717a2f46bfa727a3d13e232266/users/e54c64f1a9c54942a6d096b8ec4012b7/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:00.683402 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b0206-454f-4fb5-88c6-f39460831474 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:00.712117 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:00.749077 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 789/1596] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:00.750006 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faea86-51b2-44bd-af27-beb9857d15d2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:00.762753 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faea86-51b2-44bd-af27-beb9857d15d2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:00.777546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b0206-454f-4fb5-88c6-f39460831474 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:00.783896 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c2b36-e966-4a32-9fe7-4e45634bc26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:00.784988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c2b36-e966-4a32-9fe7-4e45634bc26e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.785366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c2b36-e966-4a32-9fe7-4e45634bc26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.785996 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c2b36-e966-4a32-9fe7-4e45634bc26e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.789497 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c2b36-e966-4a32-9fe7-4e45634bc26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:00.791795 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c2b36-e966-4a32-9fe7-4e45634bc26e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:00.805403 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 808/1597] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:00.806751 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c2b36-e966-4a32-9fe7-4e45634bc26e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:00.820576 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c2b36-e966-4a32-9fe7-4e45634bc26e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:00.827139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc5d7f-0692-4043-ab37-474358009ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:00.828311 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc5d7f-0692-4043-ab37-474358009ccb admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.828649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc5d7f-0692-4043-ab37-474358009ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.829023 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bc5d7f-0692-4043-ab37-474358009ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.829930 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc5d7f-0692-4043-ab37-474358009ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:00.832622 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bc5d7f-0692-4043-ab37-474358009ccb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:00.841236 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc8425-721c-47cb-a8b1-9f626702e1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:00.842170 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc8425-721c-47cb-a8b1-9f626702e1c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.842651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc8425-721c-47cb-a8b1-9f626702e1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.843117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc8425-721c-47cb-a8b1-9f626702e1c9 admin admin] PATH_INFO: `/v3/projects/f727d3f348504a00859acb47fcaf976f/users/041b8276308c417fa43afe8d052ac0fb/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.849569 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 809/1598] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:00.849569 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc5d7f-0692-4043-ab37-474358009ccb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:00.861962 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bc5d7f-0692-4043-ab37-474358009ccb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:00.869580 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8ca46-f200-4e01-817f-919d4489ac16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:00.869894 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8ca46-f200-4e01-817f-919d4489ac16 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.870420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8ca46-f200-4e01-817f-919d4489ac16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.870816 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8ca46-f200-4e01-817f-919d4489ac16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.871605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc8425-721c-47cb-a8b1-9f626702e1c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f727d3f348504a00859acb47fcaf976f, user_id=041b8276308c417fa43afe8d052ac0fb, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:00.871736 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8ca46-f200-4e01-817f-919d4489ac16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:00.873815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8ca46-f200-4e01-817f-919d4489ac16 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:00.875193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc8425-721c-47cb-a8b1-9f626702e1c9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:00.890150 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 810/1599] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:00.894383 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8ca46-f200-4e01-817f-919d4489ac16 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:00.899219 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 790/1600] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:00 2022] PUT /identity/v3/projects/f727d3f348504a00859acb47fcaf976f/users/041b8276308c417fa43afe8d052ac0fb/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:00.901882 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8fe23-2060-4da1-b3a0-f35fa8e4ffd1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.902529 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8fe23-2060-4da1-b3a0-f35fa8e4ffd1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.902662 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8fe23-2060-4da1-b3a0-f35fa8e4ffd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.908797 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8ca46-f200-4e01-817f-919d4489ac16 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:00.940037 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8fe8fe23-2060-4da1-b3a0-f35fa8e4ffd1 None None] MFA Rules not processed for user `e54c64f1a9c54942a6d096b8ec4012b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:00.941312 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8fe8fe23-2060-4da1-b3a0-f35fa8e4ffd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:00.980078 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48e597-a63a-419d-8669-58b61d84b680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:00.980611 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48e597-a63a-419d-8669-58b61d84b680 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:00.980894 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48e597-a63a-419d-8669-58b61d84b680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:00.981168 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48e597-a63a-419d-8669-58b61d84b680 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:00.981824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48e597-a63a-419d-8669-58b61d84b680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:00.983444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48e597-a63a-419d-8669-58b61d84b680 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:00.995598 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 811/1601] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:00.996235 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48e597-a63a-419d-8669-58b61d84b680 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:01.011202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48e597-a63a-419d-8669-58b61d84b680 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:01.017263 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff384b54-9dfc-43b6-bb50-9ec3de9dbeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:01.018517 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff384b54-9dfc-43b6-bb50-9ec3de9dbeb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:01.018809 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff384b54-9dfc-43b6-bb50-9ec3de9dbeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:01.019091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff384b54-9dfc-43b6-bb50-9ec3de9dbeb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:01.019739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff384b54-9dfc-43b6-bb50-9ec3de9dbeb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:01.021852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff384b54-9dfc-43b6-bb50-9ec3de9dbeb0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:01.030966 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 791/1602] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:01.039787 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8fe23-2060-4da1-b3a0-f35fa8e4ffd1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:01.053417 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:01.060535 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8fe23-2060-4da1-b3a0-f35fa8e4ffd1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:01.073315 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 812/1603] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:00 2022] POST /identity/v3/projects => generated 357 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:01.073315 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff384b54-9dfc-43b6-bb50-9ec3de9dbeb0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:01.078871 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f549dc-6196-4cf6-95d1-1aacfbc38581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:01.079691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f549dc-6196-4cf6-95d1-1aacfbc38581 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:01.079941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f549dc-6196-4cf6-95d1-1aacfbc38581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:01.080246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f549dc-6196-4cf6-95d1-1aacfbc38581 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:01.083553 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f549dc-6196-4cf6-95d1-1aacfbc38581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:01.085272 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f549dc-6196-4cf6-95d1-1aacfbc38581 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:01.112207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 792/1604] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:01.115835 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f549dc-6196-4cf6-95d1-1aacfbc38581 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:01.134062 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f549dc-6196-4cf6-95d1-1aacfbc38581 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:01.179394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff384b54-9dfc-43b6-bb50-9ec3de9dbeb0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:01.185402 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69603bb5-54b2-4d54-90d2-7c8f3e78111a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:01.186101 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69603bb5-54b2-4d54-90d2-7c8f3e78111a admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:01.186427 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69603bb5-54b2-4d54-90d2-7c8f3e78111a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:01.186653 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69603bb5-54b2-4d54-90d2-7c8f3e78111a admin admin] PATH_INFO: `/v3/projects/d81999a127ea4b80b0c301f64c2b8c8d/users/280e5b6f9b10479ba92dda832b6d36ad/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:01.190821 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:01.209351 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69603bb5-54b2-4d54-90d2-7c8f3e78111a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d81999a127ea4b80b0c301f64c2b8c8d, user_id=280e5b6f9b10479ba92dda832b6d36ad, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:01.212718 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69603bb5-54b2-4d54-90d2-7c8f3e78111a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:01.230964 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 813/1605] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:01 2022] PUT /identity/v3/projects/d81999a127ea4b80b0c301f64c2b8c8d/users/280e5b6f9b10479ba92dda832b6d36ad/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:01.232305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58724d8f-8293-45bd-be39-9ba28906c95b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:01.232635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58724d8f-8293-45bd-be39-9ba28906c95b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:01.232978 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58724d8f-8293-45bd-be39-9ba28906c95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:01.242039 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f942f5-d09a-4d41-8248-139b974c0ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:01.244974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f942f5-d09a-4d41-8248-139b974c0ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:01.245469 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f942f5-d09a-4d41-8248-139b974c0ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:01.246131 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f942f5-d09a-4d41-8248-139b974c0ce9 admin admin] PATH_INFO: `/v3/projects/d585f42b0a534b7cbf55a90f5b48e41f/users/af23fcaecde74f71a3e7bc7231194a06/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:01.260163 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-58724d8f-8293-45bd-be39-9ba28906c95b None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:01.261505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-58724d8f-8293-45bd-be39-9ba28906c95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:01.265812 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f942f5-d09a-4d41-8248-139b974c0ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d585f42b0a534b7cbf55a90f5b48e41f, user_id=af23fcaecde74f71a3e7bc7231194a06, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:01.268601 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f942f5-d09a-4d41-8248-139b974c0ce9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:01.288143 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 793/1606] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:01 2022] PUT /identity/v3/projects/d585f42b0a534b7cbf55a90f5b48e41f/users/af23fcaecde74f71a3e7bc7231194a06/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:01.289028 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f942f5-d09a-4d41-8248-139b974c0ce9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:01.353559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 814/1607] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:01.355352 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58724d8f-8293-45bd-be39-9ba28906c95b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:01.401589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58724d8f-8293-45bd-be39-9ba28906c95b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:01.402730 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f942f5-d09a-4d41-8248-139b974c0ce9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:01.410470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99fb54-cfc9-479d-9594-5aa89e1c7aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:01.411488 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99fb54-cfc9-479d-9594-5aa89e1c7aa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:01.411777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99fb54-cfc9-479d-9594-5aa89e1c7aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:01.412257 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99fb54-cfc9-479d-9594-5aa89e1c7aa6 admin admin] PATH_INFO: `/v3/projects/238ecc4ada964fdf8cee7beaa28362f9/users/8ada017c751b47838994c3c9404a5d1d/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:01.448063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99fb54-cfc9-479d-9594-5aa89e1c7aa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=238ecc4ada964fdf8cee7beaa28362f9, user_id=8ada017c751b47838994c3c9404a5d1d, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:01.451119 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99fb54-cfc9-479d-9594-5aa89e1c7aa6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:01.464640 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e47e30-965c-4a8e-b170-3a19d900f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:01.465257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e47e30-965c-4a8e-b170-3a19d900f65f admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:01.465542 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e47e30-965c-4a8e-b170-3a19d900f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:01.465801 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e47e30-965c-4a8e-b170-3a19d900f65f admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:01.466437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e47e30-965c-4a8e-b170-3a19d900f65f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:01.470449 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e47e30-965c-4a8e-b170-3a19d900f65f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:01.474355 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 794/1608] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:01 2022] PUT /identity/v3/projects/238ecc4ada964fdf8cee7beaa28362f9/users/8ada017c751b47838994c3c9404a5d1d/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:01.487204 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77f77c-1b96-4faa-af64-9fd8e0341469 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:01.487204 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77f77c-1b96-4faa-af64-9fd8e0341469 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:01.487479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77f77c-1b96-4faa-af64-9fd8e0341469 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:01.488811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 795/1609] 10.222.0.15 () {54 vars in 962 bytes} [Fri Sep 9 20:56:01 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:56:01.495095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77f77c-1b96-4faa-af64-9fd8e0341469 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:01.511154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 815/1610] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:01 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:01.513222 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea2793-3ff6-4ba0-80f4-d939d69a1160 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:01.513608 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea2793-3ff6-4ba0-80f4-d939d69a1160 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:01.513889 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea2793-3ff6-4ba0-80f4-d939d69a1160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:01.553195 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-95ea2793-3ff6-4ba0-80f4-d939d69a1160 None None] MFA Rules not processed for user `280e5b6f9b10479ba92dda832b6d36ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:01.554553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-95ea2793-3ff6-4ba0-80f4-d939d69a1160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:01.594257 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77f77c-1b96-4faa-af64-9fd8e0341469 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:01.600150 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740884e-964d-458d-8702-90d61950102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:01.601354 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740884e-964d-458d-8702-90d61950102e admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:01.602101 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740884e-964d-458d-8702-90d61950102e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:01.602387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740884e-964d-458d-8702-90d61950102e admin admin] PATH_INFO: `/v3/projects/410f9f5986604ba5bef24b84bc59e4f8/users/9c758557426941babdaa68cbae43f881/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:01.607588 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:01.625102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740884e-964d-458d-8702-90d61950102e admin admin] RBAC: Authorizing `identity:create_grant(project_id=410f9f5986604ba5bef24b84bc59e4f8, user_id=9c758557426941babdaa68cbae43f881, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:01.627855 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740884e-964d-458d-8702-90d61950102e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:01.639573 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 816/1611] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:01.640782 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ec718-8a71-4f7e-ac9f-bce634a4d094 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:01.641066 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ec718-8a71-4f7e-ac9f-bce634a4d094 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:01.641341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ec718-8a71-4f7e-ac9f-bce634a4d094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:01.642616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 796/1612] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:01 2022] PUT /identity/v3/projects/410f9f5986604ba5bef24b84bc59e4f8/users/9c758557426941babdaa68cbae43f881/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:01.643542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740884e-964d-458d-8702-90d61950102e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:01.650760 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:01.665384 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3e2ec718-8a71-4f7e-ac9f-bce634a4d094 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:01.666545 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3e2ec718-8a71-4f7e-ac9f-bce634a4d094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:01.706274 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740884e-964d-458d-8702-90d61950102e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:01.710699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c6b3b-ee8a-496b-bc67-0e04a1908353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:01.711321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c6b3b-ee8a-496b-bc67-0e04a1908353 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:01.711683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c6b3b-ee8a-496b-bc67-0e04a1908353 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:01.712154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c6b3b-ee8a-496b-bc67-0e04a1908353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:01.737185 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 817/1613] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:01.737185 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e284c0-8c52-4d0e-bf48-5bca10dbac94 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:01.737185 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e284c0-8c52-4d0e-bf48-5bca10dbac94 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:01.737185 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e284c0-8c52-4d0e-bf48-5bca10dbac94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:01.769764 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-62e284c0-8c52-4d0e-bf48-5bca10dbac94 None None] MFA Rules not processed for user `8ada017c751b47838994c3c9404a5d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:01.771279 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-62e284c0-8c52-4d0e-bf48-5bca10dbac94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:01.789005 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c6b3b-ee8a-496b-bc67-0e04a1908353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:01.791009 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c6b3b-ee8a-496b-bc67-0e04a1908353 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:01.803446 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 797/1614] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:01.804991 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0934f7-b098-4671-a4be-efe3419d52d3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:01.805377 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0934f7-b098-4671-a4be-efe3419d52d3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:01.805734 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0934f7-b098-4671-a4be-efe3419d52d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:01.852203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 818/1615] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:01.853148 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e284c0-8c52-4d0e-bf48-5bca10dbac94 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:01.858430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8f0934f7-b098-4671-a4be-efe3419d52d3 None None] MFA Rules not processed for user `dc210376e57a41e6b3812110db249099`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:01.859810 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8f0934f7-b098-4671-a4be-efe3419d52d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:01.864917 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e284c0-8c52-4d0e-bf48-5bca10dbac94 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:01.870313 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af6952-138f-40b2-990a-9e8f6eb52ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:01.870943 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af6952-138f-40b2-990a-9e8f6eb52ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:01.871198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af6952-138f-40b2-990a-9e8f6eb52ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:01.871473 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af6952-138f-40b2-990a-9e8f6eb52ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:01.872159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af6952-138f-40b2-990a-9e8f6eb52ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:01.873769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af6952-138f-40b2-990a-9e8f6eb52ff4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:01.887864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 819/1616] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:01.888610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af6952-138f-40b2-990a-9e8f6eb52ff4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:01.904053 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af6952-138f-40b2-990a-9e8f6eb52ff4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:01.911554 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7badf-7e5d-41fe-8e9f-f3c8701f0223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:01.912515 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7badf-7e5d-41fe-8e9f-f3c8701f0223 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:01.912854 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7badf-7e5d-41fe-8e9f-f3c8701f0223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:01.913493 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7badf-7e5d-41fe-8e9f-f3c8701f0223 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:01.914147 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7badf-7e5d-41fe-8e9f-f3c8701f0223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:01.916185 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7badf-7e5d-41fe-8e9f-f3c8701f0223 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:01.965266 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 820/1617] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:01 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:01.966632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3fba6-7f31-4966-8008-57e7bcc4e233 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:01.966919 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3fba6-7f31-4966-8008-57e7bcc4e233 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:01.967195 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3fba6-7f31-4966-8008-57e7bcc4e233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:01.989839 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7ec3fba6-7f31-4966-8008-57e7bcc4e233 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:01.991321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7ec3fba6-7f31-4966-8008-57e7bcc4e233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:01.994783 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 798/1618] 10.222.0.15 () {58 vars in 1059 bytes} [Fri Sep 9 20:56:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:01.996351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0934f7-b098-4671-a4be-efe3419d52d3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:02.016359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0934f7-b098-4671-a4be-efe3419d52d3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:02.037528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:02.072978 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 821/1619] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:02.074162 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cf73b-3dc7-4752-a74b-ae75962b1a5d None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:02.074393 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cf73b-3dc7-4752-a74b-ae75962b1a5d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:02.074675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9cf73b-3dc7-4752-a74b-ae75962b1a5d None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:02.076467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 822/1620] 10.222.0.15 () {54 vars in 962 bytes} [Fri Sep 9 20:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:56:02.084188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cf73b-3dc7-4752-a74b-ae75962b1a5d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:02.093113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:02.104025 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9cf73b-3dc7-4752-a74b-ae75962b1a5d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:02.111930 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3568b8e-ac10-47b2-bb02-c6f4827c500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:02.113068 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3568b8e-ac10-47b2-bb02-c6f4827c500e admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:02.113544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3568b8e-ac10-47b2-bb02-c6f4827c500e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:02.114163 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3568b8e-ac10-47b2-bb02-c6f4827c500e admin admin] PATH_INFO: `/v3/projects/3a7bf7486b6542eb86fb1bd4bf73fa7c/users/569dc2d44846425a8d02d7be2dd79b8a/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:02.128576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b63a5-6fa8-4c71-aa67-45ac9e7eb900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:02.129228 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b63a5-6fa8-4c71-aa67-45ac9e7eb900 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:02.130245 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b63a5-6fa8-4c71-aa67-45ac9e7eb900 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:02.130702 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b63a5-6fa8-4c71-aa67-45ac9e7eb900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:02.137531 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3568b8e-ac10-47b2-bb02-c6f4827c500e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a7bf7486b6542eb86fb1bd4bf73fa7c, user_id=569dc2d44846425a8d02d7be2dd79b8a, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:02.142989 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3568b8e-ac10-47b2-bb02-c6f4827c500e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:02.145948 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b63a5-6fa8-4c71-aa67-45ac9e7eb900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:02.147576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b63a5-6fa8-4c71-aa67-45ac9e7eb900 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:02.173463 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 823/1621] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:02 2022] PUT /identity/v3/projects/3a7bf7486b6542eb86fb1bd4bf73fa7c/users/569dc2d44846425a8d02d7be2dd79b8a/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:02.174421 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3568b8e-ac10-47b2-bb02-c6f4827c500e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:02.183486 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 799/1622] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:02.185885 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b63a5-6fa8-4c71-aa67-45ac9e7eb900 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:02.340888 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3568b8e-ac10-47b2-bb02-c6f4827c500e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:02.352158 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b63a5-6fa8-4c71-aa67-45ac9e7eb900 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:02.370855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1d982-0d1b-44a6-993d-bfa6ef103388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:02.371521 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1d982-0d1b-44a6-993d-bfa6ef103388 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:02.371933 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1d982-0d1b-44a6-993d-bfa6ef103388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:02.372308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1d982-0d1b-44a6-993d-bfa6ef103388 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:02.373025 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1d982-0d1b-44a6-993d-bfa6ef103388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:02.375366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1d982-0d1b-44a6-993d-bfa6ef103388 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:02.432688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 824/1623] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:02 2022] POST /identity/v3/users => generated 295 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:02.434096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f14100-bb51-421f-8692-65878aa38ed8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:02.434387 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f14100-bb51-421f-8692-65878aa38ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:02.434661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f14100-bb51-421f-8692-65878aa38ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:02.475595 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd0644-cc91-455d-b518-06eafee6c103 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:02.476325 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd0644-cc91-455d-b518-06eafee6c103 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:02.477675 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd0644-cc91-455d-b518-06eafee6c103 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:02.478207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd0644-cc91-455d-b518-06eafee6c103 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:02.493048 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-61f14100-bb51-421f-8692-65878aa38ed8 None None] MFA Rules not processed for user `dc210376e57a41e6b3812110db249099`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:02.494883 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-61f14100-bb51-421f-8692-65878aa38ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:02.528610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 825/1624] 10.222.0.15 () {58 vars in 1059 bytes} [Fri Sep 9 20:56:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:02.530721 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f14100-bb51-421f-8692-65878aa38ed8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:02.587168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:02.597257 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd0644-cc91-455d-b518-06eafee6c103 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:02.599246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd0644-cc91-455d-b518-06eafee6c103 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:02.613479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 800/1625] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:02.615329 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd0644-cc91-455d-b518-06eafee6c103 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:02.628214 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd0644-cc91-455d-b518-06eafee6c103 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:02.635462 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8f1ad-a241-4ab8-a4b6-cbfc2f3f120c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:02.636226 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8f1ad-a241-4ab8-a4b6-cbfc2f3f120c admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:02.636554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8f1ad-a241-4ab8-a4b6-cbfc2f3f120c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:02.636834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8f1ad-a241-4ab8-a4b6-cbfc2f3f120c admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:02.637491 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8f1ad-a241-4ab8-a4b6-cbfc2f3f120c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:02.640537 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8f1ad-a241-4ab8-a4b6-cbfc2f3f120c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:02.668591 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 801/1626] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:02.669562 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8f1ad-a241-4ab8-a4b6-cbfc2f3f120c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:02.679802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f14100-bb51-421f-8692-65878aa38ed8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:02.681583 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8f1ad-a241-4ab8-a4b6-cbfc2f3f120c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:02.687957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7e11e-d550-4289-af31-a4f7ed9fc1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:02.688793 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7e11e-d550-4289-af31-a4f7ed9fc1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:02.689085 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7e11e-d550-4289-af31-a4f7ed9fc1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:02.689262 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2520181-2d24-4693-aeab-ad0ce173d401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:02.689384 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b7e11e-d550-4289-af31-a4f7ed9fc1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:02.689863 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2520181-2d24-4693-aeab-ad0ce173d401 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:02.690046 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7e11e-d550-4289-af31-a4f7ed9fc1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:02.690840 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2520181-2d24-4693-aeab-ad0ce173d401 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:02.691601 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2520181-2d24-4693-aeab-ad0ce173d401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:02.691717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b7e11e-d550-4289-af31-a4f7ed9fc1f5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:02.713956 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2520181-2d24-4693-aeab-ad0ce173d401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:02.717813 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2520181-2d24-4693-aeab-ad0ce173d401 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:02.732058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 802/1627] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:02.733200 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7e11e-d550-4289-af31-a4f7ed9fc1f5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:02.747872 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 826/1628] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:02.749019 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2520181-2d24-4693-aeab-ad0ce173d401 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:02.755891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b7e11e-d550-4289-af31-a4f7ed9fc1f5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:02.763069 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1277af-46cc-4d4f-ad14-1aeb8eca3c55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:02.763707 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1277af-46cc-4d4f-ad14-1aeb8eca3c55 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:02.764009 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1277af-46cc-4d4f-ad14-1aeb8eca3c55 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:02.764368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1277af-46cc-4d4f-ad14-1aeb8eca3c55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:02.773608 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2520181-2d24-4693-aeab-ad0ce173d401 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:02.784517 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ec861-b18b-4812-a7a9-9e7e095efc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:02.787252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ec861-b18b-4812-a7a9-9e7e095efc63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:02.787585 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ec861-b18b-4812-a7a9-9e7e095efc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:02.788646 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ec861-b18b-4812-a7a9-9e7e095efc63 admin admin] PATH_INFO: `/v3/projects/3a7bf7486b6542eb86fb1bd4bf73fa7c/users/569dc2d44846425a8d02d7be2dd79b8a/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:02.793653 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ec861-b18b-4812-a7a9-9e7e095efc63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a7bf7486b6542eb86fb1bd4bf73fa7c, user_id=569dc2d44846425a8d02d7be2dd79b8a, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:02.799475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ec861-b18b-4812-a7a9-9e7e095efc63 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:02.827861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 827/1629] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:02 2022] PUT /identity/v3/projects/3a7bf7486b6542eb86fb1bd4bf73fa7c/users/569dc2d44846425a8d02d7be2dd79b8a/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:02.829110 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ec861-b18b-4812-a7a9-9e7e095efc63 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:02.855830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1277af-46cc-4d4f-ad14-1aeb8eca3c55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:02.857565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1277af-46cc-4d4f-ad14-1aeb8eca3c55 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:02.878441 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 803/1630] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:02.879883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f5bf3-2254-4cb4-abce-1f32aa220256 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:02.880200 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f5bf3-2254-4cb4-abce-1f32aa220256 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:02.881596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f5bf3-2254-4cb4-abce-1f32aa220256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:02.916053 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4b8f5bf3-2254-4cb4-abce-1f32aa220256 None None] MFA Rules not processed for user `569dc2d44846425a8d02d7be2dd79b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:02.917408 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4b8f5bf3-2254-4cb4-abce-1f32aa220256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:03.009842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 804/1631] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:02 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:03.018487 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f5bf3-2254-4cb4-abce-1f32aa220256 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:03.041596 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:03.082770 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ec861-b18b-4812-a7a9-9e7e095efc63 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:03.098788 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f5bf3-2254-4cb4-abce-1f32aa220256 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:03.104316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714681b-57ca-4706-8e24-74e210960120 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:03.104956 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714681b-57ca-4706-8e24-74e210960120 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:03.105236 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714681b-57ca-4706-8e24-74e210960120 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:03.105511 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714681b-57ca-4706-8e24-74e210960120 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:03.110310 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2054cc6-c4f1-40f9-9c77-fb1570b82c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:03.112478 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:03.112604 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2054cc6-c4f1-40f9-9c77-fb1570b82c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:03.112792 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2054cc6-c4f1-40f9-9c77-fb1570b82c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:03.116439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2054cc6-c4f1-40f9-9c77-fb1570b82c3f admin admin] PATH_INFO: `/v3/projects/555c401d47bd474d889a98a8b3bedb33/users/f54e196fead948cf8e75ebdc93670a0a/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:03.117862 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714681b-57ca-4706-8e24-74e210960120 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:03.120402 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714681b-57ca-4706-8e24-74e210960120 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:03.143834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 805/1632] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:03 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:03.170691 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2054cc6-c4f1-40f9-9c77-fb1570b82c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=555c401d47bd474d889a98a8b3bedb33, user_id=f54e196fead948cf8e75ebdc93670a0a, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:03.186617 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2054cc6-c4f1-40f9-9c77-fb1570b82c3f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:03.218898 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 828/1633] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:02 2022] PUT /identity/v3/projects/555c401d47bd474d889a98a8b3bedb33/users/f54e196fead948cf8e75ebdc93670a0a/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:03.223037 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714681b-57ca-4706-8e24-74e210960120 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:03.241541 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714681b-57ca-4706-8e24-74e210960120 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:03.269218 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d1712-bf6f-47ee-bd63-2873ec9e65ac None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:03.269597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d1712-bf6f-47ee-bd63-2873ec9e65ac None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:03.269880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d1712-bf6f-47ee-bd63-2873ec9e65ac None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:03.271468 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 829/1634] 10.222.0.15 () {54 vars in 912 bytes} [Fri Sep 9 20:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:56:03.281470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef8133-33bc-40d8-aefc-9daf2b313130 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:03.281943 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef8133-33bc-40d8-aefc-9daf2b313130 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:03.282229 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef8133-33bc-40d8-aefc-9daf2b313130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:03.352582 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e9ef8133-33bc-40d8-aefc-9daf2b313130 None None] MFA Rules not processed for user `dc210376e57a41e6b3812110db249099`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:03.360355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e9ef8133-33bc-40d8-aefc-9daf2b313130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:03.430574 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc819e-7119-43cb-83cd-f9fb166e8836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:03.431834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc819e-7119-43cb-83cd-f9fb166e8836 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:03.432280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc819e-7119-43cb-83cd-f9fb166e8836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:03.432660 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fc819e-7119-43cb-83cd-f9fb166e8836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:03.434040 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc819e-7119-43cb-83cd-f9fb166e8836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:03.436316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fc819e-7119-43cb-83cd-f9fb166e8836 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:03.454739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 806/1635] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:03.454739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc819e-7119-43cb-83cd-f9fb166e8836 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:03.574406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fc819e-7119-43cb-83cd-f9fb166e8836 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:03.584355 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee914bf3-ac1d-4a4f-aa23-4093e5d5b935 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:03.587478 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee914bf3-ac1d-4a4f-aa23-4093e5d5b935 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:03.588626 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee914bf3-ac1d-4a4f-aa23-4093e5d5b935 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:03.589594 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee914bf3-ac1d-4a4f-aa23-4093e5d5b935 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:03.611704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 830/1636] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Sep 9 20:56:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:56:03.618448 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef8133-33bc-40d8-aefc-9daf2b313130 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:03.648770 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef8133-33bc-40d8-aefc-9daf2b313130 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:03.672110 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f994c-4414-4d21-9aa0-89e7fcc0ae2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:03.672843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f994c-4414-4d21-9aa0-89e7fcc0ae2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:03.673121 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f994c-4414-4d21-9aa0-89e7fcc0ae2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:03.673398 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f994c-4414-4d21-9aa0-89e7fcc0ae2b admin admin] PATH_INFO: `/v3/projects/555c401d47bd474d889a98a8b3bedb33/users/f54e196fead948cf8e75ebdc93670a0a/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:03.683718 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f994c-4414-4d21-9aa0-89e7fcc0ae2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=555c401d47bd474d889a98a8b3bedb33, user_id=f54e196fead948cf8e75ebdc93670a0a, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:03.686535 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f994c-4414-4d21-9aa0-89e7fcc0ae2b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:03.718814 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 831/1637] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:03 2022] PUT /identity/v3/projects/555c401d47bd474d889a98a8b3bedb33/users/f54e196fead948cf8e75ebdc93670a0a/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:03.719703 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f994c-4414-4d21-9aa0-89e7fcc0ae2b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:03.773962 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee914bf3-ac1d-4a4f-aa23-4093e5d5b935 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:03.775495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee914bf3-ac1d-4a4f-aa23-4093e5d5b935 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:03.797338 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 807/1638] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:03.818118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ccb0a-e373-4bfa-a4f0-660589d65688 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:03.818476 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ccb0a-e373-4bfa-a4f0-660589d65688 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:03.821088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ccb0a-e373-4bfa-a4f0-660589d65688 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:03.822392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 808/1639] 10.222.0.15 () {54 vars in 912 bytes} [Fri Sep 9 20:56:03 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:56:03.835156 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bc554-8961-4813-895a-a9372a16498a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:03.836614 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bc554-8961-4813-895a-a9372a16498a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:03.836927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8bc554-8961-4813-895a-a9372a16498a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:03.858382 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f994c-4414-4d21-9aa0-89e7fcc0ae2b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:03.864115 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51d8bc-a41e-4083-9355-8a12c004db27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:03.865151 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51d8bc-a41e-4083-9355-8a12c004db27 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:03.865439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51d8bc-a41e-4083-9355-8a12c004db27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:03.865781 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51d8bc-a41e-4083-9355-8a12c004db27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:03.944597 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-da8bc554-8961-4813-895a-a9372a16498a None None] MFA Rules not processed for user `f54e196fead948cf8e75ebdc93670a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:03.946176 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-da8bc554-8961-4813-895a-a9372a16498a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:04.007628 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:04.018841 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51d8bc-a41e-4083-9355-8a12c004db27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:04.019971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:04.020566 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51d8bc-a41e-4083-9355-8a12c004db27 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:04.044550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 832/1640] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:04.045849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871fa0-360d-4ce8-a4ff-e3bccb81f48b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:04.046263 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871fa0-360d-4ce8-a4ff-e3bccb81f48b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:04.046544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871fa0-360d-4ce8-a4ff-e3bccb81f48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:04.094082 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4d871fa0-360d-4ce8-a4ff-e3bccb81f48b None None] MFA Rules not processed for user `dc210376e57a41e6b3812110db249099`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:04.095341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4d871fa0-360d-4ce8-a4ff-e3bccb81f48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:04.117340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 809/1641] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:04.129327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 833/1642] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Sep 9 20:56:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:04.257982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bc554-8961-4813-895a-a9372a16498a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:04.274306 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8bc554-8961-4813-895a-a9372a16498a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:04.285209 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade4fa9-7862-48ea-9203-85fb90bdd5d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:04.286506 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade4fa9-7862-48ea-9203-85fb90bdd5d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:04.286942 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade4fa9-7862-48ea-9203-85fb90bdd5d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:04.287275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade4fa9-7862-48ea-9203-85fb90bdd5d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:04.451319 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade4fa9-7862-48ea-9203-85fb90bdd5d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:04.453105 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade4fa9-7862-48ea-9203-85fb90bdd5d2 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:04.481696 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 810/1643] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:05.166361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d871fa0-360d-4ce8-a4ff-e3bccb81f48b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:05.178638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d871fa0-360d-4ce8-a4ff-e3bccb81f48b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:05.192875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3956c6-9900-4c67-bc7f-f8d989558dc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:05.195007 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3956c6-9900-4c67-bc7f-f8d989558dc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:05.195280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3956c6-9900-4c67-bc7f-f8d989558dc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:05.195557 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3956c6-9900-4c67-bc7f-f8d989558dc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:05.235342 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3956c6-9900-4c67-bc7f-f8d989558dc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:05.238037 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3956c6-9900-4c67-bc7f-f8d989558dc1 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:05.272608 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 834/1644] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:07.576268 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39ca36-138e-4db4-8bf1-ef97210c07dc None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:07.576774 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39ca36-138e-4db4-8bf1-ef97210c07dc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:07.576851 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39ca36-138e-4db4-8bf1-ef97210c07dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:07.642924 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9c39ca36-138e-4db4-8bf1-ef97210c07dc None None] MFA Rules not processed for user `ef5e046f57cc4389818835ba68ad8157`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:07.644952 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9c39ca36-138e-4db4-8bf1-ef97210c07dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:07.776567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 811/1645] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:07.836497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39ca36-138e-4db4-8bf1-ef97210c07dc None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:07.836827 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3956c6-9900-4c67-bc7f-f8d989558dc1 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:07.912743 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39ca36-138e-4db4-8bf1-ef97210c07dc None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:07.940659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0998880-8180-4f47-a0c1-4efba1e3a2ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:07.941461 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0998880-8180-4f47-a0c1-4efba1e3a2ac service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:07.942914 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0998880-8180-4f47-a0c1-4efba1e3a2ac service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:07.943195 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0998880-8180-4f47-a0c1-4efba1e3a2ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:07.964286 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0998880-8180-4f47-a0c1-4efba1e3a2ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:07.966154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0998880-8180-4f47-a0c1-4efba1e3a2ac service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:07.994450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 812/1646] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:08.017174 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3956c6-9900-4c67-bc7f-f8d989558dc1 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:08.027940 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653a538-8508-44e8-bbc4-823635a78766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:08.030265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653a538-8508-44e8-bbc4-823635a78766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:08.031583 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653a538-8508-44e8-bbc4-823635a78766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:08.033598 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653a538-8508-44e8-bbc4-823635a78766 admin admin] PATH_INFO: `/v3/users/e54c64f1a9c54942a6d096b8ec4012b7` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:08.039272 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653a538-8508-44e8-bbc4-823635a78766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e54c64f1a9c54942a6d096b8ec4012b7)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:08.043428 dv-cinder-831247-28-smb devstack@keystone.service[81397]: WARNING py.warnings [None req-5653a538-8508-44e8-bbc4-823635a78766 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 20:56:08.043428 dv-cinder-831247-28-smb devstack@keystone.service[81397]: warnings.warn(msg) Sep 09 20:56:08.043428 dv-cinder-831247-28-smb devstack@keystone.service[81397]: Sep 09 20:56:08.046683 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5653a538-8508-44e8-bbc4-823635a78766 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:08.162108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5653a538-8508-44e8-bbc4-823635a78766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e54c64f1a9c54942a6d096b8ec4012b7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:08.180029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5653a538-8508-44e8-bbc4-823635a78766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e54c64f1a9c54942a6d096b8ec4012b7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:08.219419 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5653a538-8508-44e8-bbc4-823635a78766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e54c64f1a9c54942a6d096b8ec4012b7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:08.220340 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5653a538-8508-44e8-bbc4-823635a78766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e54c64f1a9c54942a6d096b8ec4012b7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:08.221138 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5653a538-8508-44e8-bbc4-823635a78766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e54c64f1a9c54942a6d096b8ec4012b7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:08.250208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 835/1647] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:07 2022] DELETE /identity/v3/users/e54c64f1a9c54942a6d096b8ec4012b7 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:08.255042 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee5931-d1ce-4fa0-9006-5dd141c368fc None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:08.255382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee5931-d1ce-4fa0-9006-5dd141c368fc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:08.255597 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee5931-d1ce-4fa0-9006-5dd141c368fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:08.313579 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-32ee5931-d1ce-4fa0-9006-5dd141c368fc None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:08.314895 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-32ee5931-d1ce-4fa0-9006-5dd141c368fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:08.457166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:08.532481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 813/1648] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:08.555586 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653a538-8508-44e8-bbc4-823635a78766 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:08.557085 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5653a538-8508-44e8-bbc4-823635a78766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:08.717288 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5653a538-8508-44e8-bbc4-823635a78766 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:08.729251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe50e4-7899-4ea6-aa5c-c2e871d975ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:08.730517 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe50e4-7899-4ea6-aa5c-c2e871d975ed service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:08.731557 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe50e4-7899-4ea6-aa5c-c2e871d975ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:08.732956 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe50e4-7899-4ea6-aa5c-c2e871d975ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:08.745706 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:08.750011 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe50e4-7899-4ea6-aa5c-c2e871d975ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:08.752368 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe50e4-7899-4ea6-aa5c-c2e871d975ed service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:08.766550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 836/1649] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:08.929419 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee5931-d1ce-4fa0-9006-5dd141c368fc None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:08.931981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-32ee5931-d1ce-4fa0-9006-5dd141c368fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:09.008582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee5931-d1ce-4fa0-9006-5dd141c368fc None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:09.019932 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63214a-13d8-4cc5-924a-f1f844913ce2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:09.020637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63214a-13d8-4cc5-924a-f1f844913ce2 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:09.021018 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63214a-13d8-4cc5-924a-f1f844913ce2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:09.021300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63214a-13d8-4cc5-924a-f1f844913ce2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:09.030335 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3c63214a-13d8-4cc5-924a-f1f844913ce2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:09.164292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63214a-13d8-4cc5-924a-f1f844913ce2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:09.166535 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c63214a-13d8-4cc5-924a-f1f844913ce2 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:09.183057 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 814/1650] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:10.167944 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe50e4-7899-4ea6-aa5c-c2e871d975ed service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:10.175749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0efe50e4-7899-4ea6-aa5c-c2e871d975ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:10.218676 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe50e4-7899-4ea6-aa5c-c2e871d975ed service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:10.225429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed3d00-d363-4c07-affe-ab67128cd5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:10.226302 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed3d00-d363-4c07-affe-ab67128cd5aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:10.227885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed3d00-d363-4c07-affe-ab67128cd5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:10.228380 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed3d00-d363-4c07-affe-ab67128cd5aa admin admin] PATH_INFO: `/v3/projects/a2f0ff717a2f46bfa727a3d13e232266` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:10.229847 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed3d00-d363-4c07-affe-ab67128cd5aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f0ff717a2f46bfa727a3d13e232266)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:10.232440 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed3d00-d363-4c07-affe-ab67128cd5aa admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:10.340587 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-28ed3d00-d363-4c07-affe-ab67128cd5aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f0ff717a2f46bfa727a3d13e232266', 'request_id': 'req-28ed3d00-d363-4c07-affe-ab67128cd5aa'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:10.359380 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-28ed3d00-d363-4c07-affe-ab67128cd5aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f0ff717a2f46bfa727a3d13e232266', 'request_id': 'req-28ed3d00-d363-4c07-affe-ab67128cd5aa'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:10.369292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-28ed3d00-d363-4c07-affe-ab67128cd5aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f0ff717a2f46bfa727a3d13e232266', 'request_id': 'req-28ed3d00-d363-4c07-affe-ab67128cd5aa'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:10.385244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-28ed3d00-d363-4c07-affe-ab67128cd5aa admin admin] The token cache is being invalidate because project a2f0ff717a2f46bfa727a3d13e232266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:10.386049 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-28ed3d00-d363-4c07-affe-ab67128cd5aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:10.387302 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-28ed3d00-d363-4c07-affe-ab67128cd5aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:10.393010 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 837/1651] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:10 2022] DELETE /identity/v3/projects/a2f0ff717a2f46bfa727a3d13e232266 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:10.394839 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf5857-49bb-4eb7-9fb9-35dee69f9dae None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:10.397591 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf5857-49bb-4eb7-9fb9-35dee69f9dae None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:10.397700 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf5857-49bb-4eb7-9fb9-35dee69f9dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:10.441078 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1eaf5857-49bb-4eb7-9fb9-35dee69f9dae None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:10.445897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1eaf5857-49bb-4eb7-9fb9-35dee69f9dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:10.642462 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dbed1-daae-453b-87af-3882e7beafbf None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:10.643213 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dbed1-daae-453b-87af-3882e7beafbf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:10.643892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dbed1-daae-453b-87af-3882e7beafbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:10.646691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 815/1652] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:10.719823 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-247dbed1-daae-453b-87af-3882e7beafbf None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:10.731586 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-247dbed1-daae-453b-87af-3882e7beafbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:10.767023 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 838/1653] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:10.772947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf5857-49bb-4eb7-9fb9-35dee69f9dae None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:10.788488 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf5857-49bb-4eb7-9fb9-35dee69f9dae None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:10.805340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c19f3-8be1-4741-a634-a3a3e22d21b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:10.806242 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c19f3-8be1-4741-a634-a3a3e22d21b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:10.809101 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c19f3-8be1-4741-a634-a3a3e22d21b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:10.809101 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c19f3-8be1-4741-a634-a3a3e22d21b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:10.809101 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c19f3-8be1-4741-a634-a3a3e22d21b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:56:10.809101 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c19f3-8be1-4741-a634-a3a3e22d21b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:10.811741 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c19f3-8be1-4741-a634-a3a3e22d21b6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:10.846116 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dbed1-daae-453b-87af-3882e7beafbf None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:10.864872 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 816/1654] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:56:10.866722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dbed1-daae-453b-87af-3882e7beafbf None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:10.896824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73b530-6b46-4d95-ac98-1f15866168b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:10.901201 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73b530-6b46-4d95-ac98-1f15866168b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:10.903175 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73b530-6b46-4d95-ac98-1f15866168b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:10.904098 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73b530-6b46-4d95-ac98-1f15866168b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:10.906277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73b530-6b46-4d95-ac98-1f15866168b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:10.917199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c73b530-6b46-4d95-ac98-1f15866168b2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:11.012841 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 839/1655] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:10 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:11.014479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c19f3-8be1-4741-a634-a3a3e22d21b6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:11.036334 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c19f3-8be1-4741-a634-a3a3e22d21b6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:11.110157 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:11.328222 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa34cc-cf48-4a6f-8e3d-bcab146cb189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:11.328788 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa34cc-cf48-4a6f-8e3d-bcab146cb189 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:11.330012 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa34cc-cf48-4a6f-8e3d-bcab146cb189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:11.330298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa34cc-cf48-4a6f-8e3d-bcab146cb189 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:11.330958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa34cc-cf48-4a6f-8e3d-bcab146cb189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:11.333158 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa34cc-cf48-4a6f-8e3d-bcab146cb189 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:11.381064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 817/1656] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:11 2022] POST /identity/v3/users => generated 293 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:11.387036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73b530-6b46-4d95-ac98-1f15866168b2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:11.403132 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73b530-6b46-4d95-ac98-1f15866168b2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:11.415482 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17805d5-7a97-4ed9-a609-13d8875d751e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:11.416156 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17805d5-7a97-4ed9-a609-13d8875d751e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:11.416439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17805d5-7a97-4ed9-a609-13d8875d751e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:11.416720 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17805d5-7a97-4ed9-a609-13d8875d751e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:11.417442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17805d5-7a97-4ed9-a609-13d8875d751e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:11.419133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17805d5-7a97-4ed9-a609-13d8875d751e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:11.442006 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 840/1657] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:11.446012 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa34cc-cf48-4a6f-8e3d-bcab146cb189 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:11.460439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa34cc-cf48-4a6f-8e3d-bcab146cb189 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:11.472883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5516b7d-6cde-4b82-87ac-5f22858dfe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:11.474729 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5516b7d-6cde-4b82-87ac-5f22858dfe39 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:11.475150 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5516b7d-6cde-4b82-87ac-5f22858dfe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:11.475582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5516b7d-6cde-4b82-87ac-5f22858dfe39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:11.476196 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5516b7d-6cde-4b82-87ac-5f22858dfe39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:11.480064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5516b7d-6cde-4b82-87ac-5f22858dfe39 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:11.532081 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 818/1658] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:56:11.534039 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17805d5-7a97-4ed9-a609-13d8875d751e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:11.548917 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17805d5-7a97-4ed9-a609-13d8875d751e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:11.573424 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c93658-4832-4c26-8266-8382efe413f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:11.574644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c93658-4832-4c26-8266-8382efe413f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:11.574959 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c93658-4832-4c26-8266-8382efe413f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:11.576384 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c93658-4832-4c26-8266-8382efe413f9 admin admin] PATH_INFO: `/v3/projects/bc80ef32758142a998b4d64a3d4c2beb/users/f2b7b1db3782442084f0a71ad3cff438/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:11.611642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c93658-4832-4c26-8266-8382efe413f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc80ef32758142a998b4d64a3d4c2beb, user_id=f2b7b1db3782442084f0a71ad3cff438, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:11.623688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c93658-4832-4c26-8266-8382efe413f9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:11.656485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 841/1659] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:11 2022] PUT /identity/v3/projects/bc80ef32758142a998b4d64a3d4c2beb/users/f2b7b1db3782442084f0a71ad3cff438/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:11.671728 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4dd50-59b7-4f39-af66-04d8e998af06 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:11.672411 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4dd50-59b7-4f39-af66-04d8e998af06 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:11.673011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4dd50-59b7-4f39-af66-04d8e998af06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:11.749819 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f8f4dd50-59b7-4f39-af66-04d8e998af06 None None] MFA Rules not processed for user `f2b7b1db3782442084f0a71ad3cff438`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:11.752805 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f8f4dd50-59b7-4f39-af66-04d8e998af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:11.928937 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 819/1660] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:11.930588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c93658-4832-4c26-8266-8382efe413f9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:12.084538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77636a18-4ce6-4667-a236-8bc5ec6c7b1c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:12.084871 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77636a18-4ce6-4667-a236-8bc5ec6c7b1c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:12.085107 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77636a18-4ce6-4667-a236-8bc5ec6c7b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:12.137099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-77636a18-4ce6-4667-a236-8bc5ec6c7b1c None None] MFA Rules not processed for user `ef5e046f57cc4389818835ba68ad8157`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:12.138356 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-77636a18-4ce6-4667-a236-8bc5ec6c7b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:12.140958 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c93658-4832-4c26-8266-8382efe413f9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:12.155223 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e25ca-b868-4c90-9eb1-92874e1739f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:12.155818 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e25ca-b868-4c90-9eb1-92874e1739f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:12.156160 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e25ca-b868-4c90-9eb1-92874e1739f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:12.156442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e25ca-b868-4c90-9eb1-92874e1739f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:12.157125 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e25ca-b868-4c90-9eb1-92874e1739f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:12.166007 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e25ca-b868-4c90-9eb1-92874e1739f3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:12.224676 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:12.244517 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 842/1661] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:11 2022] POST /identity/v3/projects => generated 387 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:12.245852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e25ca-b868-4c90-9eb1-92874e1739f3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:12.335218 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 820/1662] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:12.507550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e25ca-b868-4c90-9eb1-92874e1739f3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:12.544339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcd74b-34fe-4244-a1dc-e54c73153732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:12.545216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcd74b-34fe-4244-a1dc-e54c73153732 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:12.545558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcd74b-34fe-4244-a1dc-e54c73153732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:12.545876 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcd74b-34fe-4244-a1dc-e54c73153732 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:12.546507 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffcd74b-34fe-4244-a1dc-e54c73153732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:12.583279 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffcd74b-34fe-4244-a1dc-e54c73153732 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:12.655443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 843/1663] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:12 2022] POST /identity/v3/users => generated 300 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:12.658654 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77636a18-4ce6-4667-a236-8bc5ec6c7b1c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:12.690188 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77636a18-4ce6-4667-a236-8bc5ec6c7b1c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:12.696474 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980802a-28f5-4906-aa52-81ce8b3310ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:12.697492 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980802a-28f5-4906-aa52-81ce8b3310ff admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:12.697492 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980802a-28f5-4906-aa52-81ce8b3310ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:12.697667 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980802a-28f5-4906-aa52-81ce8b3310ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:12.699023 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980802a-28f5-4906-aa52-81ce8b3310ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:12.700234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980802a-28f5-4906-aa52-81ce8b3310ff admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:12.712698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 821/1664] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:12.716768 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcd74b-34fe-4244-a1dc-e54c73153732 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:12.728836 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcd74b-34fe-4244-a1dc-e54c73153732 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:12.735053 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99512c-d23d-4498-a663-6c588640bf24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:12.735927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99512c-d23d-4498-a663-6c588640bf24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:12.736236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99512c-d23d-4498-a663-6c588640bf24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:12.736519 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99512c-d23d-4498-a663-6c588640bf24 admin admin] PATH_INFO: `/v3/projects/b7d0dc068d50444a97ae476b162aab7e/users/2c5c3847c248483eb9aed70a0003fdab/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:12.762271 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99512c-d23d-4498-a663-6c588640bf24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d0dc068d50444a97ae476b162aab7e, user_id=2c5c3847c248483eb9aed70a0003fdab, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:12.765655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc99512c-d23d-4498-a663-6c588640bf24 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:12.781774 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980802a-28f5-4906-aa52-81ce8b3310ff admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:12.784082 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7980802a-28f5-4906-aa52-81ce8b3310ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:12.794655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 844/1665] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:12 2022] PUT /identity/v3/projects/b7d0dc068d50444a97ae476b162aab7e/users/2c5c3847c248483eb9aed70a0003fdab/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:12.799768 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99512c-d23d-4498-a663-6c588640bf24 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:12.804769 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980802a-28f5-4906-aa52-81ce8b3310ff admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:12.883578 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:12.954572 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc99512c-d23d-4498-a663-6c588640bf24 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:12.964773 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c5f46-51a5-4537-9968-c001125281c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:12.965744 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c5f46-51a5-4537-9968-c001125281c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:12.966032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c5f46-51a5-4537-9968-c001125281c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:12.966381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c5f46-51a5-4537-9968-c001125281c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:12.976097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c5f46-51a5-4537-9968-c001125281c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:12.981821 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c5f46-51a5-4537-9968-c001125281c3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:12.985509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3c20d-9d60-4b87-b270-7777fc45a52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:12.986163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3c20d-9d60-4b87-b270-7777fc45a52b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:12.986444 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3c20d-9d60-4b87-b270-7777fc45a52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:12.986873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3c20d-9d60-4b87-b270-7777fc45a52b admin admin] PATH_INFO: `/v3/users/8ada017c751b47838994c3c9404a5d1d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:12.989423 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3c20d-9d60-4b87-b270-7777fc45a52b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ada017c751b47838994c3c9404a5d1d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:12.991550 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3c20d-9d60-4b87-b270-7777fc45a52b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:13.015705 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 845/1666] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:56:13.019539 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c5f46-51a5-4537-9968-c001125281c3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:13.047752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c5f46-51a5-4537-9968-c001125281c3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:13.081906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c5b0b-68f8-4b97-931d-1461979ee93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:13.083286 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c5b0b-68f8-4b97-931d-1461979ee93a admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:13.083670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c5b0b-68f8-4b97-931d-1461979ee93a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:13.091614 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c5b0b-68f8-4b97-931d-1461979ee93a admin admin] PATH_INFO: `/v3/projects/b7d0dc068d50444a97ae476b162aab7e/users/2c5c3847c248483eb9aed70a0003fdab/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:13.101292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c5b0b-68f8-4b97-931d-1461979ee93a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d0dc068d50444a97ae476b162aab7e, user_id=2c5c3847c248483eb9aed70a0003fdab, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:13.113442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c5b0b-68f8-4b97-931d-1461979ee93a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:13.139131 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ece3c20d-9d60-4b87-b270-7777fc45a52b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ada017c751b47838994c3c9404a5d1d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:13.162704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 846/1667] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:13 2022] PUT /identity/v3/projects/b7d0dc068d50444a97ae476b162aab7e/users/2c5c3847c248483eb9aed70a0003fdab/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:13.164426 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaea36-dcfc-4831-ade5-735a4e62d3f6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:13.164718 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaea36-dcfc-4831-ade5-735a4e62d3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:13.165031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaea36-dcfc-4831-ade5-735a4e62d3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:13.166030 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ece3c20d-9d60-4b87-b270-7777fc45a52b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ada017c751b47838994c3c9404a5d1d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:13.168259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ece3c20d-9d60-4b87-b270-7777fc45a52b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ada017c751b47838994c3c9404a5d1d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:13.169077 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ece3c20d-9d60-4b87-b270-7777fc45a52b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ada017c751b47838994c3c9404a5d1d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:13.192737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ece3c20d-9d60-4b87-b270-7777fc45a52b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ada017c751b47838994c3c9404a5d1d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:13.233555 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-82eaea36-dcfc-4831-ade5-735a4e62d3f6 None None] MFA Rules not processed for user `2c5c3847c248483eb9aed70a0003fdab`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:13.244960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-82eaea36-dcfc-4831-ade5-735a4e62d3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:13.249143 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 822/1668] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:12 2022] DELETE /identity/v3/users/8ada017c751b47838994c3c9404a5d1d => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:13.256497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465ef28-61ac-4bd7-839f-05f9d681172f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:13.256798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465ef28-61ac-4bd7-839f-05f9d681172f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:13.257602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c465ef28-61ac-4bd7-839f-05f9d681172f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:13.325538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c465ef28-61ac-4bd7-839f-05f9d681172f None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:13.331043 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c465ef28-61ac-4bd7-839f-05f9d681172f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:13.353448 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:13.504915 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 847/1669] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:13.506536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 823/1670] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:13.514770 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eaea36-dcfc-4831-ade5-735a4e62d3f6 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:13.518099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-82eaea36-dcfc-4831-ade5-735a4e62d3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:13.540008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465ef28-61ac-4bd7-839f-05f9d681172f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:13.541482 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c465ef28-61ac-4bd7-839f-05f9d681172f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:13.710807 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:13.727290 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eaea36-dcfc-4831-ade5-735a4e62d3f6 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:13.737599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab52ce0-e332-474c-9680-851d5a8069e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:13.738239 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab52ce0-e332-474c-9680-851d5a8069e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:13.740301 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab52ce0-e332-474c-9680-851d5a8069e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:13.740587 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab52ce0-e332-474c-9680-851d5a8069e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:13.748122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c465ef28-61ac-4bd7-839f-05f9d681172f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:13.758072 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62896dc-5102-4067-97ac-2e80ab0bbb0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:13.758959 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62896dc-5102-4067-97ac-2e80ab0bbb0f service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:13.759437 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62896dc-5102-4067-97ac-2e80ab0bbb0f service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:13.759907 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62896dc-5102-4067-97ac-2e80ab0bbb0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:13.767043 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab52ce0-e332-474c-9680-851d5a8069e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:13.771876 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab52ce0-e332-474c-9680-851d5a8069e1 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:13.780970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62896dc-5102-4067-97ac-2e80ab0bbb0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:13.782696 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62896dc-5102-4067-97ac-2e80ab0bbb0f service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:13.796378 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 848/1671] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:13 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:13.797665 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69353ec1-3a1d-409b-a850-b28973634c11 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:13.797954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69353ec1-3a1d-409b-a850-b28973634c11 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:13.800882 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69353ec1-3a1d-409b-a850-b28973634c11 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:13.802824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 849/1672] 10.222.0.15 () {54 vars in 912 bytes} [Fri Sep 9 20:56:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:56:13.809267 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2db3dc-a80d-45d9-ae17-f2438616a7bf None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:13.809558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2db3dc-a80d-45d9-ae17-f2438616a7bf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:13.809835 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2db3dc-a80d-45d9-ae17-f2438616a7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:13.824046 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 824/1673] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:13.944031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2a2db3dc-a80d-45d9-ae17-f2438616a7bf None None] MFA Rules not processed for user `27e2be33ebdc4c5a97befcbd4d09ee4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:13.948217 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2a2db3dc-a80d-45d9-ae17-f2438616a7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:13.968721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62896dc-5102-4067-97ac-2e80ab0bbb0f service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:13.970353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b62896dc-5102-4067-97ac-2e80ab0bbb0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:13.976518 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 850/1674] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Sep 9 20:56:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:14.006171 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62896dc-5102-4067-97ac-2e80ab0bbb0f service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:14.024857 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbcb6d-3a40-4f72-91a3-4f3f5804f82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:14.025521 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbcb6d-3a40-4f72-91a3-4f3f5804f82f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:14.025712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2db3dc-a80d-45d9-ae17-f2438616a7bf None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:14.028967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbcb6d-3a40-4f72-91a3-4f3f5804f82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:14.029284 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbcb6d-3a40-4f72-91a3-4f3f5804f82f admin admin] PATH_INFO: `/v3/users/f2b7b1db3782442084f0a71ad3cff438` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:14.033296 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adbcb6d-3a40-4f72-91a3-4f3f5804f82f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b7b1db3782442084f0a71ad3cff438)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:14.035265 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adbcb6d-3a40-4f72-91a3-4f3f5804f82f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:14.038775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2db3dc-a80d-45d9-ae17-f2438616a7bf None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:14.051905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616f01d-2a55-416b-af7d-2df6c1417680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:14.053276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616f01d-2a55-416b-af7d-2df6c1417680 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:14.054683 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616f01d-2a55-416b-af7d-2df6c1417680 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:14.055043 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616f01d-2a55-416b-af7d-2df6c1417680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:14.077006 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616f01d-2a55-416b-af7d-2df6c1417680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:14.081584 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616f01d-2a55-416b-af7d-2df6c1417680 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:14.124142 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 851/1675] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:14.156334 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5adbcb6d-3a40-4f72-91a3-4f3f5804f82f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b7b1db3782442084f0a71ad3cff438'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:14.179182 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5adbcb6d-3a40-4f72-91a3-4f3f5804f82f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b7b1db3782442084f0a71ad3cff438'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:14.180335 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5adbcb6d-3a40-4f72-91a3-4f3f5804f82f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b7b1db3782442084f0a71ad3cff438'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:14.180957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5adbcb6d-3a40-4f72-91a3-4f3f5804f82f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b7b1db3782442084f0a71ad3cff438'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:14.193190 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5adbcb6d-3a40-4f72-91a3-4f3f5804f82f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b7b1db3782442084f0a71ad3cff438'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:14.225170 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 825/1676] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:13 2022] DELETE /identity/v3/users/f2b7b1db3782442084f0a71ad3cff438 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:14.226311 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a578a2-0fea-4f94-b14f-0bb1343319bc None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:14.226645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a578a2-0fea-4f94-b14f-0bb1343319bc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:14.226854 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a578a2-0fea-4f94-b14f-0bb1343319bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:14.273028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e0a578a2-0fea-4f94-b14f-0bb1343319bc None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:14.274574 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e0a578a2-0fea-4f94-b14f-0bb1343319bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:14.408168 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 852/1677] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:14.446188 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbcb6d-3a40-4f72-91a3-4f3f5804f82f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:14.447893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5adbcb6d-3a40-4f72-91a3-4f3f5804f82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:14.611242 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbcb6d-3a40-4f72-91a3-4f3f5804f82f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:14.659377 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc675a-3a7e-46e3-b0f8-9cafcc94e216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:14.665799 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc675a-3a7e-46e3-b0f8-9cafcc94e216 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:14.686658 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc675a-3a7e-46e3-b0f8-9cafcc94e216 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:14.687238 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc675a-3a7e-46e3-b0f8-9cafcc94e216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:14.716358 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc675a-3a7e-46e3-b0f8-9cafcc94e216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:14.731577 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc675a-3a7e-46e3-b0f8-9cafcc94e216 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:14.791803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 826/1678] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:15.424632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a578a2-0fea-4f94-b14f-0bb1343319bc None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:15.427655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e0a578a2-0fea-4f94-b14f-0bb1343319bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:15.560875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:15.631077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a578a2-0fea-4f94-b14f-0bb1343319bc None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:15.636668 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247ecc8-917f-492a-85ea-53bfc36cae0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc28d9a1b3f4feca0deeb5f266f8b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:15.637437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247ecc8-917f-492a-85ea-53bfc36cae0a service placement] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:15.637815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247ecc8-917f-492a-85ea-53bfc36cae0a service placement] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:15.638186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247ecc8-917f-492a-85ea-53bfc36cae0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:15.643432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3247ecc8-917f-492a-85ea-53bfc36cae0a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:15.678381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247ecc8-917f-492a-85ea-53bfc36cae0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:15.683199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247ecc8-917f-492a-85ea-53bfc36cae0a service placement] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:15.713540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 853/1679] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:15.758211 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc675a-3a7e-46e3-b0f8-9cafcc94e216 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:15.760751 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-14dc675a-3a7e-46e3-b0f8-9cafcc94e216 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:15.792430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc675a-3a7e-46e3-b0f8-9cafcc94e216 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:15.811589 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d99506e-9626-4f40-b21f-ef371ad680f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:15.812488 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99506e-9626-4f40-b21f-ef371ad680f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:15.814242 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99506e-9626-4f40-b21f-ef371ad680f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:15.814752 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99506e-9626-4f40-b21f-ef371ad680f8 admin admin] PATH_INFO: `/v3/projects/238ecc4ada964fdf8cee7beaa28362f9` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:15.817963 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99506e-9626-4f40-b21f-ef371ad680f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=238ecc4ada964fdf8cee7beaa28362f9)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:15.827276 dv-cinder-831247-28-smb devstack@keystone.service[81398]: WARNING py.warnings [None req-6d99506e-9626-4f40-b21f-ef371ad680f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 09 20:56:15.827276 dv-cinder-831247-28-smb devstack@keystone.service[81398]: warnings.warn(msg) Sep 09 20:56:15.827276 dv-cinder-831247-28-smb devstack@keystone.service[81398]: Sep 09 20:56:15.833177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d99506e-9626-4f40-b21f-ef371ad680f8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:16.063465 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6d99506e-9626-4f40-b21f-ef371ad680f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '238ecc4ada964fdf8cee7beaa28362f9', 'request_id': 'req-6d99506e-9626-4f40-b21f-ef371ad680f8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:16.088756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6d99506e-9626-4f40-b21f-ef371ad680f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '238ecc4ada964fdf8cee7beaa28362f9', 'request_id': 'req-6d99506e-9626-4f40-b21f-ef371ad680f8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:16.091482 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:16.116701 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6d99506e-9626-4f40-b21f-ef371ad680f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '238ecc4ada964fdf8cee7beaa28362f9', 'request_id': 'req-6d99506e-9626-4f40-b21f-ef371ad680f8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:16.184440 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6d99506e-9626-4f40-b21f-ef371ad680f8 admin admin] The token cache is being invalidate because project 238ecc4ada964fdf8cee7beaa28362f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:16.185732 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6d99506e-9626-4f40-b21f-ef371ad680f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:16.186651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6d99506e-9626-4f40-b21f-ef371ad680f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:16.190736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 827/1680] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:15 2022] DELETE /identity/v3/projects/238ecc4ada964fdf8cee7beaa28362f9 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:16.194855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a9f73-1d34-4965-a5ad-96634ae5acc1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:16.195397 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a9f73-1d34-4965-a5ad-96634ae5acc1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:16.195907 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5a9f73-1d34-4965-a5ad-96634ae5acc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:16.268742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ed5a9f73-1d34-4965-a5ad-96634ae5acc1 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:16.274437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ed5a9f73-1d34-4965-a5ad-96634ae5acc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:16.543507 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 854/1681] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:56:16.545461 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10dea2-d129-43c0-a340-2ef505801316 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:16.545752 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10dea2-d129-43c0-a340-2ef505801316 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:16.546032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10dea2-d129-43c0-a340-2ef505801316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:16.605805 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-cd10dea2-d129-43c0-a340-2ef505801316 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:16.607101 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cd10dea2-d129-43c0-a340-2ef505801316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:16.638790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 828/1682] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:16.643350 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a9f73-1d34-4965-a5ad-96634ae5acc1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:16.671325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5a9f73-1d34-4965-a5ad-96634ae5acc1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:16.683269 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30289ffc-e52b-49a0-ac12-74a42c44d3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:16.686008 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30289ffc-e52b-49a0-ac12-74a42c44d3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:16.686654 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30289ffc-e52b-49a0-ac12-74a42c44d3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:16.687156 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30289ffc-e52b-49a0-ac12-74a42c44d3a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:16.688121 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30289ffc-e52b-49a0-ac12-74a42c44d3a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:56:16.688654 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30289ffc-e52b-49a0-ac12-74a42c44d3a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:16.701107 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30289ffc-e52b-49a0-ac12-74a42c44d3a1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:16.725342 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 855/1683] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:56:16.727172 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10dea2-d129-43c0-a340-2ef505801316 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:16.735797 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10dea2-d129-43c0-a340-2ef505801316 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:16.744245 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ea856-3094-455a-9ad0-21214676f01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:16.744883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ea856-3094-455a-9ad0-21214676f01d admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:16.745163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ea856-3094-455a-9ad0-21214676f01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:16.745433 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ea856-3094-455a-9ad0-21214676f01d admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:16.746071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ea856-3094-455a-9ad0-21214676f01d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:16.748037 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ea856-3094-455a-9ad0-21214676f01d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:16.785931 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 829/1684] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:16 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:56:16.790730 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30289ffc-e52b-49a0-ac12-74a42c44d3a1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:16.813799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30289ffc-e52b-49a0-ac12-74a42c44d3a1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:17.029955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da89e2-61bf-437a-a8de-784bc98320bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:17.030602 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da89e2-61bf-437a-a8de-784bc98320bd admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:17.030938 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da89e2-61bf-437a-a8de-784bc98320bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:17.031169 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da89e2-61bf-437a-a8de-784bc98320bd admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:17.031804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da89e2-61bf-437a-a8de-784bc98320bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:17.038725 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da89e2-61bf-437a-a8de-784bc98320bd admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:17.078125 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 856/1685] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:16 2022] POST /identity/v3/users => generated 284 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:17.082178 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ea856-3094-455a-9ad0-21214676f01d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:17.100784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ea856-3094-455a-9ad0-21214676f01d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:17.116583 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7550ae-14e7-4c20-a507-f2edb239e7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:17.118681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7550ae-14e7-4c20-a507-f2edb239e7bc admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:17.120089 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7550ae-14e7-4c20-a507-f2edb239e7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:17.120561 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7550ae-14e7-4c20-a507-f2edb239e7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:17.122533 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7550ae-14e7-4c20-a507-f2edb239e7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:17.126869 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7550ae-14e7-4c20-a507-f2edb239e7bc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:17.179356 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 830/1686] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:17.183733 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da89e2-61bf-437a-a8de-784bc98320bd admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:17.201376 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da89e2-61bf-437a-a8de-784bc98320bd admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:17.217143 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9904a-7406-495e-9624-0a2e54208aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:17.217797 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9904a-7406-495e-9624-0a2e54208aff admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:17.218466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9904a-7406-495e-9624-0a2e54208aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:17.218911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9904a-7406-495e-9624-0a2e54208aff admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:17.219576 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9904a-7406-495e-9624-0a2e54208aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:17.236346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9904a-7406-495e-9624-0a2e54208aff admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:17.291128 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 857/1687] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:17.294969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7550ae-14e7-4c20-a507-f2edb239e7bc admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:17.307176 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7550ae-14e7-4c20-a507-f2edb239e7bc admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:17.326592 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6bd6bd-759b-439f-bad3-023b999d398a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:17.327519 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bd6bd-759b-439f-bad3-023b999d398a admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:17.329580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bd6bd-759b-439f-bad3-023b999d398a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:17.330297 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6bd6bd-759b-439f-bad3-023b999d398a admin admin] PATH_INFO: `/v3/projects/ff067e48191f44c7a3bb3522f00d20c9/users/289df238f48f4795bb44bde2c1cdaa18/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:17.374209 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bd6bd-759b-439f-bad3-023b999d398a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff067e48191f44c7a3bb3522f00d20c9, user_id=289df238f48f4795bb44bde2c1cdaa18, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:17.386728 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6bd6bd-759b-439f-bad3-023b999d398a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:17.407649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9904a-7406-495e-9624-0a2e54208aff admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:17.409892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-65d9904a-7406-495e-9624-0a2e54208aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:17.449613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9904a-7406-495e-9624-0a2e54208aff admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:17.464026 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 831/1688] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:17 2022] PUT /identity/v3/projects/ff067e48191f44c7a3bb3522f00d20c9/users/289df238f48f4795bb44bde2c1cdaa18/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:17.467371 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b085c-b443-43ce-95d7-e75c8a0a8696 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:17.467793 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b085c-b443-43ce-95d7-e75c8a0a8696 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:17.468173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b085c-b443-43ce-95d7-e75c8a0a8696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:17.599544 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ac9b085c-b443-43ce-95d7-e75c8a0a8696 None None] MFA Rules not processed for user `289df238f48f4795bb44bde2c1cdaa18`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:17.600900 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ac9b085c-b443-43ce-95d7-e75c8a0a8696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:17.660590 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:17.757230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf524072-d96d-47bb-851a-3e4c148606fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:17.757896 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf524072-d96d-47bb-851a-3e4c148606fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:17.758176 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf524072-d96d-47bb-851a-3e4c148606fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:17.758451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf524072-d96d-47bb-851a-3e4c148606fe admin admin] PATH_INFO: `/v3/projects/bc80ef32758142a998b4d64a3d4c2beb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:17.772905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf524072-d96d-47bb-851a-3e4c148606fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc80ef32758142a998b4d64a3d4c2beb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:17.775048 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf524072-d96d-47bb-851a-3e4c148606fe admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:17.917032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 832/1689] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:17.948009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bf524072-d96d-47bb-851a-3e4c148606fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc80ef32758142a998b4d64a3d4c2beb', 'request_id': 'req-bf524072-d96d-47bb-851a-3e4c148606fe'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:17.957666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b085c-b443-43ce-95d7-e75c8a0a8696 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:17.959625 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ac9b085c-b443-43ce-95d7-e75c8a0a8696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:17.969176 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bf524072-d96d-47bb-851a-3e4c148606fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc80ef32758142a998b4d64a3d4c2beb', 'request_id': 'req-bf524072-d96d-47bb-851a-3e4c148606fe'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:17.991386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bf524072-d96d-47bb-851a-3e4c148606fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc80ef32758142a998b4d64a3d4c2beb', 'request_id': 'req-bf524072-d96d-47bb-851a-3e4c148606fe'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:18.031738 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bf524072-d96d-47bb-851a-3e4c148606fe admin admin] The token cache is being invalidate because project bc80ef32758142a998b4d64a3d4c2beb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:18.032052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bf524072-d96d-47bb-851a-3e4c148606fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:18.036415 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bf524072-d96d-47bb-851a-3e4c148606fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:18.039072 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 858/1690] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:17 2022] DELETE /identity/v3/projects/bc80ef32758142a998b4d64a3d4c2beb => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:18.053709 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf524072-d96d-47bb-851a-3e4c148606fe admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:18.057686 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bf524072-d96d-47bb-851a-3e4c148606fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:18.084260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b085c-b443-43ce-95d7-e75c8a0a8696 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:18.179346 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:18.336477 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e56412-979d-4b13-9f10-ccf3f99645f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:18.339773 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e56412-979d-4b13-9f10-ccf3f99645f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:18.341402 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e56412-979d-4b13-9f10-ccf3f99645f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:18.342093 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e56412-979d-4b13-9f10-ccf3f99645f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:18.351163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-57e56412-979d-4b13-9f10-ccf3f99645f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:18.493335 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf524072-d96d-47bb-851a-3e4c148606fe admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:18.512574 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571f159-cf8c-4cef-b217-d4fc24a8c6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:18.515249 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571f159-cf8c-4cef-b217-d4fc24a8c6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:18.515634 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571f159-cf8c-4cef-b217-d4fc24a8c6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:18.518361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571f159-cf8c-4cef-b217-d4fc24a8c6e7 admin admin] PATH_INFO: `/v3/users/2c5c3847c248483eb9aed70a0003fdab` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:18.525326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571f159-cf8c-4cef-b217-d4fc24a8c6e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c5c3847c248483eb9aed70a0003fdab)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:18.527451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c571f159-cf8c-4cef-b217-d4fc24a8c6e7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:18.612304 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e56412-979d-4b13-9f10-ccf3f99645f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:18.619486 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e56412-979d-4b13-9f10-ccf3f99645f7 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:18.670841 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 833/1691] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 20:56:18.712382 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c571f159-cf8c-4cef-b217-d4fc24a8c6e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c5c3847c248483eb9aed70a0003fdab'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:18.755327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c571f159-cf8c-4cef-b217-d4fc24a8c6e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c5c3847c248483eb9aed70a0003fdab'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:18.795460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c571f159-cf8c-4cef-b217-d4fc24a8c6e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c5c3847c248483eb9aed70a0003fdab'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:18.804477 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c571f159-cf8c-4cef-b217-d4fc24a8c6e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c5c3847c248483eb9aed70a0003fdab'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:18.807863 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c571f159-cf8c-4cef-b217-d4fc24a8c6e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c5c3847c248483eb9aed70a0003fdab'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:18.821243 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:18.884453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 859/1692] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:18 2022] DELETE /identity/v3/users/2c5c3847c248483eb9aed70a0003fdab => generated 0 bytes in 831 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:19.405221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66332754-f966-4b59-84b7-251388e04708 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:19.405971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66332754-f966-4b59-84b7-251388e04708 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:19.405971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66332754-f966-4b59-84b7-251388e04708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:19.495422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-66332754-f966-4b59-84b7-251388e04708 None None] MFA Rules not processed for user `041b8276308c417fa43afe8d052ac0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:19.499673 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-66332754-f966-4b59-84b7-251388e04708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:19.662831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 834/1693] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:19.671395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfb3fa-cda6-4914-9ad0-1fd50a9a593a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:19.671880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfb3fa-cda6-4914-9ad0-1fd50a9a593a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:19.672387 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfb3fa-cda6-4914-9ad0-1fd50a9a593a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:19.715418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-74bfb3fa-cda6-4914-9ad0-1fd50a9a593a None None] MFA Rules not processed for user `041b8276308c417fa43afe8d052ac0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:19.721114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-74bfb3fa-cda6-4914-9ad0-1fd50a9a593a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:19.748168 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 860/1694] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:19.761660 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66332754-f966-4b59-84b7-251388e04708 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:19.764690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-66332754-f966-4b59-84b7-251388e04708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:19.960397 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66332754-f966-4b59-84b7-251388e04708 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:19.985387 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfb3fa-cda6-4914-9ad0-1fd50a9a593a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:19.987122 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-74bfb3fa-cda6-4914-9ad0-1fd50a9a593a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:20.011747 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b2c24-7379-46a5-8a20-a15e3b7ce8e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:20.012493 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b2c24-7379-46a5-8a20-a15e3b7ce8e5 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:20.014766 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b2c24-7379-46a5-8a20-a15e3b7ce8e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:20.015892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b2c24-7379-46a5-8a20-a15e3b7ce8e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:20.064331 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:20.074279 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b2c24-7379-46a5-8a20-a15e3b7ce8e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:20.078914 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b2c24-7379-46a5-8a20-a15e3b7ce8e5 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:20.136485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 835/1695] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 20:56:20.137355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfb3fa-cda6-4914-9ad0-1fd50a9a593a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:20.138559 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d95ce-eb6f-43ca-ae24-67c6bbbcaf42 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:20.139104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d95ce-eb6f-43ca-ae24-67c6bbbcaf42 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:20.139484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d95ce-eb6f-43ca-ae24-67c6bbbcaf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:20.151385 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3615a-fc3d-4cae-a546-1181250a264b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:20.152319 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3615a-fc3d-4cae-a546-1181250a264b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:20.153219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3615a-fc3d-4cae-a546-1181250a264b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:20.153641 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3615a-fc3d-4cae-a546-1181250a264b admin admin] PATH_INFO: `/v3/projects/b7d0dc068d50444a97ae476b162aab7e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:20.157140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3615a-fc3d-4cae-a546-1181250a264b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7d0dc068d50444a97ae476b162aab7e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:20.159349 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3615a-fc3d-4cae-a546-1181250a264b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:20.258081 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e60d95ce-eb6f-43ca-ae24-67c6bbbcaf42 None None] MFA Rules not processed for user `af23fcaecde74f71a3e7bc7231194a06`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:20.259310 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e60d95ce-eb6f-43ca-ae24-67c6bbbcaf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:20.286716 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-18b3615a-fc3d-4cae-a546-1181250a264b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7d0dc068d50444a97ae476b162aab7e', 'request_id': 'req-18b3615a-fc3d-4cae-a546-1181250a264b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:20.308882 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-18b3615a-fc3d-4cae-a546-1181250a264b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7d0dc068d50444a97ae476b162aab7e', 'request_id': 'req-18b3615a-fc3d-4cae-a546-1181250a264b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:20.316355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-18b3615a-fc3d-4cae-a546-1181250a264b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7d0dc068d50444a97ae476b162aab7e', 'request_id': 'req-18b3615a-fc3d-4cae-a546-1181250a264b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:20.341521 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-18b3615a-fc3d-4cae-a546-1181250a264b admin admin] The token cache is being invalidate because project b7d0dc068d50444a97ae476b162aab7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:20.341855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-18b3615a-fc3d-4cae-a546-1181250a264b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:20.345790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-18b3615a-fc3d-4cae-a546-1181250a264b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:20.348370 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 861/1696] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:19 2022] DELETE /identity/v3/projects/b7d0dc068d50444a97ae476b162aab7e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:20.350609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03dac1-4b2e-477a-b211-e7035a72efe6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:20.352181 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03dac1-4b2e-477a-b211-e7035a72efe6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:20.353695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03dac1-4b2e-477a-b211-e7035a72efe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:20.448610 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 836/1697] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:20.459199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb487166-1a33-40bc-95ea-e7131409e1d1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:20.459199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb487166-1a33-40bc-95ea-e7131409e1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:20.459199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb487166-1a33-40bc-95ea-e7131409e1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:20.487889 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fd03dac1-4b2e-477a-b211-e7035a72efe6 None None] MFA Rules not processed for user `e51ae6959aac49898e75c6786c5dbdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:20.490254 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fd03dac1-4b2e-477a-b211-e7035a72efe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:20.501004 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-eb487166-1a33-40bc-95ea-e7131409e1d1 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:20.502237 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-eb487166-1a33-40bc-95ea-e7131409e1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:20.601108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:20.628460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 837/1698] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:20.633414 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec50b4b-0fae-45b5-b481-2ed4a2a17704 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:20.637544 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec50b4b-0fae-45b5-b481-2ed4a2a17704 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:20.637544 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec50b4b-0fae-45b5-b481-2ed4a2a17704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:20.675314 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 862/1699] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Sep 9 20:56:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:20.677611 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9834f46-e27b-4223-b980-39d8e634ce63 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:20.678048 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9834f46-e27b-4223-b980-39d8e634ce63 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:20.678489 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9834f46-e27b-4223-b980-39d8e634ce63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:20.734078 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2ec50b4b-0fae-45b5-b481-2ed4a2a17704 None None] MFA Rules not processed for user `af23fcaecde74f71a3e7bc7231194a06`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:20.738201 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2ec50b4b-0fae-45b5-b481-2ed4a2a17704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:20.738604 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a9834f46-e27b-4223-b980-39d8e634ce63 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:20.740133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a9834f46-e27b-4223-b980-39d8e634ce63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:20.756982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 863/1700] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:20.762055 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9834f46-e27b-4223-b980-39d8e634ce63 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:20.782666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 838/1701] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:20.786582 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9834f46-e27b-4223-b980-39d8e634ce63 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:20.802523 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf3a99-4e8c-460d-8452-801217f60479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:20.803230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf3a99-4e8c-460d-8452-801217f60479 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:20.803457 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf3a99-4e8c-460d-8452-801217f60479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:20.803740 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf3a99-4e8c-460d-8452-801217f60479 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:20.804705 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf3a99-4e8c-460d-8452-801217f60479 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:56:20.805199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf3a99-4e8c-460d-8452-801217f60479 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:20.809255 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf3a99-4e8c-460d-8452-801217f60479 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:20.840372 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 864/1702] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:56:20.844894 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec50b4b-0fae-45b5-b481-2ed4a2a17704 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:20.863648 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf3a99-4e8c-460d-8452-801217f60479 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:20.865560 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fedf3a99-4e8c-460d-8452-801217f60479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:20.869221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec50b4b-0fae-45b5-b481-2ed4a2a17704 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:20.884307 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731400f9-2095-4f1a-8e56-52f2c074ca29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:20.887594 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731400f9-2095-4f1a-8e56-52f2c074ca29 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:20.887751 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731400f9-2095-4f1a-8e56-52f2c074ca29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:20.888065 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731400f9-2095-4f1a-8e56-52f2c074ca29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:20.888748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731400f9-2095-4f1a-8e56-52f2c074ca29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:20.892674 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731400f9-2095-4f1a-8e56-52f2c074ca29 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:21.011322 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 839/1703] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:20 2022] POST /identity/v3/projects => generated 391 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:56:21.020554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731400f9-2095-4f1a-8e56-52f2c074ca29 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:21.183460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf3a99-4e8c-460d-8452-801217f60479 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:21.294608 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:21.305452 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731400f9-2095-4f1a-8e56-52f2c074ca29 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:21.320736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a43b5a-1fc4-4d2a-a134-9b5e5985be70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:21.321412 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a43b5a-1fc4-4d2a-a134-9b5e5985be70 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:21.321693 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a43b5a-1fc4-4d2a-a134-9b5e5985be70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:21.321964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a43b5a-1fc4-4d2a-a134-9b5e5985be70 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:21.322681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a43b5a-1fc4-4d2a-a134-9b5e5985be70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:21.343837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a43b5a-1fc4-4d2a-a134-9b5e5985be70 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:21.418185 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 840/1704] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:21 2022] POST /identity/v3/users => generated 296 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:21.423757 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a43b5a-1fc4-4d2a-a134-9b5e5985be70 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:21.428928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-81a43b5a-1fc4-4d2a-a134-9b5e5985be70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:21.469593 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfd43e-4ade-48a2-9f8b-ee1882a2caab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:21.470230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfd43e-4ade-48a2-9f8b-ee1882a2caab service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:21.470511 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfd43e-4ade-48a2-9f8b-ee1882a2caab service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:21.470783 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfd43e-4ade-48a2-9f8b-ee1882a2caab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:21.645603 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfd43e-4ade-48a2-9f8b-ee1882a2caab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:21.647370 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfd43e-4ade-48a2-9f8b-ee1882a2caab service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:21.672214 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:21.689441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 865/1705] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:20 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 826 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 20:56:21.692173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfd43e-4ade-48a2-9f8b-ee1882a2caab service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:21.734736 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfd43e-4ade-48a2-9f8b-ee1882a2caab service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:21.749260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365276e-7a1b-488a-9a80-c222c35a8a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:21.749955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365276e-7a1b-488a-9a80-c222c35a8a91 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:21.750215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365276e-7a1b-488a-9a80-c222c35a8a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:21.750490 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365276e-7a1b-488a-9a80-c222c35a8a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:21.751148 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365276e-7a1b-488a-9a80-c222c35a8a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:21.756214 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365276e-7a1b-488a-9a80-c222c35a8a91 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:21.795169 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 866/1706] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:21.800077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365276e-7a1b-488a-9a80-c222c35a8a91 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:21.822270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365276e-7a1b-488a-9a80-c222c35a8a91 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:21.839969 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbca8cf-6deb-4f88-9e99-874202e5d78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:21.842164 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbca8cf-6deb-4f88-9e99-874202e5d78a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:21.843343 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbca8cf-6deb-4f88-9e99-874202e5d78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:21.843771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbca8cf-6deb-4f88-9e99-874202e5d78a admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:21.844785 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbca8cf-6deb-4f88-9e99-874202e5d78a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:21.845845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a43b5a-1fc4-4d2a-a134-9b5e5985be70 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:21.848121 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbca8cf-6deb-4f88-9e99-874202e5d78a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:21.867195 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fa85c-924b-46dd-b752-c195c1e716fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9570eaa112de460cb9e371278bfb300b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:21.877892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fa85c-924b-46dd-b752-c195c1e716fc service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:21.877892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fa85c-924b-46dd-b752-c195c1e716fc service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:21.878356 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fa85c-924b-46dd-b752-c195c1e716fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:21.880305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 867/1707] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:21.886375 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbca8cf-6deb-4f88-9e99-874202e5d78a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:21.930188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbca8cf-6deb-4f88-9e99-874202e5d78a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:21.977841 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da8b5cd-a459-4641-90d6-85cc6eb00426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:21.978777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8b5cd-a459-4641-90d6-85cc6eb00426 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:21.979676 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8b5cd-a459-4641-90d6-85cc6eb00426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:21.981014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da8b5cd-a459-4641-90d6-85cc6eb00426 admin admin] PATH_INFO: `/v3/projects/aefc616bbe7d46f2bd11121efde23aa9/users/5aa3f43a722c48dfabf355fb94719482/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:22.033193 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8b5cd-a459-4641-90d6-85cc6eb00426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aefc616bbe7d46f2bd11121efde23aa9, user_id=5aa3f43a722c48dfabf355fb94719482, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:22.036479 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da8b5cd-a459-4641-90d6-85cc6eb00426 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:22.067204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 868/1708] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:21 2022] PUT /identity/v3/projects/aefc616bbe7d46f2bd11121efde23aa9/users/5aa3f43a722c48dfabf355fb94719482/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:22.078775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7302c35-7110-4be2-b326-134929b94762 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:22.079316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7302c35-7110-4be2-b326-134929b94762 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:22.079742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7302c35-7110-4be2-b326-134929b94762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:22.148283 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b7302c35-7110-4be2-b326-134929b94762 None None] MFA Rules not processed for user `5aa3f43a722c48dfabf355fb94719482`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:22.155491 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b7302c35-7110-4be2-b326-134929b94762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:22.166016 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fa85c-924b-46dd-b752-c195c1e716fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:22.167668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fa85c-924b-46dd-b752-c195c1e716fc service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:22.199597 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 841/1709] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Sep 9 20:56:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 781 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 20:56:22.367748 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 869/1710] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:56:22.372400 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fa85c-924b-46dd-b752-c195c1e716fc service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:22.399328 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fa85c-924b-46dd-b752-c195c1e716fc service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:22.684162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a66e0c-cf27-4c66-b669-b2575a3fc065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:22.684916 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a66e0c-cf27-4c66-b669-b2575a3fc065 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:22.689065 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a66e0c-cf27-4c66-b669-b2575a3fc065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:22.689450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a66e0c-cf27-4c66-b669-b2575a3fc065 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:22.697651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a66e0c-cf27-4c66-b669-b2575a3fc065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:22.700577 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a66e0c-cf27-4c66-b669-b2575a3fc065 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:22.788216 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:22.821190 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 842/1711] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:22 2022] POST /identity/v3/projects => generated 391 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:22.822468 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7302c35-7110-4be2-b326-134929b94762 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:22.840790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7302c35-7110-4be2-b326-134929b94762 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:23.026172 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33f464-85c5-46ac-b423-4931d9b270fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:23.027837 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33f464-85c5-46ac-b423-4931d9b270fd admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:23.029190 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33f464-85c5-46ac-b423-4931d9b270fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:23.030005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33f464-85c5-46ac-b423-4931d9b270fd admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:23.031481 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33f464-85c5-46ac-b423-4931d9b270fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:23.038347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33f464-85c5-46ac-b423-4931d9b270fd admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:23.157926 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a66e0c-cf27-4c66-b669-b2575a3fc065 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:23.168711 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 870/1712] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:22 2022] POST /identity/v3/users => generated 302 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:56:23.183542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a66e0c-cf27-4c66-b669-b2575a3fc065 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:23.203314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9cddf-bbe1-49a3-b9db-d3a981068dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:23.204278 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9cddf-bbe1-49a3-b9db-d3a981068dca admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:23.204702 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9cddf-bbe1-49a3-b9db-d3a981068dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:23.205043 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9cddf-bbe1-49a3-b9db-d3a981068dca admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:23.210854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9cddf-bbe1-49a3-b9db-d3a981068dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:23.212631 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9cddf-bbe1-49a3-b9db-d3a981068dca admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:23.263385 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33f464-85c5-46ac-b423-4931d9b270fd admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:23.270878 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 843/1713] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:56:23.292216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33f464-85c5-46ac-b423-4931d9b270fd admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:23.313635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75a733-8774-4522-b34a-6ff5ee64f742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:23.314367 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75a733-8774-4522-b34a-6ff5ee64f742 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:23.314876 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75a733-8774-4522-b34a-6ff5ee64f742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:23.315351 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75a733-8774-4522-b34a-6ff5ee64f742 admin admin] PATH_INFO: `/v3/projects/60d62b23b1734df7aa3ca25ce712476d/users/8d0a232e9e28433a8e091ac7319ce641/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:23.409981 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75a733-8774-4522-b34a-6ff5ee64f742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d62b23b1734df7aa3ca25ce712476d, user_id=8d0a232e9e28433a8e091ac7319ce641, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:23.416189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75a733-8774-4522-b34a-6ff5ee64f742 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:23.470570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9cddf-bbe1-49a3-b9db-d3a981068dca admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:23.471268 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 871/1714] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:23 2022] PUT /identity/v3/projects/60d62b23b1734df7aa3ca25ce712476d/users/8d0a232e9e28433a8e091ac7319ce641/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:23.509299 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9cddf-bbe1-49a3-b9db-d3a981068dca admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:23.674348 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58833e89-5546-4dd7-9ed8-59e0000abb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:23.680048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58833e89-5546-4dd7-9ed8-59e0000abb10 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:23.683554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58833e89-5546-4dd7-9ed8-59e0000abb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:23.683872 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58833e89-5546-4dd7-9ed8-59e0000abb10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:23.689366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58833e89-5546-4dd7-9ed8-59e0000abb10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:23.713345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58833e89-5546-4dd7-9ed8-59e0000abb10 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:23.799808 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 844/1715] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:23.807108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75a733-8774-4522-b34a-6ff5ee64f742 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:23.855837 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75a733-8774-4522-b34a-6ff5ee64f742 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:23.901833 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf49dd-d9cf-4700-b9b0-6d3a6dd2486e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:23.905360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf49dd-d9cf-4700-b9b0-6d3a6dd2486e admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:23.909876 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf49dd-d9cf-4700-b9b0-6d3a6dd2486e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:23.913591 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf49dd-d9cf-4700-b9b0-6d3a6dd2486e admin admin] PATH_INFO: `/v3/projects/60d62b23b1734df7aa3ca25ce712476d/users/8d0a232e9e28433a8e091ac7319ce641/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:23.936078 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf49dd-d9cf-4700-b9b0-6d3a6dd2486e admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d62b23b1734df7aa3ca25ce712476d, user_id=8d0a232e9e28433a8e091ac7319ce641, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:23.941592 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf49dd-d9cf-4700-b9b0-6d3a6dd2486e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:23.958316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:23.991617 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46755b8-1c03-435f-9eb7-a643ef0484ae None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:23.995838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46755b8-1c03-435f-9eb7-a643ef0484ae None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:23.995838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46755b8-1c03-435f-9eb7-a643ef0484ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:24.002903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 872/1716] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:23 2022] PUT /identity/v3/projects/60d62b23b1734df7aa3ca25ce712476d/users/8d0a232e9e28433a8e091ac7319ce641/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:24.118265 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e46755b8-1c03-435f-9eb7-a643ef0484ae None None] MFA Rules not processed for user `8d0a232e9e28433a8e091ac7319ce641`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:24.119518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e46755b8-1c03-435f-9eb7-a643ef0484ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:24.331888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 845/1717] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:23 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:24.395725 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf49dd-d9cf-4700-b9b0-6d3a6dd2486e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:24.396742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-80bf49dd-d9cf-4700-b9b0-6d3a6dd2486e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:24.553221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf49dd-d9cf-4700-b9b0-6d3a6dd2486e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:24.560629 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe4482-4ad0-44e5-9b18-9708c3c98a13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:24.561531 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe4482-4ad0-44e5-9b18-9708c3c98a13 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:24.562402 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe4482-4ad0-44e5-9b18-9708c3c98a13 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:24.562888 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe4482-4ad0-44e5-9b18-9708c3c98a13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:24.592976 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe4482-4ad0-44e5-9b18-9708c3c98a13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:24.595693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe4482-4ad0-44e5-9b18-9708c3c98a13 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:24.634810 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 873/1718] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:24 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:24.812134 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46755b8-1c03-435f-9eb7-a643ef0484ae None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:24.831262 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46755b8-1c03-435f-9eb7-a643ef0484ae None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:24.846787 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc37295-ce4a-4a86-a52c-3968e5c5d202 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:24.847840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc37295-ce4a-4a86-a52c-3968e5c5d202 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:24.848456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc37295-ce4a-4a86-a52c-3968e5c5d202 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:24.849038 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc37295-ce4a-4a86-a52c-3968e5c5d202 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:24.991264 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b307f54-053e-4517-8734-9a7c7ced9216 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:24.992411 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b307f54-053e-4517-8734-9a7c7ced9216 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:24.993807 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b307f54-053e-4517-8734-9a7c7ced9216 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:24.996812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 874/1719] 10.222.0.15 () {54 vars in 912 bytes} [Fri Sep 9 20:56:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:56:25.007083 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4b874-f5cc-430f-b5dc-dd47c9f6d79a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:25.007944 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4b874-f5cc-430f-b5dc-dd47c9f6d79a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:25.008543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4b874-f5cc-430f-b5dc-dd47c9f6d79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:25.049046 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc37295-ce4a-4a86-a52c-3968e5c5d202 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:25.049359 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ddd4b874-f5cc-430f-b5dc-dd47c9f6d79a None None] MFA Rules not processed for user `27e2be33ebdc4c5a97befcbd4d09ee4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:25.051571 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc37295-ce4a-4a86-a52c-3968e5c5d202 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:25.053186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ddd4b874-f5cc-430f-b5dc-dd47c9f6d79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:25.099919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 846/1720] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:25.286943 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc37295-ce4a-4a86-a52c-3968e5c5d202 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:25.288749 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7cc37295-ce4a-4a86-a52c-3968e5c5d202 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:25.296550 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:25.303703 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 875/1721] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Sep 9 20:56:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:25.456522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4b874-f5cc-430f-b5dc-dd47c9f6d79a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:25.458610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ddd4b874-f5cc-430f-b5dc-dd47c9f6d79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:25.477286 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4b874-f5cc-430f-b5dc-dd47c9f6d79a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:25.499859 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae6316-74b5-4982-be90-cc5f4467d7ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:25.500490 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae6316-74b5-4982-be90-cc5f4467d7ac service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:25.500756 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae6316-74b5-4982-be90-cc5f4467d7ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:25.501030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae6316-74b5-4982-be90-cc5f4467d7ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:25.546074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc37295-ce4a-4a86-a52c-3968e5c5d202 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:25.555435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae6316-74b5-4982-be90-cc5f4467d7ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:25.558470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae6316-74b5-4982-be90-cc5f4467d7ac service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:25.563575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15d75b-0ca8-46e6-8059-13c79c4f582b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:25.564281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15d75b-0ca8-46e6-8059-13c79c4f582b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:25.571744 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15d75b-0ca8-46e6-8059-13c79c4f582b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:25.572190 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15d75b-0ca8-46e6-8059-13c79c4f582b admin admin] PATH_INFO: `/v3/users/280e5b6f9b10479ba92dda832b6d36ad` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:25.576919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15d75b-0ca8-46e6-8059-13c79c4f582b admin admin] RBAC: Authorizing `identity:delete_user(user_id=280e5b6f9b10479ba92dda832b6d36ad)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:25.579324 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15d75b-0ca8-46e6-8059-13c79c4f582b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:25.614987 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 876/1722] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:25.703840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9f15d75b-0ca8-46e6-8059-13c79c4f582b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '280e5b6f9b10479ba92dda832b6d36ad'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:25.742002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9f15d75b-0ca8-46e6-8059-13c79c4f582b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '280e5b6f9b10479ba92dda832b6d36ad'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:25.742740 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9f15d75b-0ca8-46e6-8059-13c79c4f582b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '280e5b6f9b10479ba92dda832b6d36ad'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:25.743344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9f15d75b-0ca8-46e6-8059-13c79c4f582b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '280e5b6f9b10479ba92dda832b6d36ad'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:25.763329 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9f15d75b-0ca8-46e6-8059-13c79c4f582b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '280e5b6f9b10479ba92dda832b6d36ad'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:25.834901 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 847/1723] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:25 2022] DELETE /identity/v3/users/280e5b6f9b10479ba92dda832b6d36ad => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:25.842097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee5ec6-6c0b-4f0b-beab-f13eb818a4bf None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:25.842993 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee5ec6-6c0b-4f0b-beab-f13eb818a4bf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:25.843278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee5ec6-6c0b-4f0b-beab-f13eb818a4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:25.920705 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-cfee5ec6-6c0b-4f0b-beab-f13eb818a4bf None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:25.924297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cfee5ec6-6c0b-4f0b-beab-f13eb818a4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:26.029926 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3847cd7-8f06-446a-b07f-facc1010c803 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:26.030479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3847cd7-8f06-446a-b07f-facc1010c803 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:26.030757 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3847cd7-8f06-446a-b07f-facc1010c803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:26.044541 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 877/1724] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:26.060439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee5ec6-6c0b-4f0b-beab-f13eb818a4bf None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:26.062771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cfee5ec6-6c0b-4f0b-beab-f13eb818a4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:26.117874 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c3847cd7-8f06-446a-b07f-facc1010c803 None None] MFA Rules not processed for user `27e2be33ebdc4c5a97befcbd4d09ee4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:26.119140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c3847cd7-8f06-446a-b07f-facc1010c803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:26.256333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:26.347268 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee5ec6-6c0b-4f0b-beab-f13eb818a4bf None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:26.355314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 848/1725] 10.222.0.17 () {58 vars in 1015 bytes} [Fri Sep 9 20:56:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:26.368092 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c079114-5d60-441b-b4fd-5c100c5d1edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:26.368905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c079114-5d60-441b-b4fd-5c100c5d1edf service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:26.370651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c079114-5d60-441b-b4fd-5c100c5d1edf service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:26.371153 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c079114-5d60-441b-b4fd-5c100c5d1edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:26.402178 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c079114-5d60-441b-b4fd-5c100c5d1edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:26.403916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c079114-5d60-441b-b4fd-5c100c5d1edf service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:26.441389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 878/1726] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:26.621420 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3847cd7-8f06-446a-b07f-facc1010c803 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:26.623212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c3847cd7-8f06-446a-b07f-facc1010c803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:26.644290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3847cd7-8f06-446a-b07f-facc1010c803 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:26.679053 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728bee5-1478-4dd4-8711-3dda8c015678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:26.679053 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728bee5-1478-4dd4-8711-3dda8c015678 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:26.679053 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728bee5-1478-4dd4-8711-3dda8c015678 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:26.679053 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728bee5-1478-4dd4-8711-3dda8c015678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:26.698458 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728bee5-1478-4dd4-8711-3dda8c015678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:26.703375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728bee5-1478-4dd4-8711-3dda8c015678 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:26.742422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 849/1727] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:27.139849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c079114-5d60-441b-b4fd-5c100c5d1edf service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:27.143942 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8c079114-5d60-441b-b4fd-5c100c5d1edf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:27.179173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206af5b-8708-4715-9326-cc310094cc95 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:27.179789 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206af5b-8708-4715-9326-cc310094cc95 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:27.180326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206af5b-8708-4715-9326-cc310094cc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:27.214871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c079114-5d60-441b-b4fd-5c100c5d1edf service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:27.242012 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea57d8-280a-49d3-b1e8-5a0dfd242706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:27.242904 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea57d8-280a-49d3-b1e8-5a0dfd242706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:27.245075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea57d8-280a-49d3-b1e8-5a0dfd242706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:27.245548 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea57d8-280a-49d3-b1e8-5a0dfd242706 admin admin] PATH_INFO: `/v3/users/c09627123f8e409fadd35bca01ea80dd` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:27.249141 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea57d8-280a-49d3-b1e8-5a0dfd242706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c09627123f8e409fadd35bca01ea80dd)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:27.252810 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea57d8-280a-49d3-b1e8-5a0dfd242706 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:27.254999 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d206af5b-8708-4715-9326-cc310094cc95 None None] MFA Rules not processed for user `9c758557426941babdaa68cbae43f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:27.256276 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d206af5b-8708-4715-9326-cc310094cc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:27.277830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:27.368618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bdea57d8-280a-49d3-b1e8-5a0dfd242706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c09627123f8e409fadd35bca01ea80dd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:27.413141 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bdea57d8-280a-49d3-b1e8-5a0dfd242706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c09627123f8e409fadd35bca01ea80dd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:27.486356 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bdea57d8-280a-49d3-b1e8-5a0dfd242706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c09627123f8e409fadd35bca01ea80dd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:27.490325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bdea57d8-280a-49d3-b1e8-5a0dfd242706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c09627123f8e409fadd35bca01ea80dd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:27.496727 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bdea57d8-280a-49d3-b1e8-5a0dfd242706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c09627123f8e409fadd35bca01ea80dd'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:27.522460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 850/1728] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:27.522460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206af5b-8708-4715-9326-cc310094cc95 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:27.537277 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d206af5b-8708-4715-9326-cc310094cc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:27.545384 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 879/1729] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:27 2022] DELETE /identity/v3/users/c09627123f8e409fadd35bca01ea80dd => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:27.550146 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17329a5e-a681-4f47-80a4-9e7dd6928954 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:27.550458 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17329a5e-a681-4f47-80a4-9e7dd6928954 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:27.550823 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17329a5e-a681-4f47-80a4-9e7dd6928954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:27.586000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-17329a5e-a681-4f47-80a4-9e7dd6928954 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:27.587337 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-17329a5e-a681-4f47-80a4-9e7dd6928954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:27.617239 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d206af5b-8708-4715-9326-cc310094cc95 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:27.764380 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 880/1730] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:27.776780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17329a5e-a681-4f47-80a4-9e7dd6928954 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:27.786788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-17329a5e-a681-4f47-80a4-9e7dd6928954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:27.834258 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6d0d3-7af3-492a-b8b8-964d0fb470ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:27.835466 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6d0d3-7af3-492a-b8b8-964d0fb470ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:27.835893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6d0d3-7af3-492a-b8b8-964d0fb470ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:27.836337 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6d0d3-7af3-492a-b8b8-964d0fb470ae admin admin] PATH_INFO: `/v3/projects/d81999a127ea4b80b0c301f64c2b8c8d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:27.844024 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6d0d3-7af3-492a-b8b8-964d0fb470ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=d81999a127ea4b80b0c301f64c2b8c8d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:27.861284 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6d0d3-7af3-492a-b8b8-964d0fb470ae admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:27.963528 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17329a5e-a681-4f47-80a4-9e7dd6928954 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:27.975102 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f1376-0041-4f95-824c-a7ccb9ce8d8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:27.975743 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f1376-0041-4f95-824c-a7ccb9ce8d8e service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:27.976046 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f1376-0041-4f95-824c-a7ccb9ce8d8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:27.976326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f1376-0041-4f95-824c-a7ccb9ce8d8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:27.992929 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:28.006556 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f1376-0041-4f95-824c-a7ccb9ce8d8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:28.009421 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f1376-0041-4f95-824c-a7ccb9ce8d8e service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:28.025518 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 881/1731] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:28.038524 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-94f6d0d3-7af3-492a-b8b8-964d0fb470ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd81999a127ea4b80b0c301f64c2b8c8d', 'request_id': 'req-94f6d0d3-7af3-492a-b8b8-964d0fb470ae'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:28.054595 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-94f6d0d3-7af3-492a-b8b8-964d0fb470ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd81999a127ea4b80b0c301f64c2b8c8d', 'request_id': 'req-94f6d0d3-7af3-492a-b8b8-964d0fb470ae'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:28.081677 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-94f6d0d3-7af3-492a-b8b8-964d0fb470ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd81999a127ea4b80b0c301f64c2b8c8d', 'request_id': 'req-94f6d0d3-7af3-492a-b8b8-964d0fb470ae'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:28.107349 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f1376-0041-4f95-824c-a7ccb9ce8d8e service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:28.108899 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8b7f1376-0041-4f95-824c-a7ccb9ce8d8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:28.145081 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-94f6d0d3-7af3-492a-b8b8-964d0fb470ae admin admin] The token cache is being invalidate because project d81999a127ea4b80b0c301f64c2b8c8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:28.145439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-94f6d0d3-7af3-492a-b8b8-964d0fb470ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:28.159597 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-94f6d0d3-7af3-492a-b8b8-964d0fb470ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:28.164428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 851/1732] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:27 2022] DELETE /identity/v3/projects/d81999a127ea4b80b0c301f64c2b8c8d => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:28.200017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6d0d3-7af3-492a-b8b8-964d0fb470ae admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:28.201757 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-94f6d0d3-7af3-492a-b8b8-964d0fb470ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:28.381377 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:28.434518 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f1376-0041-4f95-824c-a7ccb9ce8d8e service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:28.490352 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6d0d3-7af3-492a-b8b8-964d0fb470ae admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:28.511534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4fa6e-de66-4319-a90a-a4ac2cc1b2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:28.512241 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4fa6e-de66-4319-a90a-a4ac2cc1b2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:28.512529 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4fa6e-de66-4319-a90a-a4ac2cc1b2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:28.512808 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea4fa6e-de66-4319-a90a-a4ac2cc1b2c5 admin admin] PATH_INFO: `/v3/users/f54e196fead948cf8e75ebdc93670a0a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:28.525805 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4fa6e-de66-4319-a90a-a4ac2cc1b2c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f54e196fead948cf8e75ebdc93670a0a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:28.527880 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea4fa6e-de66-4319-a90a-a4ac2cc1b2c5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:28.717267 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1ea4fa6e-de66-4319-a90a-a4ac2cc1b2c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f54e196fead948cf8e75ebdc93670a0a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:28.721027 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e53d25-4c88-417d-9cd3-c633952e4a8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:28.721651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e53d25-4c88-417d-9cd3-c633952e4a8e service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:28.722170 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e53d25-4c88-417d-9cd3-c633952e4a8e service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:28.722170 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e53d25-4c88-417d-9cd3-c633952e4a8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:28.735814 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1ea4fa6e-de66-4319-a90a-a4ac2cc1b2c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f54e196fead948cf8e75ebdc93670a0a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:28.736189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a6e53d25-4c88-417d-9cd3-c633952e4a8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:28.736524 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1ea4fa6e-de66-4319-a90a-a4ac2cc1b2c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f54e196fead948cf8e75ebdc93670a0a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:28.737181 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1ea4fa6e-de66-4319-a90a-a4ac2cc1b2c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f54e196fead948cf8e75ebdc93670a0a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:28.773619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1ea4fa6e-de66-4319-a90a-a4ac2cc1b2c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f54e196fead948cf8e75ebdc93670a0a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:28.868755 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 852/1733] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:28 2022] DELETE /identity/v3/users/f54e196fead948cf8e75ebdc93670a0a => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:28.960670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e53d25-4c88-417d-9cd3-c633952e4a8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:28.963723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e53d25-4c88-417d-9cd3-c633952e4a8e service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:29.011173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 882/1734] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 903 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:29.084925 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4fa6e-de66-4319-a90a-a4ac2cc1b2c5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:29.086496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1ea4fa6e-de66-4319-a90a-a4ac2cc1b2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:29.473470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea4fa6e-de66-4319-a90a-a4ac2cc1b2c5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:29.495116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bd168-b355-461f-a6f0-6b2e57c59e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:29.495808 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bd168-b355-461f-a6f0-6b2e57c59e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:29.496131 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bd168-b355-461f-a6f0-6b2e57c59e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:29.496417 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bd168-b355-461f-a6f0-6b2e57c59e4e admin admin] PATH_INFO: `/v3/projects/b62c2e013806475b8a5afe666d530744` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:29.503048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062bd168-b355-461f-a6f0-6b2e57c59e4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b62c2e013806475b8a5afe666d530744)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:29.506930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062bd168-b355-461f-a6f0-6b2e57c59e4e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:29.746971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-062bd168-b355-461f-a6f0-6b2e57c59e4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b62c2e013806475b8a5afe666d530744', 'request_id': 'req-062bd168-b355-461f-a6f0-6b2e57c59e4e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:29.780891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-062bd168-b355-461f-a6f0-6b2e57c59e4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b62c2e013806475b8a5afe666d530744', 'request_id': 'req-062bd168-b355-461f-a6f0-6b2e57c59e4e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:29.787390 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:29.823997 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-062bd168-b355-461f-a6f0-6b2e57c59e4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b62c2e013806475b8a5afe666d530744', 'request_id': 'req-062bd168-b355-461f-a6f0-6b2e57c59e4e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:29.880657 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-062bd168-b355-461f-a6f0-6b2e57c59e4e admin admin] The token cache is being invalidate because project b62c2e013806475b8a5afe666d530744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:29.881334 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-062bd168-b355-461f-a6f0-6b2e57c59e4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:29.887312 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-062bd168-b355-461f-a6f0-6b2e57c59e4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:29.894243 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 853/1735] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:29 2022] DELETE /identity/v3/projects/b62c2e013806475b8a5afe666d530744 => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:29.898839 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e53d25-4c88-417d-9cd3-c633952e4a8e service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:29.901025 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a6e53d25-4c88-417d-9cd3-c633952e4a8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:29.929927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e53d25-4c88-417d-9cd3-c633952e4a8e service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:30.030444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:30.121824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac6b3d-4bb7-4312-bbe6-ac69ded1e814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:30.124388 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac6b3d-4bb7-4312-bbe6-ac69ded1e814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:30.148205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac6b3d-4bb7-4312-bbe6-ac69ded1e814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:30.148544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac6b3d-4bb7-4312-bbe6-ac69ded1e814 admin admin] PATH_INFO: `/v3/users/569dc2d44846425a8d02d7be2dd79b8a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:30.155828 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac6b3d-4bb7-4312-bbe6-ac69ded1e814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=569dc2d44846425a8d02d7be2dd79b8a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:30.162898 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac6b3d-4bb7-4312-bbe6-ac69ded1e814 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:30.396337 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-04ac6b3d-4bb7-4312-bbe6-ac69ded1e814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '569dc2d44846425a8d02d7be2dd79b8a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:30.418682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-04ac6b3d-4bb7-4312-bbe6-ac69ded1e814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '569dc2d44846425a8d02d7be2dd79b8a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:30.479046 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-04ac6b3d-4bb7-4312-bbe6-ac69ded1e814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '569dc2d44846425a8d02d7be2dd79b8a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:30.483845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-04ac6b3d-4bb7-4312-bbe6-ac69ded1e814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '569dc2d44846425a8d02d7be2dd79b8a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:30.486339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-04ac6b3d-4bb7-4312-bbe6-ac69ded1e814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '569dc2d44846425a8d02d7be2dd79b8a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:30.547269 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 883/1736] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:29 2022] DELETE /identity/v3/users/569dc2d44846425a8d02d7be2dd79b8a => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:31.014264 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff92e0-15e6-4ffe-bac3-e667d029e856 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:31.014840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff92e0-15e6-4ffe-bac3-e667d029e856 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:31.014840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff92e0-15e6-4ffe-bac3-e667d029e856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:31.073234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-37ff92e0-15e6-4ffe-bac3-e667d029e856 None None] MFA Rules not processed for user `af23fcaecde74f71a3e7bc7231194a06`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:31.074964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-37ff92e0-15e6-4ffe-bac3-e667d029e856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:31.423803 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac6b3d-4bb7-4312-bbe6-ac69ded1e814 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:31.425908 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-04ac6b3d-4bb7-4312-bbe6-ac69ded1e814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:31.441097 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 854/1737] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:56:31.638786 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac6b3d-4bb7-4312-bbe6-ac69ded1e814 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:31.648195 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901dad31-a901-494a-a2e9-201cc69d26aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:31.648864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dad31-a901-494a-a2e9-201cc69d26aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:31.649141 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dad31-a901-494a-a2e9-201cc69d26aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:31.649414 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dad31-a901-494a-a2e9-201cc69d26aa admin admin] PATH_INFO: `/v3/users/5aa3f43a722c48dfabf355fb94719482` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:31.650630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901dad31-a901-494a-a2e9-201cc69d26aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aa3f43a722c48dfabf355fb94719482)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:31.654268 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901dad31-a901-494a-a2e9-201cc69d26aa admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:31.778988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-901dad31-a901-494a-a2e9-201cc69d26aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aa3f43a722c48dfabf355fb94719482'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:31.791817 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:31.808262 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-901dad31-a901-494a-a2e9-201cc69d26aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aa3f43a722c48dfabf355fb94719482'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:31.828100 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff92e0-15e6-4ffe-bac3-e667d029e856 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:31.830199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-37ff92e0-15e6-4ffe-bac3-e667d029e856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:31.871632 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff92e0-15e6-4ffe-bac3-e667d029e856 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:31.885662 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-901dad31-a901-494a-a2e9-201cc69d26aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aa3f43a722c48dfabf355fb94719482'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:31.890811 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-901dad31-a901-494a-a2e9-201cc69d26aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aa3f43a722c48dfabf355fb94719482'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:31.893561 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0d422-d887-4b52-ae99-99f737bbe32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:31.897600 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0d422-d887-4b52-ae99-99f737bbe32c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:31.898484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0d422-d887-4b52-ae99-99f737bbe32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:31.898974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0d422-d887-4b52-ae99-99f737bbe32c admin admin] PATH_INFO: `/v3/projects/555c401d47bd474d889a98a8b3bedb33` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:31.902255 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-901dad31-a901-494a-a2e9-201cc69d26aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aa3f43a722c48dfabf355fb94719482'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:31.905091 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0d422-d887-4b52-ae99-99f737bbe32c admin admin] RBAC: Authorizing `identity:delete_project(project_id=555c401d47bd474d889a98a8b3bedb33)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:31.913655 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0d422-d887-4b52-ae99-99f737bbe32c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:31.960915 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 884/1738] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:31 2022] DELETE /identity/v3/users/5aa3f43a722c48dfabf355fb94719482 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:31.965543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869678d1-29b3-4223-9ac5-3f68f1f78c47 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:31.966045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869678d1-29b3-4223-9ac5-3f68f1f78c47 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:31.966817 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869678d1-29b3-4223-9ac5-3f68f1f78c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:32.013896 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-869678d1-29b3-4223-9ac5-3f68f1f78c47 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:32.024497 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-869678d1-29b3-4223-9ac5-3f68f1f78c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:32.117776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-30e0d422-d887-4b52-ae99-99f737bbe32c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '555c401d47bd474d889a98a8b3bedb33', 'request_id': 'req-30e0d422-d887-4b52-ae99-99f737bbe32c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:32.141960 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-30e0d422-d887-4b52-ae99-99f737bbe32c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '555c401d47bd474d889a98a8b3bedb33', 'request_id': 'req-30e0d422-d887-4b52-ae99-99f737bbe32c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:32.181493 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-30e0d422-d887-4b52-ae99-99f737bbe32c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '555c401d47bd474d889a98a8b3bedb33', 'request_id': 'req-30e0d422-d887-4b52-ae99-99f737bbe32c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:32.218612 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-30e0d422-d887-4b52-ae99-99f737bbe32c admin admin] The token cache is being invalidate because project 555c401d47bd474d889a98a8b3bedb33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:32.218915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-30e0d422-d887-4b52-ae99-99f737bbe32c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:32.223964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-30e0d422-d887-4b52-ae99-99f737bbe32c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:32.228879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 885/1739] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:32.229818 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 855/1740] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:31 2022] DELETE /identity/v3/projects/555c401d47bd474d889a98a8b3bedb33 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:32.257325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c9980-5a14-4c9e-a383-8f3489b60f27 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:32.257961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c9980-5a14-4c9e-a383-8f3489b60f27 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:32.258236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c9980-5a14-4c9e-a383-8f3489b60f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:32.285441 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0d422-d887-4b52-ae99-99f737bbe32c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:32.287396 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-30e0d422-d887-4b52-ae99-99f737bbe32c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:32.294033 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8b2c9980-5a14-4c9e-a383-8f3489b60f27 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:32.295505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8b2c9980-5a14-4c9e-a383-8f3489b60f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:32.510087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0d422-d887-4b52-ae99-99f737bbe32c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:32.515193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f796c3-4635-42d3-980e-76ef5ce631a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:32.515887 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f796c3-4635-42d3-980e-76ef5ce631a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:32.516214 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f796c3-4635-42d3-980e-76ef5ce631a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:32.516492 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f796c3-4635-42d3-980e-76ef5ce631a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:32.518731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-59f796c3-4635-42d3-980e-76ef5ce631a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:32.565856 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 886/1741] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:32.575038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba0af3-dc99-4e9e-a3f7-b1cbfbbc0086 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:32.575335 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba0af3-dc99-4e9e-a3f7-b1cbfbbc0086 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:32.576853 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba0af3-dc99-4e9e-a3f7-b1cbfbbc0086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:32.636588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b1ba0af3-dc99-4e9e-a3f7-b1cbfbbc0086 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:32.638008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:32.642927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b1ba0af3-dc99-4e9e-a3f7-b1cbfbbc0086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:32.688382 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 887/1742] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:56:32.698164 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba0af3-dc99-4e9e-a3f7-b1cbfbbc0086 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:32.724081 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba0af3-dc99-4e9e-a3f7-b1cbfbbc0086 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:32.738766 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf5050-fbe2-4d50-b34e-4c7417a771f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:32.739549 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf5050-fbe2-4d50-b34e-4c7417a771f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:32.739827 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf5050-fbe2-4d50-b34e-4c7417a771f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:32.740116 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf5050-fbe2-4d50-b34e-4c7417a771f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:32.740785 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf5050-fbe2-4d50-b34e-4c7417a771f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:56:32.741090 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf5050-fbe2-4d50-b34e-4c7417a771f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:32.742763 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf5050-fbe2-4d50-b34e-4c7417a771f7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:32.796530 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 888/1743] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:56:32.804281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf5050-fbe2-4d50-b34e-4c7417a771f7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:32.817606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f796c3-4635-42d3-980e-76ef5ce631a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:32.819331 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f796c3-4635-42d3-980e-76ef5ce631a5 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:32.837948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf5050-fbe2-4d50-b34e-4c7417a771f7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:32.854816 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 856/1744] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:32.864857 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26375b4-acb4-48e6-b751-99141c3c7c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:32.865985 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26375b4-acb4-48e6-b751-99141c3c7c82 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:32.866470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26375b4-acb4-48e6-b751-99141c3c7c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:32.866978 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26375b4-acb4-48e6-b751-99141c3c7c82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:32.867920 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26375b4-acb4-48e6-b751-99141c3c7c82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:32.870128 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26375b4-acb4-48e6-b751-99141c3c7c82 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:32.934313 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 889/1745] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:32 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:32.939423 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f796c3-4635-42d3-980e-76ef5ce631a5 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:32.957988 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f796c3-4635-42d3-980e-76ef5ce631a5 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:33.081631 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff4609-bd2a-448c-9771-f4e932e09b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:33.086694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff4609-bd2a-448c-9771-f4e932e09b46 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:33.087141 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff4609-bd2a-448c-9771-f4e932e09b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:33.087523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff4609-bd2a-448c-9771-f4e932e09b46 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:33.088478 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff4609-bd2a-448c-9771-f4e932e09b46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:33.092031 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff4609-bd2a-448c-9771-f4e932e09b46 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:33.142003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 857/1746] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:32 2022] POST /identity/v3/users => generated 290 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:33.147561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26375b4-acb4-48e6-b751-99141c3c7c82 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:33.172418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26375b4-acb4-48e6-b751-99141c3c7c82 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:33.178950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93318845-2a31-49c5-bebc-8a6ca4466b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:33.179950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93318845-2a31-49c5-bebc-8a6ca4466b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:33.180106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93318845-2a31-49c5-bebc-8a6ca4466b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:33.180483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93318845-2a31-49c5-bebc-8a6ca4466b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:33.181262 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93318845-2a31-49c5-bebc-8a6ca4466b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:33.186423 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93318845-2a31-49c5-bebc-8a6ca4466b67 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:33.217505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 890/1747] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:56:33.223439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff4609-bd2a-448c-9771-f4e932e09b46 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:33.241472 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff4609-bd2a-448c-9771-f4e932e09b46 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:33.253476 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9f889-6d00-4ee4-8107-fda5f6b63814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:33.254331 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9f889-6d00-4ee4-8107-fda5f6b63814 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:33.254717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9f889-6d00-4ee4-8107-fda5f6b63814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:33.255181 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9f889-6d00-4ee4-8107-fda5f6b63814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:33.255954 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9f889-6d00-4ee4-8107-fda5f6b63814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:33.257883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9f889-6d00-4ee4-8107-fda5f6b63814 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:33.297756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 858/1748] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:33.303456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93318845-2a31-49c5-bebc-8a6ca4466b67 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:33.317872 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93318845-2a31-49c5-bebc-8a6ca4466b67 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:33.335486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f17e2-8acb-4120-835f-f8f624f7b9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:33.338305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f17e2-8acb-4120-835f-f8f624f7b9e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:33.338305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f17e2-8acb-4120-835f-f8f624f7b9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:33.339467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f17e2-8acb-4120-835f-f8f624f7b9e4 admin admin] PATH_INFO: `/v3/projects/4cadfb02d9014e8798868f8b7754b094/users/cb937ab5d3504cf9a813bb1ee0615b2b/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:33.380053 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:33.389892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f17e2-8acb-4120-835f-f8f624f7b9e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cadfb02d9014e8798868f8b7754b094, user_id=cb937ab5d3504cf9a813bb1ee0615b2b, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:33.398012 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f17e2-8acb-4120-835f-f8f624f7b9e4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:33.442261 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 891/1749] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:33 2022] PUT /identity/v3/projects/4cadfb02d9014e8798868f8b7754b094/users/cb937ab5d3504cf9a813bb1ee0615b2b/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:33.453951 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddd735-167b-46d7-91f8-e579ddc0b327 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:33.454516 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddd735-167b-46d7-91f8-e579ddc0b327 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:33.454924 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddd735-167b-46d7-91f8-e579ddc0b327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:33.523250 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1bddd735-167b-46d7-91f8-e579ddc0b327 None None] MFA Rules not processed for user `cb937ab5d3504cf9a813bb1ee0615b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:33.528400 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1bddd735-167b-46d7-91f8-e579ddc0b327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:33.721542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 859/1750] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:33.724736 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f17e2-8acb-4120-835f-f8f624f7b9e4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:33.993222 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f17e2-8acb-4120-835f-f8f624f7b9e4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:34.014277 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddd735-167b-46d7-91f8-e579ddc0b327 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:34.016796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1bddd735-167b-46d7-91f8-e579ddc0b327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:34.035975 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e43d3-0b3f-4fcb-8dc1-e4f9b4b82fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:34.045244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e43d3-0b3f-4fcb-8dc1-e4f9b4b82fdf admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:34.045658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e43d3-0b3f-4fcb-8dc1-e4f9b4b82fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:34.046062 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e43d3-0b3f-4fcb-8dc1-e4f9b4b82fdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:34.056746 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e43d3-0b3f-4fcb-8dc1-e4f9b4b82fdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:34.075801 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e43d3-0b3f-4fcb-8dc1-e4f9b4b82fdf admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:34.110545 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddd735-167b-46d7-91f8-e579ddc0b327 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:34.138603 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d20dab-c913-41b2-bfdc-ea8e6c542176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:34.146107 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d20dab-c913-41b2-bfdc-ea8e6c542176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:34.147017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d20dab-c913-41b2-bfdc-ea8e6c542176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:34.147017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d20dab-c913-41b2-bfdc-ea8e6c542176 admin admin] PATH_INFO: `/v3/projects/3a7bf7486b6542eb86fb1bd4bf73fa7c` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:34.154458 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d20dab-c913-41b2-bfdc-ea8e6c542176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a7bf7486b6542eb86fb1bd4bf73fa7c)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:34.176118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d20dab-c913-41b2-bfdc-ea8e6c542176 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:34.307744 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 892/1751] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:33 2022] POST /identity/v3/projects => generated 381 bytes in 584 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:56:34.309437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9163a7-a805-488d-bdcd-5731caae3c87 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:34.322875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9163a7-a805-488d-bdcd-5731caae3c87 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:34.324613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9163a7-a805-488d-bdcd-5731caae3c87 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:34.326485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 893/1752] 10.222.0.15 () {54 vars in 921 bytes} [Fri Sep 9 20:56:34 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:56:34.333463 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9163a7-a805-488d-bdcd-5731caae3c87 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:34.376868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:34.438680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-58d20dab-c913-41b2-bfdc-ea8e6c542176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a7bf7486b6542eb86fb1bd4bf73fa7c', 'request_id': 'req-58d20dab-c913-41b2-bfdc-ea8e6c542176'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:34.461395 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-58d20dab-c913-41b2-bfdc-ea8e6c542176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a7bf7486b6542eb86fb1bd4bf73fa7c', 'request_id': 'req-58d20dab-c913-41b2-bfdc-ea8e6c542176'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:34.478194 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-58d20dab-c913-41b2-bfdc-ea8e6c542176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a7bf7486b6542eb86fb1bd4bf73fa7c', 'request_id': 'req-58d20dab-c913-41b2-bfdc-ea8e6c542176'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:34.539128 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-58d20dab-c913-41b2-bfdc-ea8e6c542176 admin admin] The token cache is being invalidate because project 3a7bf7486b6542eb86fb1bd4bf73fa7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:34.539128 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-58d20dab-c913-41b2-bfdc-ea8e6c542176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:34.543450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-58d20dab-c913-41b2-bfdc-ea8e6c542176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:34.554287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 860/1753] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:34 2022] DELETE /identity/v3/projects/3a7bf7486b6542eb86fb1bd4bf73fa7c => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:34.554287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333393e-87f5-4bc9-8227-549f01aff6af None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:34.554287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333393e-87f5-4bc9-8227-549f01aff6af None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:34.554287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333393e-87f5-4bc9-8227-549f01aff6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:34.656548 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3333393e-87f5-4bc9-8227-549f01aff6af None None] MFA Rules not processed for user `dc210376e57a41e6b3812110db249099`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:34.657711 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3333393e-87f5-4bc9-8227-549f01aff6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:34.665505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9163a7-a805-488d-bdcd-5731caae3c87 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:34.805383 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac619267-1c2a-4512-9bde-a017abf22513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:34.806072 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac619267-1c2a-4512-9bde-a017abf22513 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:34.806284 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac619267-1c2a-4512-9bde-a017abf22513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:34.806562 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac619267-1c2a-4512-9bde-a017abf22513 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:34.807276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac619267-1c2a-4512-9bde-a017abf22513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:34.809277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac619267-1c2a-4512-9bde-a017abf22513 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:34.851550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 894/1754] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:34 2022] POST /identity/v3/users => generated 297 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:34.854033 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde2229-0016-4b8a-aa76-a4c660834a7e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:34.854608 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde2229-0016-4b8a-aa76-a4c660834a7e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:34.863934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde2229-0016-4b8a-aa76-a4c660834a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:34.909038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6bde2229-0016-4b8a-aa76-a4c660834a7e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:34.911176 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6bde2229-0016-4b8a-aa76-a4c660834a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:34.944654 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 895/1755] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:34.945546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde2229-0016-4b8a-aa76-a4c660834a7e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:34.948794 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6bde2229-0016-4b8a-aa76-a4c660834a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:34.974058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde2229-0016-4b8a-aa76-a4c660834a7e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:34.987683 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68be0d-0c85-41d7-99fd-0e97746c205e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:34.988599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68be0d-0c85-41d7-99fd-0e97746c205e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:34.988888 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68be0d-0c85-41d7-99fd-0e97746c205e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:34.989170 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68be0d-0c85-41d7-99fd-0e97746c205e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:34.990346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68be0d-0c85-41d7-99fd-0e97746c205e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:34.991562 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68be0d-0c85-41d7-99fd-0e97746c205e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:34.994488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:35.016971 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 896/1756] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:35.018406 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370eb72-27f8-4f89-93b8-c844475e1819 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:35.028162 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370eb72-27f8-4f89-93b8-c844475e1819 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:35.028492 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370eb72-27f8-4f89-93b8-c844475e1819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:35.063000 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 861/1757] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Sep 9 20:56:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 511 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:35.064269 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333393e-87f5-4bc9-8227-549f01aff6af None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:35.080825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c370eb72-27f8-4f89-93b8-c844475e1819 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:35.082712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c370eb72-27f8-4f89-93b8-c844475e1819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:35.113030 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333393e-87f5-4bc9-8227-549f01aff6af None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:35.121534 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 897/1758] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:35.122244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370eb72-27f8-4f89-93b8-c844475e1819 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:35.130947 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c370eb72-27f8-4f89-93b8-c844475e1819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:35.135099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e4645-103e-434a-a5ce-e034cf5e96ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:35.136324 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e4645-103e-434a-a5ce-e034cf5e96ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:35.143496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e4645-103e-434a-a5ce-e034cf5e96ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:35.143901 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e4645-103e-434a-a5ce-e034cf5e96ca admin admin] PATH_INFO: `/v3/projects/1b3ef79e19ad40078ae5a2ef723ef789/users/7fda1aa40a794facab1c89190dcb8232/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:35.166773 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370eb72-27f8-4f89-93b8-c844475e1819 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:35.191863 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c7a94-f519-45f4-8c5e-07d384a1f7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:35.192585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e4645-103e-434a-a5ce-e034cf5e96ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b3ef79e19ad40078ae5a2ef723ef789, user_id=7fda1aa40a794facab1c89190dcb8232, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:35.193395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c7a94-f519-45f4-8c5e-07d384a1f7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:35.193395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c7a94-f519-45f4-8c5e-07d384a1f7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:35.193395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c7a94-f519-45f4-8c5e-07d384a1f7b5 admin admin] PATH_INFO: `/v3/projects/aefc616bbe7d46f2bd11121efde23aa9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:35.199835 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e4645-103e-434a-a5ce-e034cf5e96ca admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:35.200940 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c7a94-f519-45f4-8c5e-07d384a1f7b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aefc616bbe7d46f2bd11121efde23aa9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:35.203121 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c7a94-f519-45f4-8c5e-07d384a1f7b5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:35.232330 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 862/1759] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:35 2022] PUT /identity/v3/projects/1b3ef79e19ad40078ae5a2ef723ef789/users/7fda1aa40a794facab1c89190dcb8232/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:35.235444 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e4645-103e-434a-a5ce-e034cf5e96ca admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:35.333989 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ff4c7a94-f519-45f4-8c5e-07d384a1f7b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aefc616bbe7d46f2bd11121efde23aa9', 'request_id': 'req-ff4c7a94-f519-45f4-8c5e-07d384a1f7b5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:35.352590 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ff4c7a94-f519-45f4-8c5e-07d384a1f7b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aefc616bbe7d46f2bd11121efde23aa9', 'request_id': 'req-ff4c7a94-f519-45f4-8c5e-07d384a1f7b5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:35.362006 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ff4c7a94-f519-45f4-8c5e-07d384a1f7b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aefc616bbe7d46f2bd11121efde23aa9', 'request_id': 'req-ff4c7a94-f519-45f4-8c5e-07d384a1f7b5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:35.401624 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ff4c7a94-f519-45f4-8c5e-07d384a1f7b5 admin admin] The token cache is being invalidate because project aefc616bbe7d46f2bd11121efde23aa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:35.401927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ff4c7a94-f519-45f4-8c5e-07d384a1f7b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:35.403060 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ff4c7a94-f519-45f4-8c5e-07d384a1f7b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:35.405700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 898/1760] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:35 2022] DELETE /identity/v3/projects/aefc616bbe7d46f2bd11121efde23aa9 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:35.406293 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c7a94-f519-45f4-8c5e-07d384a1f7b5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:35.413758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ff4c7a94-f519-45f4-8c5e-07d384a1f7b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:35.499809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e4645-103e-434a-a5ce-e034cf5e96ca admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:35.587688 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:35.704423 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c7a94-f519-45f4-8c5e-07d384a1f7b5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:35.714104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f83d4-35ac-4881-9d5c-c6be32c12db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:35.715703 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f83d4-35ac-4881-9d5c-c6be32c12db2 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:35.716253 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f83d4-35ac-4881-9d5c-c6be32c12db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:35.716741 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f83d4-35ac-4881-9d5c-c6be32c12db2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:35.717923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f83d4-35ac-4881-9d5c-c6be32c12db2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:56:35.718455 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f83d4-35ac-4881-9d5c-c6be32c12db2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:35.722018 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f83d4-35ac-4881-9d5c-c6be32c12db2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:35.737244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2b849-4a6c-44c3-850d-62aa2a4af438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:35.737945 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2b849-4a6c-44c3-850d-62aa2a4af438 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:35.738213 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2b849-4a6c-44c3-850d-62aa2a4af438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:35.738633 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da2b849-4a6c-44c3-850d-62aa2a4af438 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:35.739610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2b849-4a6c-44c3-850d-62aa2a4af438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:35.741276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da2b849-4a6c-44c3-850d-62aa2a4af438 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:35.767493 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 863/1761] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 534 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:56:35.774938 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f83d4-35ac-4881-9d5c-c6be32c12db2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:35.784571 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ae2f83d4-35ac-4881-9d5c-c6be32c12db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:35.785584 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 899/1762] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:35.789192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2b849-4a6c-44c3-850d-62aa2a4af438 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:35.807960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8da2b849-4a6c-44c3-850d-62aa2a4af438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:35.871797 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f83d4-35ac-4881-9d5c-c6be32c12db2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:35.901589 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a773e7-5868-4c9a-9c99-9671477cb8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:35.902392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a773e7-5868-4c9a-9c99-9671477cb8d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:35.905692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a773e7-5868-4c9a-9c99-9671477cb8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:35.906148 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a773e7-5868-4c9a-9c99-9671477cb8d7 admin admin] PATH_INFO: `/v3/users/8d0a232e9e28433a8e091ac7319ce641` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:35.911827 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a773e7-5868-4c9a-9c99-9671477cb8d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d0a232e9e28433a8e091ac7319ce641)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:35.911827 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a773e7-5868-4c9a-9c99-9671477cb8d7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:36.049159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-98a773e7-5868-4c9a-9c99-9671477cb8d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d0a232e9e28433a8e091ac7319ce641'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:36.053413 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da2b849-4a6c-44c3-850d-62aa2a4af438 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:36.068447 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-98a773e7-5868-4c9a-9c99-9671477cb8d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d0a232e9e28433a8e091ac7319ce641'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:36.069146 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6e2a1-1652-4079-b43d-40d8e2251555 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:36.069921 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6e2a1-1652-4079-b43d-40d8e2251555 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:36.071160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-98a773e7-5868-4c9a-9c99-9671477cb8d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d0a232e9e28433a8e091ac7319ce641'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:36.071613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6e2a1-1652-4079-b43d-40d8e2251555 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:36.072048 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6e2a1-1652-4079-b43d-40d8e2251555 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:36.072794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-98a773e7-5868-4c9a-9c99-9671477cb8d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d0a232e9e28433a8e091ac7319ce641'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:36.091731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-63e6e2a1-1652-4079-b43d-40d8e2251555 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:36.108896 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-98a773e7-5868-4c9a-9c99-9671477cb8d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d0a232e9e28433a8e091ac7319ce641'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:36.143204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:36.151761 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 864/1763] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:35 2022] DELETE /identity/v3/users/8d0a232e9e28433a8e091ac7319ce641 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:36.152477 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a773e7-5868-4c9a-9c99-9671477cb8d7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:36.156843 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-98a773e7-5868-4c9a-9c99-9671477cb8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:36.161854 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6e2a1-1652-4079-b43d-40d8e2251555 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:36.163945 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6e2a1-1652-4079-b43d-40d8e2251555 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:36.203469 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 900/1764] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:36.210338 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6e2a1-1652-4079-b43d-40d8e2251555 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:36.215710 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-63e6e2a1-1652-4079-b43d-40d8e2251555 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:36.272225 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6e2a1-1652-4079-b43d-40d8e2251555 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:36.413286 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a773e7-5868-4c9a-9c99-9671477cb8d7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:36.444005 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26caee0f-199e-4877-946b-cffa87edf6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:36.446895 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caee0f-199e-4877-946b-cffa87edf6b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:36.447201 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caee0f-199e-4877-946b-cffa87edf6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:36.447486 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caee0f-199e-4877-946b-cffa87edf6b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:36.450392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26caee0f-199e-4877-946b-cffa87edf6b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:36.453890 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26caee0f-199e-4877-946b-cffa87edf6b3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:36.463579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c623d34-1431-406a-8fde-d1368bb7adda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:36.464822 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c623d34-1431-406a-8fde-d1368bb7adda admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:36.465249 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c623d34-1431-406a-8fde-d1368bb7adda admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:36.465668 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c623d34-1431-406a-8fde-d1368bb7adda admin admin] PATH_INFO: `/v3/projects/1b3ef79e19ad40078ae5a2ef723ef789/users/7fda1aa40a794facab1c89190dcb8232/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:36.473014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c623d34-1431-406a-8fde-d1368bb7adda admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b3ef79e19ad40078ae5a2ef723ef789, user_id=7fda1aa40a794facab1c89190dcb8232, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:36.476998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c623d34-1431-406a-8fde-d1368bb7adda admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:36.512481 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 901/1765] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:36 2022] PUT /identity/v3/projects/1b3ef79e19ad40078ae5a2ef723ef789/users/7fda1aa40a794facab1c89190dcb8232/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:36.516417 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621993a7-64f8-4dbe-b2fe-5737f2bad96a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:36.516715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621993a7-64f8-4dbe-b2fe-5737f2bad96a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:36.517061 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621993a7-64f8-4dbe-b2fe-5737f2bad96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:36.529184 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 865/1766] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:36 2022] POST /identity/v3/projects => generated 387 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:36.534768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26caee0f-199e-4877-946b-cffa87edf6b3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:36.560259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-621993a7-64f8-4dbe-b2fe-5737f2bad96a None None] MFA Rules not processed for user `7fda1aa40a794facab1c89190dcb8232`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:36.561983 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-621993a7-64f8-4dbe-b2fe-5737f2bad96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:36.577113 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:36.633648 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26caee0f-199e-4877-946b-cffa87edf6b3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:36.639975 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a787f-8858-413e-a625-c1405b6bd4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:36.641034 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a787f-8858-413e-a625-c1405b6bd4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:36.641540 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a787f-8858-413e-a625-c1405b6bd4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:36.642064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a787f-8858-413e-a625-c1405b6bd4a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:36.643345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a787f-8858-413e-a625-c1405b6bd4a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:36.646464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a787f-8858-413e-a625-c1405b6bd4a1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:36.685652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 866/1767] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:36 2022] POST /identity/v3/users => generated 294 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:36.692371 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a787f-8858-413e-a625-c1405b6bd4a1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:36.707581 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a787f-8858-413e-a625-c1405b6bd4a1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:36.715077 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889ba4c-5d46-47d1-a60a-782cd9347c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:36.717321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889ba4c-5d46-47d1-a60a-782cd9347c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:36.717955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889ba4c-5d46-47d1-a60a-782cd9347c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:36.718603 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889ba4c-5d46-47d1-a60a-782cd9347c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:36.719672 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889ba4c-5d46-47d1-a60a-782cd9347c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:36.722110 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889ba4c-5d46-47d1-a60a-782cd9347c0a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:36.749426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 867/1768] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:36.758603 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 902/1769] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:36.773301 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621993a7-64f8-4dbe-b2fe-5737f2bad96a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:36.779434 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889ba4c-5d46-47d1-a60a-782cd9347c0a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:36.784855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-621993a7-64f8-4dbe-b2fe-5737f2bad96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:36.794830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889ba4c-5d46-47d1-a60a-782cd9347c0a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:36.800376 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529fc1c-6897-4415-9793-e369fb687f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:36.801581 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529fc1c-6897-4415-9793-e369fb687f13 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:36.802043 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529fc1c-6897-4415-9793-e369fb687f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:36.802463 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529fc1c-6897-4415-9793-e369fb687f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:36.803266 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529fc1c-6897-4415-9793-e369fb687f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:36.805092 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529fc1c-6897-4415-9793-e369fb687f13 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:36.828447 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 868/1770] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:56:36.829598 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529fc1c-6897-4415-9793-e369fb687f13 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:36.851555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529fc1c-6897-4415-9793-e369fb687f13 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:36.859390 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e297f-95fd-4368-bf74-65505893abf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:36.860128 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e297f-95fd-4368-bf74-65505893abf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:36.860460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e297f-95fd-4368-bf74-65505893abf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:36.860900 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e297f-95fd-4368-bf74-65505893abf7 admin admin] PATH_INFO: `/v3/projects/6876b47c37a044659a95d31dd6b5fc66/users/f242175c0a514600a10cb77313d2a7cc/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:36.893462 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e297f-95fd-4368-bf74-65505893abf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6876b47c37a044659a95d31dd6b5fc66, user_id=f242175c0a514600a10cb77313d2a7cc, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:36.897430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e297f-95fd-4368-bf74-65505893abf7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:36.924485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 869/1771] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:36 2022] PUT /identity/v3/projects/6876b47c37a044659a95d31dd6b5fc66/users/f242175c0a514600a10cb77313d2a7cc/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:36.942950 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533b972-06e7-4164-9b2d-32e4e2005ad0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:36.943551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533b972-06e7-4164-9b2d-32e4e2005ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:36.945232 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533b972-06e7-4164-9b2d-32e4e2005ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:36.986026 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b533b972-06e7-4164-9b2d-32e4e2005ad0 None None] MFA Rules not processed for user `f242175c0a514600a10cb77313d2a7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:36.988867 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b533b972-06e7-4164-9b2d-32e4e2005ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:36.998676 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621993a7-64f8-4dbe-b2fe-5737f2bad96a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:37.121601 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:37.182884 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 870/1772] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:37.187627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533b972-06e7-4164-9b2d-32e4e2005ad0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:37.229439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4ba1e-d48c-48f8-9f09-ff9ea9ac2af8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:37.230083 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4ba1e-d48c-48f8-9f09-ff9ea9ac2af8 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:37.230362 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4ba1e-d48c-48f8-9f09-ff9ea9ac2af8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:37.230639 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4ba1e-d48c-48f8-9f09-ff9ea9ac2af8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:37.355892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:37.372778 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533b972-06e7-4164-9b2d-32e4e2005ad0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:37.391823 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529be86-b3e8-4a27-8301-496a15f51251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:37.392615 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529be86-b3e8-4a27-8301-496a15f51251 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:37.393019 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529be86-b3e8-4a27-8301-496a15f51251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:37.393646 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529be86-b3e8-4a27-8301-496a15f51251 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:37.394557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529be86-b3e8-4a27-8301-496a15f51251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:37.396820 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529be86-b3e8-4a27-8301-496a15f51251 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:37.469776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 871/1773] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:37 2022] POST /identity/v3/projects => generated 385 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:37.470688 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529be86-b3e8-4a27-8301-496a15f51251 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:37.531940 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4ba1e-d48c-48f8-9f09-ff9ea9ac2af8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:37.533688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4ba1e-d48c-48f8-9f09-ff9ea9ac2af8 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:37.555748 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 903/1774] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 783 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:37.630685 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529be86-b3e8-4a27-8301-496a15f51251 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:37.661797 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7272a-cd1b-488f-83be-30c8be7d99a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:37.664917 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7272a-cd1b-488f-83be-30c8be7d99a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:37.665204 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7272a-cd1b-488f-83be-30c8be7d99a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:37.665629 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7272a-cd1b-488f-83be-30c8be7d99a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:37.666299 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7272a-cd1b-488f-83be-30c8be7d99a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:37.682373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7272a-cd1b-488f-83be-30c8be7d99a0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:37.730712 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 872/1775] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:37 2022] POST /identity/v3/users => generated 299 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:37.734662 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4ba1e-d48c-48f8-9f09-ff9ea9ac2af8 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:37.754858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4ba1e-d48c-48f8-9f09-ff9ea9ac2af8 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:37.767108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090ca00-c1ea-4090-a5f2-8c63a00726e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:37.768150 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090ca00-c1ea-4090-a5f2-8c63a00726e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:37.770597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090ca00-c1ea-4090-a5f2-8c63a00726e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:37.772339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090ca00-c1ea-4090-a5f2-8c63a00726e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:37.773364 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090ca00-c1ea-4090-a5f2-8c63a00726e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:37.795695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090ca00-c1ea-4090-a5f2-8c63a00726e0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:37.829020 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 904/1776] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:37.834361 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7272a-cd1b-488f-83be-30c8be7d99a0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:37.852395 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7272a-cd1b-488f-83be-30c8be7d99a0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:37.867443 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8bca3-42a5-4df7-b391-f41c1d1a441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:37.868546 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8bca3-42a5-4df7-b391-f41c1d1a441e admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:37.870357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8bca3-42a5-4df7-b391-f41c1d1a441e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:37.870868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8bca3-42a5-4df7-b391-f41c1d1a441e admin admin] PATH_INFO: `/v3/projects/e0f79e007e97443cb6365e96f3dea7b1/users/38a6c735c8f141e09a85daee5b3c892c/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:37.931576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8bca3-42a5-4df7-b391-f41c1d1a441e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f79e007e97443cb6365e96f3dea7b1, user_id=38a6c735c8f141e09a85daee5b3c892c, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:37.937110 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8bca3-42a5-4df7-b391-f41c1d1a441e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:37.983926 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 873/1777] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:37 2022] PUT /identity/v3/projects/e0f79e007e97443cb6365e96f3dea7b1/users/38a6c735c8f141e09a85daee5b3c892c/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:37.988236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090ca00-c1ea-4090-a5f2-8c63a00726e0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:38.002476 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090ca00-c1ea-4090-a5f2-8c63a00726e0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:38.196509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a862d607-1885-4d54-9744-38308632bad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:38.198633 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862d607-1885-4d54-9744-38308632bad4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:38.199015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862d607-1885-4d54-9744-38308632bad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:38.200363 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a862d607-1885-4d54-9744-38308632bad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:38.202539 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862d607-1885-4d54-9744-38308632bad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:38.206527 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a862d607-1885-4d54-9744-38308632bad4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:38.242547 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 905/1778] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:38.244469 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8bca3-42a5-4df7-b391-f41c1d1a441e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:38.261011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8bca3-42a5-4df7-b391-f41c1d1a441e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:38.276207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305a41c-4a96-48d3-bc1b-942800992c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:38.277059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305a41c-4a96-48d3-bc1b-942800992c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:38.277443 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305a41c-4a96-48d3-bc1b-942800992c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:38.277790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2305a41c-4a96-48d3-bc1b-942800992c8a admin admin] PATH_INFO: `/v3/projects/e0f79e007e97443cb6365e96f3dea7b1/users/38a6c735c8f141e09a85daee5b3c892c/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:38.284707 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305a41c-4a96-48d3-bc1b-942800992c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f79e007e97443cb6365e96f3dea7b1, user_id=38a6c735c8f141e09a85daee5b3c892c, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:38.295276 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2305a41c-4a96-48d3-bc1b-942800992c8a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:38.328602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 874/1779] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:38 2022] PUT /identity/v3/projects/e0f79e007e97443cb6365e96f3dea7b1/users/38a6c735c8f141e09a85daee5b3c892c/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:38.341889 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8000932-8eb1-4209-b9c2-5400f859f1b1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:38.342292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8000932-8eb1-4209-b9c2-5400f859f1b1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:38.342678 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8000932-8eb1-4209-b9c2-5400f859f1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:38.372471 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305a41c-4a96-48d3-bc1b-942800992c8a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:38.445400 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e8000932-8eb1-4209-b9c2-5400f859f1b1 None None] MFA Rules not processed for user `38a6c735c8f141e09a85daee5b3c892c`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:38.447092 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e8000932-8eb1-4209-b9c2-5400f859f1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:38.572809 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:38.573724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2305a41c-4a96-48d3-bc1b-942800992c8a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:38.595734 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04931cf8-5dc5-434e-a7f6-643f52288b1d tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fda1aa40a794facab1c89190dcb8232', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b3ef79e19ad40078ae5a2ef723ef789', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:38.596431 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04931cf8-5dc5-434e-a7f6-643f52288b1d tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:38.596764 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04931cf8-5dc5-434e-a7f6-643f52288b1d tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:38.597086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04931cf8-5dc5-434e-a7f6-643f52288b1d tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:38.600447 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04931cf8-5dc5-434e-a7f6-643f52288b1d tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:56:38.600971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04931cf8-5dc5-434e-a7f6-643f52288b1d tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:38.604746 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04931cf8-5dc5-434e-a7f6-643f52288b1d tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:38.625264 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 875/1780] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:56:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:56:38.627031 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04931cf8-5dc5-434e-a7f6-643f52288b1d tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:38.633465 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 906/1781] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:56:38.634531 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-04931cf8-5dc5-434e-a7f6-643f52288b1d tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:38.634897 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8000932-8eb1-4209-b9c2-5400f859f1b1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:38.636557 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e8000932-8eb1-4209-b9c2-5400f859f1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:38.695775 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:38.758034 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8000932-8eb1-4209-b9c2-5400f859f1b1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:38.758266 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04931cf8-5dc5-434e-a7f6-643f52288b1d tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:38.765584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c00be7-fe75-4ef6-8b7c-aa9cb4a81697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:38.766615 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c00be7-fe75-4ef6-8b7c-aa9cb4a81697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:38.766928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c00be7-fe75-4ef6-8b7c-aa9cb4a81697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:38.767298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c00be7-fe75-4ef6-8b7c-aa9cb4a81697 admin admin] PATH_INFO: `/v3/users/289df238f48f4795bb44bde2c1cdaa18` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:38.768592 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c00be7-fe75-4ef6-8b7c-aa9cb4a81697 admin admin] RBAC: Authorizing `identity:delete_user(user_id=289df238f48f4795bb44bde2c1cdaa18)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:38.771841 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c00be7-fe75-4ef6-8b7c-aa9cb4a81697 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:38.773248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850ba6b-a2ac-4aa7-818b-33021f264fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:38.774213 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850ba6b-a2ac-4aa7-818b-33021f264fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:38.775119 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850ba6b-a2ac-4aa7-818b-33021f264fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:38.775408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850ba6b-a2ac-4aa7-818b-33021f264fdb admin admin] PATH_INFO: `/v3/projects/60d62b23b1734df7aa3ca25ce712476d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:38.780634 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850ba6b-a2ac-4aa7-818b-33021f264fdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d62b23b1734df7aa3ca25ce712476d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:38.792380 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850ba6b-a2ac-4aa7-818b-33021f264fdb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:38.887830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d9c00be7-fe75-4ef6-8b7c-aa9cb4a81697 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '289df238f48f4795bb44bde2c1cdaa18'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:38.893173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3850ba6b-a2ac-4aa7-818b-33021f264fdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d62b23b1734df7aa3ca25ce712476d', 'request_id': 'req-3850ba6b-a2ac-4aa7-818b-33021f264fdb'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:38.901688 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d9c00be7-fe75-4ef6-8b7c-aa9cb4a81697 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '289df238f48f4795bb44bde2c1cdaa18'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:38.902565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d9c00be7-fe75-4ef6-8b7c-aa9cb4a81697 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '289df238f48f4795bb44bde2c1cdaa18'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:38.903325 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d9c00be7-fe75-4ef6-8b7c-aa9cb4a81697 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '289df238f48f4795bb44bde2c1cdaa18'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:38.907804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3850ba6b-a2ac-4aa7-818b-33021f264fdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d62b23b1734df7aa3ca25ce712476d', 'request_id': 'req-3850ba6b-a2ac-4aa7-818b-33021f264fdb'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:38.915372 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d9c00be7-fe75-4ef6-8b7c-aa9cb4a81697 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '289df238f48f4795bb44bde2c1cdaa18'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:38.919396 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3850ba6b-a2ac-4aa7-818b-33021f264fdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d62b23b1734df7aa3ca25ce712476d', 'request_id': 'req-3850ba6b-a2ac-4aa7-818b-33021f264fdb'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:38.939781 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3850ba6b-a2ac-4aa7-818b-33021f264fdb admin admin] The token cache is being invalidate because project 60d62b23b1734df7aa3ca25ce712476d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:38.940504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3850ba6b-a2ac-4aa7-818b-33021f264fdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:38.941708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3850ba6b-a2ac-4aa7-818b-33021f264fdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:38.943699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 876/1782] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:38 2022] DELETE /identity/v3/users/289df238f48f4795bb44bde2c1cdaa18 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:38.943835 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 907/1783] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:38 2022] DELETE /identity/v3/projects/60d62b23b1734df7aa3ca25ce712476d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:38.944880 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c00be7-fe75-4ef6-8b7c-aa9cb4a81697 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:38.948285 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850ba6b-a2ac-4aa7-818b-33021f264fdb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:38.949228 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d9c00be7-fe75-4ef6-8b7c-aa9cb4a81697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:38.949899 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3850ba6b-a2ac-4aa7-818b-33021f264fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:39.025610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850ba6b-a2ac-4aa7-818b-33021f264fdb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:39.063891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c00be7-fe75-4ef6-8b7c-aa9cb4a81697 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:39.068615 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:39.072159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafd431-2042-4920-9391-c078135b8f98 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fda1aa40a794facab1c89190dcb8232', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b3ef79e19ad40078ae5a2ef723ef789', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:39.073220 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafd431-2042-4920-9391-c078135b8f98 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:39.073928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafd431-2042-4920-9391-c078135b8f98 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:39.074474 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafd431-2042-4920-9391-c078135b8f98 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:39.075419 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafd431-2042-4920-9391-c078135b8f98 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:39.080321 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafd431-2042-4920-9391-c078135b8f98 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:39.089668 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e983de8-3d61-4712-a9db-e3c439df61e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:39.090420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e983de8-3d61-4712-a9db-e3c439df61e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:39.090910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e983de8-3d61-4712-a9db-e3c439df61e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:39.091341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e983de8-3d61-4712-a9db-e3c439df61e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:39.093984 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3e983de8-3d61-4712-a9db-e3c439df61e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:39.146082 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 877/1784] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:38 2022] POST /identity/v3/projects => generated 355 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:39.147860 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764d60d-672c-415d-be4e-dce9009f088f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:39.148283 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764d60d-672c-415d-be4e-dce9009f088f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:39.148488 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764d60d-672c-415d-be4e-dce9009f088f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:39.182496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c764d60d-672c-415d-be4e-dce9009f088f None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:39.183679 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c764d60d-672c-415d-be4e-dce9009f088f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:39.205919 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e983de8-3d61-4712-a9db-e3c439df61e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:39.208455 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e983de8-3d61-4712-a9db-e3c439df61e2 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:39.218306 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:39.226073 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 908/1785] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:39.230070 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086aa15-79ca-4b84-b352-93ce7077ac92 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:39.230529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086aa15-79ca-4b84-b352-93ce7077ac92 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:39.230960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086aa15-79ca-4b84-b352-93ce7077ac92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:39.258550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0086aa15-79ca-4b84-b352-93ce7077ac92 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:39.267968 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0086aa15-79ca-4b84-b352-93ce7077ac92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:39.299537 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 878/1786] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:39.301262 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764d60d-672c-415d-be4e-dce9009f088f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:39.303304 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c764d60d-672c-415d-be4e-dce9009f088f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:39.412162 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 909/1787] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:39.412162 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086aa15-79ca-4b84-b352-93ce7077ac92 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:39.415831 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0086aa15-79ca-4b84-b352-93ce7077ac92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:39.435452 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764d60d-672c-415d-be4e-dce9009f088f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:39.437514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086aa15-79ca-4b84-b352-93ce7077ac92 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:39.442335 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba67377-efc8-4bb8-9d58-2d7ff541bcc3 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fda1aa40a794facab1c89190dcb8232', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b3ef79e19ad40078ae5a2ef723ef789', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:39.443536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba67377-efc8-4bb8-9d58-2d7ff541bcc3 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:39.443536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba67377-efc8-4bb8-9d58-2d7ff541bcc3 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:39.443843 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba67377-efc8-4bb8-9d58-2d7ff541bcc3 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:39.444626 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba67377-efc8-4bb8-9d58-2d7ff541bcc3 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:56:39.445010 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba67377-efc8-4bb8-9d58-2d7ff541bcc3 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:39.446296 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7a307-8b25-4d6b-805a-2b8fcd3a988d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:39.447030 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba67377-efc8-4bb8-9d58-2d7ff541bcc3 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:39.447430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7a307-8b25-4d6b-805a-2b8fcd3a988d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:39.447844 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7a307-8b25-4d6b-805a-2b8fcd3a988d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:39.448499 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7a307-8b25-4d6b-805a-2b8fcd3a988d admin admin] PATH_INFO: `/v3/users/f242175c0a514600a10cb77313d2a7cc` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:39.450884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7a307-8b25-4d6b-805a-2b8fcd3a988d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f242175c0a514600a10cb77313d2a7cc)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:39.455177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7a307-8b25-4d6b-805a-2b8fcd3a988d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:39.464068 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 879/1788] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:56:39.464880 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba67377-efc8-4bb8-9d58-2d7ff541bcc3 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:39.467305 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0ba67377-efc8-4bb8-9d58-2d7ff541bcc3 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:39.531972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b1a7a307-8b25-4d6b-805a-2b8fcd3a988d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f242175c0a514600a10cb77313d2a7cc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:39.539104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba67377-efc8-4bb8-9d58-2d7ff541bcc3 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:39.544370 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b1a7a307-8b25-4d6b-805a-2b8fcd3a988d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f242175c0a514600a10cb77313d2a7cc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:39.556373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c73f92-481e-4c78-8e7c-1538fbbeec65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:39.557384 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c73f92-481e-4c78-8e7c-1538fbbeec65 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:39.557676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c73f92-481e-4c78-8e7c-1538fbbeec65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:39.558111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c73f92-481e-4c78-8e7c-1538fbbeec65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:39.563008 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b1a7a307-8b25-4d6b-805a-2b8fcd3a988d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f242175c0a514600a10cb77313d2a7cc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:39.563756 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b1a7a307-8b25-4d6b-805a-2b8fcd3a988d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f242175c0a514600a10cb77313d2a7cc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:39.564536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b1a7a307-8b25-4d6b-805a-2b8fcd3a988d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f242175c0a514600a10cb77313d2a7cc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:39.570214 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c73f92-481e-4c78-8e7c-1538fbbeec65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:39.571958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c73f92-481e-4c78-8e7c-1538fbbeec65 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:39.574862 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:39.585587 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 910/1789] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:39 2022] DELETE /identity/v3/users/f242175c0a514600a10cb77313d2a7cc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:39.585792 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 880/1790] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:39.585792 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45a839-f314-4e34-a01e-35e89fd74606 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:39.585792 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45a839-f314-4e34-a01e-35e89fd74606 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:39.586358 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45a839-f314-4e34-a01e-35e89fd74606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:39.588752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec3e13-2352-4170-9631-5da8948b4f2f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:39.590050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec3e13-2352-4170-9631-5da8948b4f2f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:39.590576 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec3e13-2352-4170-9631-5da8948b4f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:39.609916 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-aa45a839-f314-4e34-a01e-35e89fd74606 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:39.610874 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-aa45a839-f314-4e34-a01e-35e89fd74606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:39.621229 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-89ec3e13-2352-4170-9631-5da8948b4f2f None None] MFA Rules not processed for user `9c758557426941babdaa68cbae43f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:39.622806 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-89ec3e13-2352-4170-9631-5da8948b4f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:39.682901 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 881/1791] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:39.686223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45a839-f314-4e34-a01e-35e89fd74606 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:39.686223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-aa45a839-f314-4e34-a01e-35e89fd74606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:39.705437 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:39.767626 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 911/1792] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:39.767626 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f261b63-2813-430e-a401-bce0c42ec582 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:39.767626 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f261b63-2813-430e-a401-bce0c42ec582 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:39.767626 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f261b63-2813-430e-a401-bce0c42ec582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:39.836877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45a839-f314-4e34-a01e-35e89fd74606 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:39.842516 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3ceac-bebe-4afc-9136-e75d05e16482 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fda1aa40a794facab1c89190dcb8232', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b3ef79e19ad40078ae5a2ef723ef789', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:39.843793 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3ceac-bebe-4afc-9136-e75d05e16482 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:39.845233 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3ceac-bebe-4afc-9136-e75d05e16482 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:39.845759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3ceac-bebe-4afc-9136-e75d05e16482 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] PATH_INFO: `/v3/projects/f4de75d32c464a3c9f54e052b58a3896` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:39.849346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7f261b63-2813-430e-a401-bce0c42ec582 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:39.850397 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3ceac-bebe-4afc-9136-e75d05e16482 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f4de75d32c464a3c9f54e052b58a3896)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:39.850646 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7f261b63-2813-430e-a401-bce0c42ec582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:39.853171 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d3ceac-bebe-4afc-9136-e75d05e16482 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:39.867398 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 912/1793] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:39.867398 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f261b63-2813-430e-a401-bce0c42ec582 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:39.883655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f261b63-2813-430e-a401-bce0c42ec582 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:39.892977 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b95b6e-f714-4a72-a438-1871307c3b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:39.893927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b95b6e-f714-4a72-a438-1871307c3b4a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:39.894269 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b95b6e-f714-4a72-a438-1871307c3b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:39.894709 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b95b6e-f714-4a72-a438-1871307c3b4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:39.895591 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b95b6e-f714-4a72-a438-1871307c3b4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:56:39.895903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b95b6e-f714-4a72-a438-1871307c3b4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:39.897924 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b95b6e-f714-4a72-a438-1871307c3b4a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:39.919946 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 913/1794] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:56:39.921374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b95b6e-f714-4a72-a438-1871307c3b4a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:39.925268 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-77b95b6e-f714-4a72-a438-1871307c3b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:39.952171 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-49d3ceac-bebe-4afc-9136-e75d05e16482 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4de75d32c464a3c9f54e052b58a3896', 'request_id': 'req-49d3ceac-bebe-4afc-9136-e75d05e16482'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:39.969925 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-49d3ceac-bebe-4afc-9136-e75d05e16482 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4de75d32c464a3c9f54e052b58a3896', 'request_id': 'req-49d3ceac-bebe-4afc-9136-e75d05e16482'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:39.980871 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-49d3ceac-bebe-4afc-9136-e75d05e16482 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4de75d32c464a3c9f54e052b58a3896', 'request_id': 'req-49d3ceac-bebe-4afc-9136-e75d05e16482'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:40.008804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-49d3ceac-bebe-4afc-9136-e75d05e16482 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] The token cache is being invalidate because project f4de75d32c464a3c9f54e052b58a3896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:40.009123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-49d3ceac-bebe-4afc-9136-e75d05e16482 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:40.011089 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-49d3ceac-bebe-4afc-9136-e75d05e16482 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:40.017175 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b95b6e-f714-4a72-a438-1871307c3b4a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:40.021495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 882/1795] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:39 2022] DELETE /identity/v3/projects/f4de75d32c464a3c9f54e052b58a3896 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:40.022441 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3ceac-bebe-4afc-9136-e75d05e16482 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:40.025641 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-49d3ceac-bebe-4afc-9136-e75d05e16482 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:40.135958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3ceac-bebe-4afc-9136-e75d05e16482 tempest-VolumeQuotaClassesTest-1429520874 tempest-VolumeQuotaClassesTest-1429520874-project-admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:40.150303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac45a3e-b886-40d6-9b5e-91356005c1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:40.152376 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac45a3e-b886-40d6-9b5e-91356005c1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:40.152670 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac45a3e-b886-40d6-9b5e-91356005c1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:40.154191 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac45a3e-b886-40d6-9b5e-91356005c1c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:40.155551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac45a3e-b886-40d6-9b5e-91356005c1c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:40.157760 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108602e-ec69-45e3-9209-1265164f3441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:40.160827 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108602e-ec69-45e3-9209-1265164f3441 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:40.161218 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108602e-ec69-45e3-9209-1265164f3441 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:40.161847 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac45a3e-b886-40d6-9b5e-91356005c1c7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:40.162767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108602e-ec69-45e3-9209-1265164f3441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:40.167680 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a108602e-ec69-45e3-9209-1265164f3441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:40.200573 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108602e-ec69-45e3-9209-1265164f3441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:40.205767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108602e-ec69-45e3-9209-1265164f3441 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:40.235298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 883/1796] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:40 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:40.235502 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 914/1797] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:40.237265 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac45a3e-b886-40d6-9b5e-91356005c1c7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:40.282289 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:40.370170 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac45a3e-b886-40d6-9b5e-91356005c1c7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:40.389155 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0e75f-49c4-4aa5-be40-09683bcd9b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:40.389799 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0e75f-49c4-4aa5-be40-09683bcd9b5f admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:40.390083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0e75f-49c4-4aa5-be40-09683bcd9b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:40.390357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf0e75f-49c4-4aa5-be40-09683bcd9b5f admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:40.391013 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0e75f-49c4-4aa5-be40-09683bcd9b5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:40.393045 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf0e75f-49c4-4aa5-be40-09683bcd9b5f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:40.402663 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108602e-ec69-45e3-9209-1265164f3441 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:40.403888 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a108602e-ec69-45e3-9209-1265164f3441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:40.427746 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108602e-ec69-45e3-9209-1265164f3441 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:40.436288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 884/1798] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:40 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:56:40.440185 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0e75f-49c4-4aa5-be40-09683bcd9b5f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:40.442053 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390d032-7169-4e16-9668-7ccc80e79e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:40.442854 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390d032-7169-4e16-9668-7ccc80e79e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:40.443143 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390d032-7169-4e16-9668-7ccc80e79e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:40.443426 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390d032-7169-4e16-9668-7ccc80e79e3b admin admin] PATH_INFO: `/v3/users/cb937ab5d3504cf9a813bb1ee0615b2b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:40.444702 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390d032-7169-4e16-9668-7ccc80e79e3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb937ab5d3504cf9a813bb1ee0615b2b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:40.447089 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390d032-7169-4e16-9668-7ccc80e79e3b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:40.458453 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf0e75f-49c4-4aa5-be40-09683bcd9b5f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:40.467399 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0af12a-14f2-4a7e-a0e9-9df0a87a81f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:40.468357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0af12a-14f2-4a7e-a0e9-9df0a87a81f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:40.468813 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0af12a-14f2-4a7e-a0e9-9df0a87a81f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:40.469519 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0af12a-14f2-4a7e-a0e9-9df0a87a81f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:40.471128 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0af12a-14f2-4a7e-a0e9-9df0a87a81f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:40.477567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0af12a-14f2-4a7e-a0e9-9df0a87a81f2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:40.491460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 885/1799] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:40.495907 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0af12a-14f2-4a7e-a0e9-9df0a87a81f2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:40.498796 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:40.513032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0af12a-14f2-4a7e-a0e9-9df0a87a81f2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:40.517662 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c390d032-7169-4e16-9668-7ccc80e79e3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb937ab5d3504cf9a813bb1ee0615b2b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:40.518617 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba00d3-e364-4886-ba67-563318d48f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:40.519685 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba00d3-e364-4886-ba67-563318d48f6d admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:40.520438 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba00d3-e364-4886-ba67-563318d48f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:40.520754 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba00d3-e364-4886-ba67-563318d48f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:40.521716 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba00d3-e364-4886-ba67-563318d48f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:40.523630 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba00d3-e364-4886-ba67-563318d48f6d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:40.529919 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c390d032-7169-4e16-9668-7ccc80e79e3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb937ab5d3504cf9a813bb1ee0615b2b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:40.542599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 886/1800] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:56:40.544644 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba00d3-e364-4886-ba67-563318d48f6d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:40.561402 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c390d032-7169-4e16-9668-7ccc80e79e3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb937ab5d3504cf9a813bb1ee0615b2b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:40.562432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c390d032-7169-4e16-9668-7ccc80e79e3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb937ab5d3504cf9a813bb1ee0615b2b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:40.563769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c390d032-7169-4e16-9668-7ccc80e79e3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb937ab5d3504cf9a813bb1ee0615b2b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:40.565322 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba00d3-e364-4886-ba67-563318d48f6d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:40.575184 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c284dd8-0be9-44a6-b428-5c8d03248459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:40.576005 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c284dd8-0be9-44a6-b428-5c8d03248459 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:40.576409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c284dd8-0be9-44a6-b428-5c8d03248459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:40.576941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c284dd8-0be9-44a6-b428-5c8d03248459 admin admin] PATH_INFO: `/v3/projects/7114b4fbaf1a4d048108a23720f4e4c7/users/a5bc663c0bb54528b561d6f857a19e83/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:40.588048 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 915/1801] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:40 2022] DELETE /identity/v3/users/cb937ab5d3504cf9a813bb1ee0615b2b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:40.592432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afaf81-7635-45c9-9f4e-175a13206f36 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:40.592834 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afaf81-7635-45c9-9f4e-175a13206f36 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:40.593224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afaf81-7635-45c9-9f4e-175a13206f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:40.604545 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c284dd8-0be9-44a6-b428-5c8d03248459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7114b4fbaf1a4d048108a23720f4e4c7, user_id=a5bc663c0bb54528b561d6f857a19e83, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:40.608224 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c284dd8-0be9-44a6-b428-5c8d03248459 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:40.639436 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d4afaf81-7635-45c9-9f4e-175a13206f36 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:40.640721 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d4afaf81-7635-45c9-9f4e-175a13206f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:40.660548 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 887/1802] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:40 2022] PUT /identity/v3/projects/7114b4fbaf1a4d048108a23720f4e4c7/users/a5bc663c0bb54528b561d6f857a19e83/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:40.689076 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124128d8-f355-42b9-a015-484cb194e1c7 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:40.689416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124128d8-f355-42b9-a015-484cb194e1c7 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:40.691970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124128d8-f355-42b9-a015-484cb194e1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:40.737840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-124128d8-f355-42b9-a015-484cb194e1c7 None None] MFA Rules not processed for user `a5bc663c0bb54528b561d6f857a19e83`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:40.739513 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-124128d8-f355-42b9-a015-484cb194e1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:40.763959 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 916/1803] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:40.801601 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afaf81-7635-45c9-9f4e-175a13206f36 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:40.805189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d4afaf81-7635-45c9-9f4e-175a13206f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:40.826633 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 888/1804] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:40.841347 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124128d8-f355-42b9-a015-484cb194e1c7 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:40.843438 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-124128d8-f355-42b9-a015-484cb194e1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:40.913897 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afaf81-7635-45c9-9f4e-175a13206f36 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:40.959218 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124128d8-f355-42b9-a015-484cb194e1c7 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:40.963920 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8b0c6-7b9d-4aed-918a-270a2814e54f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:40.964871 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8b0c6-7b9d-4aed-918a-270a2814e54f service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:40.965523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8b0c6-7b9d-4aed-918a-270a2814e54f service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:40.965915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8b0c6-7b9d-4aed-918a-270a2814e54f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:40.979564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8b0c6-7b9d-4aed-918a-270a2814e54f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:40.981825 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee8b0c6-7b9d-4aed-918a-270a2814e54f service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:40.987940 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:41.000364 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 889/1805] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 20:56:41.022485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e622168-eff4-4649-9126-65a1f8361ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:41.023519 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e622168-eff4-4649-9126-65a1f8361ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:41.023519 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e622168-eff4-4649-9126-65a1f8361ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:41.023847 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e622168-eff4-4649-9126-65a1f8361ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:41.058723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8b0c6-7b9d-4aed-918a-270a2814e54f service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:41.061101 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1ee8b0c6-7b9d-4aed-918a-270a2814e54f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:41.096140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:41.214798 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e622168-eff4-4649-9126-65a1f8361ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:41.218862 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e622168-eff4-4649-9126-65a1f8361ba4 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:41.236155 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee8b0c6-7b9d-4aed-918a-270a2814e54f service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:41.249837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80d33a-1740-4614-952c-dc1e1e279a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:41.250589 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80d33a-1740-4614-952c-dc1e1e279a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:41.250960 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80d33a-1740-4614-952c-dc1e1e279a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:41.251311 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80d33a-1740-4614-952c-dc1e1e279a6e admin admin] PATH_INFO: `/v3/projects/ff067e48191f44c7a3bb3522f00d20c9` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:41.251672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 917/1806] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:41.253338 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80d33a-1740-4614-952c-dc1e1e279a6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff067e48191f44c7a3bb3522f00d20c9)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:41.257756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc80d33a-1740-4614-952c-dc1e1e279a6e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:41.335645 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fc80d33a-1740-4614-952c-dc1e1e279a6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff067e48191f44c7a3bb3522f00d20c9', 'request_id': 'req-fc80d33a-1740-4614-952c-dc1e1e279a6e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:41.349352 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fc80d33a-1740-4614-952c-dc1e1e279a6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff067e48191f44c7a3bb3522f00d20c9', 'request_id': 'req-fc80d33a-1740-4614-952c-dc1e1e279a6e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:41.358579 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fc80d33a-1740-4614-952c-dc1e1e279a6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff067e48191f44c7a3bb3522f00d20c9', 'request_id': 'req-fc80d33a-1740-4614-952c-dc1e1e279a6e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:41.392391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fc80d33a-1740-4614-952c-dc1e1e279a6e admin admin] The token cache is being invalidate because project ff067e48191f44c7a3bb3522f00d20c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:41.392792 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fc80d33a-1740-4614-952c-dc1e1e279a6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:41.393564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fc80d33a-1740-4614-952c-dc1e1e279a6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:41.396611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 890/1807] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:41 2022] DELETE /identity/v3/projects/ff067e48191f44c7a3bb3522f00d20c9 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:41.401179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7258131-6f62-4bdb-a33b-4b10287a1580 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:41.401652 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7258131-6f62-4bdb-a33b-4b10287a1580 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:41.401926 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7258131-6f62-4bdb-a33b-4b10287a1580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:41.410903 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6b5b3-8fd6-4df4-aacc-ee27475db5c3 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:41.411286 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6b5b3-8fd6-4df4-aacc-ee27475db5c3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:41.411624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6b5b3-8fd6-4df4-aacc-ee27475db5c3 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:41.413237 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 891/1808] 10.222.0.15 () {54 vars in 921 bytes} [Fri Sep 9 20:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:56:41.457530 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e7258131-6f62-4bdb-a33b-4b10287a1580 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:41.458778 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e7258131-6f62-4bdb-a33b-4b10287a1580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:41.513258 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995868f-253d-4a88-92da-5aaf4851e9f5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:41.513846 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995868f-253d-4a88-92da-5aaf4851e9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:41.514343 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995868f-253d-4a88-92da-5aaf4851e9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:41.557214 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b995868f-253d-4a88-92da-5aaf4851e9f5 None None] MFA Rules not processed for user `dc210376e57a41e6b3812110db249099`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:41.558488 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b995868f-253d-4a88-92da-5aaf4851e9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:41.592618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 918/1809] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:41.601443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef3fe7-0e5f-4a40-af68-685431dfe2dc None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:41.602161 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef3fe7-0e5f-4a40-af68-685431dfe2dc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:41.603242 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef3fe7-0e5f-4a40-af68-685431dfe2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:41.657611 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-84ef3fe7-0e5f-4a40-af68-685431dfe2dc None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:41.662121 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-84ef3fe7-0e5f-4a40-af68-685431dfe2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:41.685258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 919/1810] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:41.688651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef3fe7-0e5f-4a40-af68-685431dfe2dc None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:41.699144 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef3fe7-0e5f-4a40-af68-685431dfe2dc None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:41.704574 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70d47-7d8d-4161-9ebc-2f23189cbb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:41.705192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70d47-7d8d-4161-9ebc-2f23189cbb41 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:41.705618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70d47-7d8d-4161-9ebc-2f23189cbb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:41.705902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70d47-7d8d-4161-9ebc-2f23189cbb41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:41.706763 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70d47-7d8d-4161-9ebc-2f23189cbb41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:56:41.707331 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70d47-7d8d-4161-9ebc-2f23189cbb41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:41.708974 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70d47-7d8d-4161-9ebc-2f23189cbb41 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:41.709424 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 892/1811] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Sep 9 20:56:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:56:41.722114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 920/1812] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:56:41.727288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995868f-253d-4a88-92da-5aaf4851e9f5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:41.739767 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995868f-253d-4a88-92da-5aaf4851e9f5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:41.745364 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4112cfa-db81-4dfa-aa85-b34feb2e6132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:41.746187 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4112cfa-db81-4dfa-aa85-b34feb2e6132 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:41.746506 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4112cfa-db81-4dfa-aa85-b34feb2e6132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:41.746875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4112cfa-db81-4dfa-aa85-b34feb2e6132 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:41.747537 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4112cfa-db81-4dfa-aa85-b34feb2e6132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:41.749509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4112cfa-db81-4dfa-aa85-b34feb2e6132 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:41.789965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:41.801250 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 893/1813] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:41 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:41.802820 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70d47-7d8d-4161-9ebc-2f23189cbb41 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:41.813800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70d47-7d8d-4161-9ebc-2f23189cbb41 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:41.909564 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6a5a2-a445-4d9c-98c5-8eac6f1d5bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:41.911069 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6a5a2-a445-4d9c-98c5-8eac6f1d5bef admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:41.911550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6a5a2-a445-4d9c-98c5-8eac6f1d5bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:41.911835 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6a5a2-a445-4d9c-98c5-8eac6f1d5bef admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:41.912534 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6a5a2-a445-4d9c-98c5-8eac6f1d5bef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:41.914544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6a5a2-a445-4d9c-98c5-8eac6f1d5bef admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:41.941515 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 921/1814] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:41 2022] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:41.945380 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4112cfa-db81-4dfa-aa85-b34feb2e6132 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:41.959811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4112cfa-db81-4dfa-aa85-b34feb2e6132 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:41.970620 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d0d50-c863-41e5-b4de-8c9ee235f5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:41.971462 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d0d50-c863-41e5-b4de-8c9ee235f5fe admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:41.971755 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d0d50-c863-41e5-b4de-8c9ee235f5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:41.972742 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d0d50-c863-41e5-b4de-8c9ee235f5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:41.973406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d0d50-c863-41e5-b4de-8c9ee235f5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:41.977160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d0d50-c863-41e5-b4de-8c9ee235f5fe admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:41.993381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6a5a2-a445-4d9c-98c5-8eac6f1d5bef admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:41.997706 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0be6a5a2-a445-4d9c-98c5-8eac6f1d5bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:42.020328 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 894/1815] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:42.039253 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d0d50-c863-41e5-b4de-8c9ee235f5fe admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:42.061878 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d0d50-c863-41e5-b4de-8c9ee235f5fe admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:42.082824 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483723ce-3a63-480e-989e-e27e5e1aaa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:42.083589 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483723ce-3a63-480e-989e-e27e5e1aaa2c admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:42.083876 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483723ce-3a63-480e-989e-e27e5e1aaa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:42.084188 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483723ce-3a63-480e-989e-e27e5e1aaa2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:42.084878 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483723ce-3a63-480e-989e-e27e5e1aaa2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:42.086389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:42.086516 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483723ce-3a63-480e-989e-e27e5e1aaa2c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:42.123694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 895/1816] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:56:42.128278 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483723ce-3a63-480e-989e-e27e5e1aaa2c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:42.162184 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483723ce-3a63-480e-989e-e27e5e1aaa2c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:42.164447 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6a5a2-a445-4d9c-98c5-8eac6f1d5bef admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:42.169370 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28332c31-873c-4ea0-97c9-f86862b66593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:42.170706 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28332c31-873c-4ea0-97c9-f86862b66593 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:42.171313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28332c31-873c-4ea0-97c9-f86862b66593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:42.172492 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28332c31-873c-4ea0-97c9-f86862b66593 admin admin] PATH_INFO: `/v3/projects/220bc1578a244b0fb138e0d995a7b4c6/users/ccae18a992e04710905cdd9a948a3b4a/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:42.174957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c658d3-13b7-42e4-a091-970e2f344889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:42.176529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c658d3-13b7-42e4-a091-970e2f344889 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:42.176979 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c658d3-13b7-42e4-a091-970e2f344889 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:42.177414 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c658d3-13b7-42e4-a091-970e2f344889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:42.190976 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c658d3-13b7-42e4-a091-970e2f344889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:42.193701 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c658d3-13b7-42e4-a091-970e2f344889 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:42.202899 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28332c31-873c-4ea0-97c9-f86862b66593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=220bc1578a244b0fb138e0d995a7b4c6, user_id=ccae18a992e04710905cdd9a948a3b4a, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:42.207860 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28332c31-873c-4ea0-97c9-f86862b66593 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:42.211353 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 922/1817] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:42.212600 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c658d3-13b7-42e4-a091-970e2f344889 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:42.214471 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-29c658d3-13b7-42e4-a091-970e2f344889 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:42.236908 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c658d3-13b7-42e4-a091-970e2f344889 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:42.249606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 896/1818] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:42 2022] PUT /identity/v3/projects/220bc1578a244b0fb138e0d995a7b4c6/users/ccae18a992e04710905cdd9a948a3b4a/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:42.265396 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a856248-e640-4457-a23e-77ac7e8197e5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:42.265984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a856248-e640-4457-a23e-77ac7e8197e5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:42.266937 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a856248-e640-4457-a23e-77ac7e8197e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:42.344361 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0a856248-e640-4457-a23e-77ac7e8197e5 None None] MFA Rules not processed for user `ccae18a992e04710905cdd9a948a3b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:42.345699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0a856248-e640-4457-a23e-77ac7e8197e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:42.355080 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea292cb-464d-4d5f-85d3-d1f133ed65aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:42.355815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea292cb-464d-4d5f-85d3-d1f133ed65aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:42.357751 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea292cb-464d-4d5f-85d3-d1f133ed65aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:42.358060 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea292cb-464d-4d5f-85d3-d1f133ed65aa admin admin] PATH_INFO: `/v3/projects/6876b47c37a044659a95d31dd6b5fc66` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:42.363066 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea292cb-464d-4d5f-85d3-d1f133ed65aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6876b47c37a044659a95d31dd6b5fc66)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:42.366367 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea292cb-464d-4d5f-85d3-d1f133ed65aa admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:42.456368 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8ea292cb-464d-4d5f-85d3-d1f133ed65aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6876b47c37a044659a95d31dd6b5fc66', 'request_id': 'req-8ea292cb-464d-4d5f-85d3-d1f133ed65aa'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:42.465016 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 897/1819] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:42.469765 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a856248-e640-4457-a23e-77ac7e8197e5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:42.486042 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a856248-e640-4457-a23e-77ac7e8197e5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:42.500746 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8ea292cb-464d-4d5f-85d3-d1f133ed65aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6876b47c37a044659a95d31dd6b5fc66', 'request_id': 'req-8ea292cb-464d-4d5f-85d3-d1f133ed65aa'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:42.552899 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8ea292cb-464d-4d5f-85d3-d1f133ed65aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6876b47c37a044659a95d31dd6b5fc66', 'request_id': 'req-8ea292cb-464d-4d5f-85d3-d1f133ed65aa'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:42.577345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8ea292cb-464d-4d5f-85d3-d1f133ed65aa admin admin] The token cache is being invalidate because project 6876b47c37a044659a95d31dd6b5fc66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:42.577982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8ea292cb-464d-4d5f-85d3-d1f133ed65aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:42.579037 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8ea292cb-464d-4d5f-85d3-d1f133ed65aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:42.581701 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 923/1820] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:42 2022] DELETE /identity/v3/projects/6876b47c37a044659a95d31dd6b5fc66 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:42.585740 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea292cb-464d-4d5f-85d3-d1f133ed65aa admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:42.588182 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8ea292cb-464d-4d5f-85d3-d1f133ed65aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:42.600794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda3b3a-b65a-4316-ad82-0f8840c5b615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:42.602902 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda3b3a-b65a-4316-ad82-0f8840c5b615 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:42.603538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda3b3a-b65a-4316-ad82-0f8840c5b615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:42.604741 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda3b3a-b65a-4316-ad82-0f8840c5b615 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:42.606617 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda3b3a-b65a-4316-ad82-0f8840c5b615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:42.617333 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fda3b3a-b65a-4316-ad82-0f8840c5b615 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:42.678626 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 898/1821] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:42 2022] POST /identity/v3/projects => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:42.687640 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda3b3a-b65a-4316-ad82-0f8840c5b615 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:42.692042 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4fda3b3a-b65a-4316-ad82-0f8840c5b615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:42.709106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:42.739061 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea292cb-464d-4d5f-85d3-d1f133ed65aa admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:42.756519 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:42.822784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fda3b3a-b65a-4316-ad82-0f8840c5b615 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:42.848752 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb3fe1-527c-4e45-9836-50d0b07c9590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:42.852787 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb3fe1-527c-4e45-9836-50d0b07c9590 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:42.854231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb3fe1-527c-4e45-9836-50d0b07c9590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:42.854528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb3fe1-527c-4e45-9836-50d0b07c9590 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:42.858484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb3fe1-527c-4e45-9836-50d0b07c9590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:42.865733 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb3fe1-527c-4e45-9836-50d0b07c9590 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:42.872510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747abad-0c77-4db8-aae3-9137f9beeaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:42.874029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747abad-0c77-4db8-aae3-9137f9beeaa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:42.874574 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747abad-0c77-4db8-aae3-9137f9beeaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:42.875010 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747abad-0c77-4db8-aae3-9137f9beeaa3 admin admin] PATH_INFO: `/v3/users/38a6c735c8f141e09a85daee5b3c892c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:42.877700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747abad-0c77-4db8-aae3-9137f9beeaa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a6c735c8f141e09a85daee5b3c892c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:42.884688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747abad-0c77-4db8-aae3-9137f9beeaa3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:42.913558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 899/1822] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:42 2022] POST /identity/v3/users => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:42.916521 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb3fe1-527c-4e45-9836-50d0b07c9590 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:42.956095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb3fe1-527c-4e45-9836-50d0b07c9590 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:42.986863 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecdb79-422c-437c-be20-7ed3a6927d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:42.987582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecdb79-422c-437c-be20-7ed3a6927d81 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:42.989635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecdb79-422c-437c-be20-7ed3a6927d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:42.989908 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecdb79-422c-437c-be20-7ed3a6927d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:42.990994 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecdb79-422c-437c-be20-7ed3a6927d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:42.992952 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ecdb79-422c-437c-be20-7ed3a6927d81 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:43.001443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9747abad-0c77-4db8-aae3-9137f9beeaa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a6c735c8f141e09a85daee5b3c892c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:43.017671 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9747abad-0c77-4db8-aae3-9137f9beeaa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a6c735c8f141e09a85daee5b3c892c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:43.037679 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 900/1823] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:43.038614 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecdb79-422c-437c-be20-7ed3a6927d81 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:43.044176 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9747abad-0c77-4db8-aae3-9137f9beeaa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a6c735c8f141e09a85daee5b3c892c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:43.044361 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-79ecdb79-422c-437c-be20-7ed3a6927d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:43.045075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9747abad-0c77-4db8-aae3-9137f9beeaa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a6c735c8f141e09a85daee5b3c892c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:43.045847 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9747abad-0c77-4db8-aae3-9137f9beeaa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a6c735c8f141e09a85daee5b3c892c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:43.067947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecdb79-422c-437c-be20-7ed3a6927d81 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:43.078069 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 924/1824] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:42 2022] DELETE /identity/v3/users/38a6c735c8f141e09a85daee5b3c892c => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:43.078069 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747abad-0c77-4db8-aae3-9137f9beeaa3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:43.078354 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3839a2-9adc-4388-8302-27184882c308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:43.078354 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3839a2-9adc-4388-8302-27184882c308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:43.078354 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3839a2-9adc-4388-8302-27184882c308 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:43.078354 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3839a2-9adc-4388-8302-27184882c308 admin admin] PATH_INFO: `/v3/projects/4cadfb02d9014e8798868f8b7754b094` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:43.079487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9747abad-0c77-4db8-aae3-9137f9beeaa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:43.080861 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3839a2-9adc-4388-8302-27184882c308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cadfb02d9014e8798868f8b7754b094)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:43.086585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3839a2-9adc-4388-8302-27184882c308 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:43.184897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0c3839a2-9adc-4388-8302-27184882c308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cadfb02d9014e8798868f8b7754b094', 'request_id': 'req-0c3839a2-9adc-4388-8302-27184882c308'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:43.199484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0c3839a2-9adc-4388-8302-27184882c308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cadfb02d9014e8798868f8b7754b094', 'request_id': 'req-0c3839a2-9adc-4388-8302-27184882c308'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:43.211432 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0c3839a2-9adc-4388-8302-27184882c308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cadfb02d9014e8798868f8b7754b094', 'request_id': 'req-0c3839a2-9adc-4388-8302-27184882c308'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:43.222933 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747abad-0c77-4db8-aae3-9137f9beeaa3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:43.228293 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0c3839a2-9adc-4388-8302-27184882c308 admin admin] The token cache is being invalidate because project 4cadfb02d9014e8798868f8b7754b094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:43.228700 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0c3839a2-9adc-4388-8302-27184882c308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:43.229918 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0c3839a2-9adc-4388-8302-27184882c308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:43.231533 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 901/1825] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:43 2022] DELETE /identity/v3/projects/4cadfb02d9014e8798868f8b7754b094 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:43.237682 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3839a2-9adc-4388-8302-27184882c308 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:43.241983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0c3839a2-9adc-4388-8302-27184882c308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:43.251511 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:43.301572 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8f534-8924-4ad3-bcd8-91b0dfaae6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:43.302348 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8f534-8924-4ad3-bcd8-91b0dfaae6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:43.302697 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8f534-8924-4ad3-bcd8-91b0dfaae6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:43.303039 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8f534-8924-4ad3-bcd8-91b0dfaae6ea admin admin] PATH_INFO: `/v3/projects/10d394c110974b2eaa264f778ad9b44b/users/2898bfe641704ebfb5e56c15d0f9439e/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:43.323171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8f534-8924-4ad3-bcd8-91b0dfaae6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d394c110974b2eaa264f778ad9b44b, user_id=2898bfe641704ebfb5e56c15d0f9439e, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:43.328299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8f534-8924-4ad3-bcd8-91b0dfaae6ea admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:43.346281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 925/1826] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:43 2022] PUT /identity/v3/projects/10d394c110974b2eaa264f778ad9b44b/users/2898bfe641704ebfb5e56c15d0f9439e/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:43.350705 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8f534-8924-4ad3-bcd8-91b0dfaae6ea admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:43.353401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-64d8f534-8924-4ad3-bcd8-91b0dfaae6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:43.385312 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3839a2-9adc-4388-8302-27184882c308 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:43.448546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8f534-8924-4ad3-bcd8-91b0dfaae6ea admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:43.449289 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:43.455761 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78f6bc-4ed7-433c-826f-f5bae78c4f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:43.457196 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78f6bc-4ed7-433c-826f-f5bae78c4f3f admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:43.457833 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78f6bc-4ed7-433c-826f-f5bae78c4f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:43.458383 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78f6bc-4ed7-433c-826f-f5bae78c4f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:43.459695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78f6bc-4ed7-433c-826f-f5bae78c4f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:43.461585 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78f6bc-4ed7-433c-826f-f5bae78c4f3f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:43.476172 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 926/1827] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:43.477706 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e67fb5-f834-4cc7-a8a0-8e45343fefde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:43.478867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78f6bc-4ed7-433c-826f-f5bae78c4f3f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:43.479201 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e67fb5-f834-4cc7-a8a0-8e45343fefde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:43.479679 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e67fb5-f834-4cc7-a8a0-8e45343fefde admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:43.480190 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e67fb5-f834-4cc7-a8a0-8e45343fefde admin admin] PATH_INFO: `/v3/users/7fda1aa40a794facab1c89190dcb8232` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:43.481606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e67fb5-f834-4cc7-a8a0-8e45343fefde admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fda1aa40a794facab1c89190dcb8232)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:43.483893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e67fb5-f834-4cc7-a8a0-8e45343fefde admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:43.492089 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78f6bc-4ed7-433c-826f-f5bae78c4f3f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:43.504040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c443e-8824-426b-a1f3-b420009cd0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:43.504802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c443e-8824-426b-a1f3-b420009cd0b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:43.505102 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c443e-8824-426b-a1f3-b420009cd0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:43.505374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c443e-8824-426b-a1f3-b420009cd0b5 admin admin] PATH_INFO: `/v3/projects/10d394c110974b2eaa264f778ad9b44b/users/2898bfe641704ebfb5e56c15d0f9439e/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:43.507385 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c443e-8824-426b-a1f3-b420009cd0b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d394c110974b2eaa264f778ad9b44b, user_id=2898bfe641704ebfb5e56c15d0f9439e, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:43.513542 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c443e-8824-426b-a1f3-b420009cd0b5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:43.541683 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 927/1828] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:43 2022] PUT /identity/v3/projects/10d394c110974b2eaa264f778ad9b44b/users/2898bfe641704ebfb5e56c15d0f9439e/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:43.554078 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ea44d-9d5c-4c0c-b555-95fb91d4261e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:43.554379 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ea44d-9d5c-4c0c-b555-95fb91d4261e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:43.554770 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ea44d-9d5c-4c0c-b555-95fb91d4261e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:43.650804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7e5ea44d-9d5c-4c0c-b555-95fb91d4261e None None] MFA Rules not processed for user `2898bfe641704ebfb5e56c15d0f9439e`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:43.652728 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7e5ea44d-9d5c-4c0c-b555-95fb91d4261e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:43.682853 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-58e67fb5-f834-4cc7-a8a0-8e45343fefde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fda1aa40a794facab1c89190dcb8232'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:43.696453 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-58e67fb5-f834-4cc7-a8a0-8e45343fefde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fda1aa40a794facab1c89190dcb8232'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:43.697330 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-58e67fb5-f834-4cc7-a8a0-8e45343fefde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fda1aa40a794facab1c89190dcb8232'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:43.699562 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-58e67fb5-f834-4cc7-a8a0-8e45343fefde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fda1aa40a794facab1c89190dcb8232'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:43.709974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-58e67fb5-f834-4cc7-a8a0-8e45343fefde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fda1aa40a794facab1c89190dcb8232'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:43.731270 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 902/1829] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:43 2022] DELETE /identity/v3/users/7fda1aa40a794facab1c89190dcb8232 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:43.732200 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e67fb5-f834-4cc7-a8a0-8e45343fefde admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:43.733562 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-58e67fb5-f834-4cc7-a8a0-8e45343fefde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:43.763426 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 928/1830] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:43.772910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ea44d-9d5c-4c0c-b555-95fb91d4261e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:43.775540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7e5ea44d-9d5c-4c0c-b555-95fb91d4261e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:43.801675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:43.869053 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e67fb5-f834-4cc7-a8a0-8e45343fefde admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:43.876845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ea44d-9d5c-4c0c-b555-95fb91d4261e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:43.885812 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caa8c69-4c49-4132-8c5a-6a0e43209ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:43.886993 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa8c69-4c49-4132-8c5a-6a0e43209ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:43.887133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa8c69-4c49-4132-8c5a-6a0e43209ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:43.887394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caa8c69-4c49-4132-8c5a-6a0e43209ece admin admin] PATH_INFO: `/v3/projects/e0f79e007e97443cb6365e96f3dea7b1` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:43.889006 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa8c69-4c49-4132-8c5a-6a0e43209ece admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0f79e007e97443cb6365e96f3dea7b1)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:43.892095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caa8c69-4c49-4132-8c5a-6a0e43209ece admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:43.968535 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5caa8c69-4c49-4132-8c5a-6a0e43209ece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0f79e007e97443cb6365e96f3dea7b1', 'request_id': 'req-5caa8c69-4c49-4132-8c5a-6a0e43209ece'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:43.982200 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c0f4f-7a99-4ddf-8089-c188174b2536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:43.982509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5caa8c69-4c49-4132-8c5a-6a0e43209ece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0f79e007e97443cb6365e96f3dea7b1', 'request_id': 'req-5caa8c69-4c49-4132-8c5a-6a0e43209ece'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:43.982936 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c0f4f-7a99-4ddf-8089-c188174b2536 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:43.983227 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c0f4f-7a99-4ddf-8089-c188174b2536 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:43.983537 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c0f4f-7a99-4ddf-8089-c188174b2536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:43.985556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:43.992689 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5caa8c69-4c49-4132-8c5a-6a0e43209ece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0f79e007e97443cb6365e96f3dea7b1', 'request_id': 'req-5caa8c69-4c49-4132-8c5a-6a0e43209ece'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:44.014185 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5caa8c69-4c49-4132-8c5a-6a0e43209ece admin admin] The token cache is being invalidate because project e0f79e007e97443cb6365e96f3dea7b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:44.014185 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5caa8c69-4c49-4132-8c5a-6a0e43209ece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:44.016033 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5caa8c69-4c49-4132-8c5a-6a0e43209ece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:44.019865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 903/1831] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:43 2022] DELETE /identity/v3/projects/e0f79e007e97443cb6365e96f3dea7b1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:44.024683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00e564-76b9-41ef-8e2d-b276f9127ecc None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:44.024971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00e564-76b9-41ef-8e2d-b276f9127ecc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:44.025454 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00e564-76b9-41ef-8e2d-b276f9127ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:44.062881 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2b00e564-76b9-41ef-8e2d-b276f9127ecc None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:44.064253 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2b00e564-76b9-41ef-8e2d-b276f9127ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:44.107301 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c0f4f-7a99-4ddf-8089-c188174b2536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:44.108813 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361c0f4f-7a99-4ddf-8089-c188174b2536 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:44.131649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 929/1832] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:44.187837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 904/1833] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:56:44.196394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009f99e-60e7-4922-9761-242e31161a78 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:44.196394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009f99e-60e7-4922-9761-242e31161a78 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:44.197208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009f99e-60e7-4922-9761-242e31161a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:44.226675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5009f99e-60e7-4922-9761-242e31161a78 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:44.229186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5009f99e-60e7-4922-9761-242e31161a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:44.244756 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 930/1834] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:44.249955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00e564-76b9-41ef-8e2d-b276f9127ecc None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:44.289639 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00e564-76b9-41ef-8e2d-b276f9127ecc None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:44.299823 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98230b-206a-4b4b-9811-ed2120cf26be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:44.300552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98230b-206a-4b4b-9811-ed2120cf26be admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:44.300840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98230b-206a-4b4b-9811-ed2120cf26be admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:44.301145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98230b-206a-4b4b-9811-ed2120cf26be admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:44.301805 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98230b-206a-4b4b-9811-ed2120cf26be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:56:44.302132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98230b-206a-4b4b-9811-ed2120cf26be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:44.305438 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98230b-206a-4b4b-9811-ed2120cf26be admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:44.321886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 905/1835] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:56:44.333917 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009f99e-60e7-4922-9761-242e31161a78 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:44.341720 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009f99e-60e7-4922-9761-242e31161a78 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:44.371115 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad50de-4e7a-4777-a629-6d4459dcc086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:44.377520 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad50de-4e7a-4777-a629-6d4459dcc086 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:44.378815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad50de-4e7a-4777-a629-6d4459dcc086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:44.381666 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad50de-4e7a-4777-a629-6d4459dcc086 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:44.383681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad50de-4e7a-4777-a629-6d4459dcc086 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:44.390197 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bad50de-4e7a-4777-a629-6d4459dcc086 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:44.420861 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98230b-206a-4b4b-9811-ed2120cf26be admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:44.423059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8f98230b-206a-4b4b-9811-ed2120cf26be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:44.463079 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 931/1836] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:44 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:44.466276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad50de-4e7a-4777-a629-6d4459dcc086 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:44.598572 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:44.627905 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98230b-206a-4b4b-9811-ed2120cf26be admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:44.663322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bad50de-4e7a-4777-a629-6d4459dcc086 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:44.677211 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb84ba6-b9ce-42ce-a1f6-c1b4fc12f1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:44.679829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb84ba6-b9ce-42ce-a1f6-c1b4fc12f1ec admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:44.680169 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb84ba6-b9ce-42ce-a1f6-c1b4fc12f1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:44.680457 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb84ba6-b9ce-42ce-a1f6-c1b4fc12f1ec admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:44.681297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb84ba6-b9ce-42ce-a1f6-c1b4fc12f1ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:44.685119 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb84ba6-b9ce-42ce-a1f6-c1b4fc12f1ec admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:44.745308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0cc28-a4ef-485c-8685-bc92e9146449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:44.746094 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0cc28-a4ef-485c-8685-bc92e9146449 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:44.746462 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0cc28-a4ef-485c-8685-bc92e9146449 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:44.747286 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0cc28-a4ef-485c-8685-bc92e9146449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:44.751981 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 932/1837] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:44 2022] POST /identity/v3/users => generated 289 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:44.758046 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-25a0cc28-a4ef-485c-8685-bc92e9146449 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:44.758470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb84ba6-b9ce-42ce-a1f6-c1b4fc12f1ec admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:44.792365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb84ba6-b9ce-42ce-a1f6-c1b4fc12f1ec admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:44.804964 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23918794-ee5a-4195-8d88-c23b16fa4eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:44.804964 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23918794-ee5a-4195-8d88-c23b16fa4eff admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:44.806392 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23918794-ee5a-4195-8d88-c23b16fa4eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:44.807336 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23918794-ee5a-4195-8d88-c23b16fa4eff admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:44.809875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23918794-ee5a-4195-8d88-c23b16fa4eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:44.811717 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23918794-ee5a-4195-8d88-c23b16fa4eff admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:44.848812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 933/1838] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:44.853862 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23918794-ee5a-4195-8d88-c23b16fa4eff admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:44.864921 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:44.879479 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23918794-ee5a-4195-8d88-c23b16fa4eff admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:44.891847 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0cc28-a4ef-485c-8685-bc92e9146449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:44.892548 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28bb12-2255-4d5a-ad3d-867afd146add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:44.893182 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28bb12-2255-4d5a-ad3d-867afd146add admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:44.893432 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0cc28-a4ef-485c-8685-bc92e9146449 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:44.895338 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28bb12-2255-4d5a-ad3d-867afd146add admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:44.895641 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28bb12-2255-4d5a-ad3d-867afd146add admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:44.896339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28bb12-2255-4d5a-ad3d-867afd146add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:44.900444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28bb12-2255-4d5a-ad3d-867afd146add admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:44.908815 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 906/1839] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 20:56:44.909795 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0cc28-a4ef-485c-8685-bc92e9146449 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:44.911283 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-25a0cc28-a4ef-485c-8685-bc92e9146449 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:44.927692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0cc28-a4ef-485c-8685-bc92e9146449 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:44.930783 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 934/1840] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:44.933647 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714f9a4-9ed8-4b8b-a09d-8da8d6499f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:44.935407 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714f9a4-9ed8-4b8b-a09d-8da8d6499f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:44.935529 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714f9a4-9ed8-4b8b-a09d-8da8d6499f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:44.935663 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28bb12-2255-4d5a-ad3d-867afd146add admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:44.935806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714f9a4-9ed8-4b8b-a09d-8da8d6499f66 admin admin] PATH_INFO: `/v3/projects/1b3ef79e19ad40078ae5a2ef723ef789` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:44.942660 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714f9a4-9ed8-4b8b-a09d-8da8d6499f66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b3ef79e19ad40078ae5a2ef723ef789)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:44.944797 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714f9a4-9ed8-4b8b-a09d-8da8d6499f66 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:44.958810 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28bb12-2255-4d5a-ad3d-867afd146add admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:44.972670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7bc55-f17b-4d2f-b82c-7f23e1c305ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:44.973359 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7bc55-f17b-4d2f-b82c-7f23e1c305ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:44.975687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7bc55-f17b-4d2f-b82c-7f23e1c305ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:44.975982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7bc55-f17b-4d2f-b82c-7f23e1c305ef admin admin] PATH_INFO: `/v3/projects/4de62930c75943c38cc8f167899c24a7/users/f4f57769d1b7400c8f850826e9c445d4/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:45.029366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7bc55-f17b-4d2f-b82c-7f23e1c305ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de62930c75943c38cc8f167899c24a7, user_id=f4f57769d1b7400c8f850826e9c445d4, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:45.030033 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c714f9a4-9ed8-4b8b-a09d-8da8d6499f66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b3ef79e19ad40078ae5a2ef723ef789', 'request_id': 'req-c714f9a4-9ed8-4b8b-a09d-8da8d6499f66'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:45.040232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded7bc55-f17b-4d2f-b82c-7f23e1c305ef admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:45.045716 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c714f9a4-9ed8-4b8b-a09d-8da8d6499f66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b3ef79e19ad40078ae5a2ef723ef789', 'request_id': 'req-c714f9a4-9ed8-4b8b-a09d-8da8d6499f66'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:45.055545 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c714f9a4-9ed8-4b8b-a09d-8da8d6499f66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b3ef79e19ad40078ae5a2ef723ef789', 'request_id': 'req-c714f9a4-9ed8-4b8b-a09d-8da8d6499f66'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:45.083609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c714f9a4-9ed8-4b8b-a09d-8da8d6499f66 admin admin] The token cache is being invalidate because project 1b3ef79e19ad40078ae5a2ef723ef789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:45.084043 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c714f9a4-9ed8-4b8b-a09d-8da8d6499f66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:45.085738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c714f9a4-9ed8-4b8b-a09d-8da8d6499f66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:45.093449 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 907/1841] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:44 2022] DELETE /identity/v3/projects/1b3ef79e19ad40078ae5a2ef723ef789 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:45.095470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb23dc-7cad-4ddc-8979-f3441051c0a6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:45.095772 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb23dc-7cad-4ddc-8979-f3441051c0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:45.097268 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb23dc-7cad-4ddc-8979-f3441051c0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:45.101855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 935/1842] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:44 2022] PUT /identity/v3/projects/4de62930c75943c38cc8f167899c24a7/users/f4f57769d1b7400c8f850826e9c445d4/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:45.113766 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec52e1-80e5-47ad-8878-f9c4219a8ff5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:45.114054 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec52e1-80e5-47ad-8878-f9c4219a8ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:45.114344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec52e1-80e5-47ad-8878-f9c4219a8ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:45.153765 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0fcb23dc-7cad-4ddc-8979-f3441051c0a6 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:45.155042 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0fcb23dc-7cad-4ddc-8979-f3441051c0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:45.222270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-21ec52e1-80e5-47ad-8878-f9c4219a8ff5 None None] MFA Rules not processed for user `f4f57769d1b7400c8f850826e9c445d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:45.229770 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-21ec52e1-80e5-47ad-8878-f9c4219a8ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:45.312360 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 908/1843] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:56:45.316677 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6262205-bbd9-492c-8bce-6096250503f6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:45.317098 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6262205-bbd9-492c-8bce-6096250503f6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:45.317392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6262205-bbd9-492c-8bce-6096250503f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:45.385097 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c6262205-bbd9-492c-8bce-6096250503f6 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:45.389177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c6262205-bbd9-492c-8bce-6096250503f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:45.410775 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 909/1844] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:45.415561 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6262205-bbd9-492c-8bce-6096250503f6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:45.443632 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6262205-bbd9-492c-8bce-6096250503f6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:45.458384 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa0306-547a-4256-9af9-c122dc7554d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:45.459034 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa0306-547a-4256-9af9-c122dc7554d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:45.459420 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa0306-547a-4256-9af9-c122dc7554d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:45.459704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa0306-547a-4256-9af9-c122dc7554d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:45.461789 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa0306-547a-4256-9af9-c122dc7554d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:56:45.462527 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa0306-547a-4256-9af9-c122dc7554d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:45.467284 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa0306-547a-4256-9af9-c122dc7554d5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:45.508409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 910/1845] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:56:45.510765 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa0306-547a-4256-9af9-c122dc7554d5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:45.525187 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa0306-547a-4256-9af9-c122dc7554d5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:45.531752 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd186a-2a2b-4e1c-91cf-735162d08801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:45.532584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd186a-2a2b-4e1c-91cf-735162d08801 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:45.532971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd186a-2a2b-4e1c-91cf-735162d08801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:45.533782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd186a-2a2b-4e1c-91cf-735162d08801 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:45.535524 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd186a-2a2b-4e1c-91cf-735162d08801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:45.538597 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd186a-2a2b-4e1c-91cf-735162d08801 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:45.546039 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 936/1846] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:45.548344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec52e1-80e5-47ad-8878-f9c4219a8ff5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:45.549807 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-21ec52e1-80e5-47ad-8878-f9c4219a8ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:45.590946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 911/1847] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:45 2022] POST /identity/v3/projects => generated 401 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:56:45.591817 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd186a-2a2b-4e1c-91cf-735162d08801 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:45.592900 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec52e1-80e5-47ad-8878-f9c4219a8ff5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:45.696600 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:45.720814 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a392f4-78ed-46bb-a66e-3a7c49bf936f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:45.721494 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a392f4-78ed-46bb-a66e-3a7c49bf936f admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:45.721728 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a392f4-78ed-46bb-a66e-3a7c49bf936f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:45.722061 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a392f4-78ed-46bb-a66e-3a7c49bf936f admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:45.723595 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a392f4-78ed-46bb-a66e-3a7c49bf936f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:45.725538 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a392f4-78ed-46bb-a66e-3a7c49bf936f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:45.740076 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd186a-2a2b-4e1c-91cf-735162d08801 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:45.747361 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa46bf6-088e-4531-a265-3acf599c7ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:45.748240 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa46bf6-088e-4531-a265-3acf599c7ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:45.748534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa46bf6-088e-4531-a265-3acf599c7ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:45.748784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa46bf6-088e-4531-a265-3acf599c7ae9 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:45.750218 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa46bf6-088e-4531-a265-3acf599c7ae9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:45.753325 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa46bf6-088e-4531-a265-3acf599c7ae9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:45.785535 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 937/1848] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:45 2022] POST /identity/v3/projects => generated 377 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:56:45.786813 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a392f4-78ed-46bb-a66e-3a7c49bf936f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:45.808261 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 912/1849] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:45 2022] POST /identity/v3/users => generated 301 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:45.810167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa46bf6-088e-4531-a265-3acf599c7ae9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:45.812624 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:45.836495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa46bf6-088e-4531-a265-3acf599c7ae9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:45.930253 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36135c-fb26-4ef0-bf67-7dd112344799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:45.931171 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36135c-fb26-4ef0-bf67-7dd112344799 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:45.931564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36135c-fb26-4ef0-bf67-7dd112344799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:45.931942 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c36135c-fb26-4ef0-bf67-7dd112344799 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:45.932767 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36135c-fb26-4ef0-bf67-7dd112344799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:45.935036 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c36135c-fb26-4ef0-bf67-7dd112344799 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:45.948810 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 913/1850] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:45.952788 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36135c-fb26-4ef0-bf67-7dd112344799 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:45.965338 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c36135c-fb26-4ef0-bf67-7dd112344799 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:45.968579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a392f4-78ed-46bb-a66e-3a7c49bf936f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:45.970576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60bd5e-b3c8-4dd8-bc2b-a32ee739b86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:45.971345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60bd5e-b3c8-4dd8-bc2b-a32ee739b86b admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:45.971787 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60bd5e-b3c8-4dd8-bc2b-a32ee739b86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:45.972259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60bd5e-b3c8-4dd8-bc2b-a32ee739b86b admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:45.973308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60bd5e-b3c8-4dd8-bc2b-a32ee739b86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:45.975059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60bd5e-b3c8-4dd8-bc2b-a32ee739b86b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:45.982027 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe16d7a-ea74-43c2-974a-d7cc373933e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:45.982672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe16d7a-ea74-43c2-974a-d7cc373933e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:45.982954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe16d7a-ea74-43c2-974a-d7cc373933e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:45.983230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe16d7a-ea74-43c2-974a-d7cc373933e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:45.983885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe16d7a-ea74-43c2-974a-d7cc373933e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:45.989029 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 914/1851] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:45.989576 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe16d7a-ea74-43c2-974a-d7cc373933e2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:45.993465 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60bd5e-b3c8-4dd8-bc2b-a32ee739b86b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:46.011559 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60bd5e-b3c8-4dd8-bc2b-a32ee739b86b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:46.017317 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900b97f-bf54-4312-ab3c-f968983e2e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:46.017672 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900b97f-bf54-4312-ab3c-f968983e2e9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:46.017944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900b97f-bf54-4312-ab3c-f968983e2e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:46.018220 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900b97f-bf54-4312-ab3c-f968983e2e9f admin admin] PATH_INFO: `/v3/projects/1390ba0886884bd690779dbf7e756668/users/c3fd691866814593add2aa0ee6c2e094/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:46.038747 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900b97f-bf54-4312-ab3c-f968983e2e9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1390ba0886884bd690779dbf7e756668, user_id=c3fd691866814593add2aa0ee6c2e094, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:46.041609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900b97f-bf54-4312-ab3c-f968983e2e9f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:46.050916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 938/1852] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:45 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:46.055145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe16d7a-ea74-43c2-974a-d7cc373933e2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:46.071685 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 915/1853] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:45 2022] PUT /identity/v3/projects/1390ba0886884bd690779dbf7e756668/users/c3fd691866814593add2aa0ee6c2e094/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:46.081002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da4332-b98c-4d90-9a4c-6662473c1d0a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:46.081002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da4332-b98c-4d90-9a4c-6662473c1d0a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:46.081002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da4332-b98c-4d90-9a4c-6662473c1d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:46.093670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe16d7a-ea74-43c2-974a-d7cc373933e2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:46.113436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b2da4332-b98c-4d90-9a4c-6662473c1d0a None None] MFA Rules not processed for user `c3fd691866814593add2aa0ee6c2e094`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:46.114676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b2da4332-b98c-4d90-9a4c-6662473c1d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:46.218049 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d1f5d-3f93-4193-8f04-6fd8fed1c89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:46.218682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d1f5d-3f93-4193-8f04-6fd8fed1c89b admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:46.219169 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d1f5d-3f93-4193-8f04-6fd8fed1c89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:46.219278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d1f5d-3f93-4193-8f04-6fd8fed1c89b admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:46.219871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d1f5d-3f93-4193-8f04-6fd8fed1c89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:46.221521 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d1f5d-3f93-4193-8f04-6fd8fed1c89b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:46.238766 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 916/1854] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:46 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:46.239751 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 939/1855] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:46.246116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da4332-b98c-4d90-9a4c-6662473c1d0a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:46.246270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d1f5d-3f93-4193-8f04-6fd8fed1c89b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:46.257739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da4332-b98c-4d90-9a4c-6662473c1d0a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:46.263143 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d1f5d-3f93-4193-8f04-6fd8fed1c89b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:46.263294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f262cec-8f46-4115-b2b0-26fdd0e54a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:46.264580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f262cec-8f46-4115-b2b0-26fdd0e54a3c admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:46.266220 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f262cec-8f46-4115-b2b0-26fdd0e54a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:46.266220 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f262cec-8f46-4115-b2b0-26fdd0e54a3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:46.266220 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f262cec-8f46-4115-b2b0-26fdd0e54a3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:46.268426 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e454775-f8f9-46bf-ba56-013b8ad2f434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:46.268578 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f262cec-8f46-4115-b2b0-26fdd0e54a3c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:46.270189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e454775-f8f9-46bf-ba56-013b8ad2f434 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:46.270562 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e454775-f8f9-46bf-ba56-013b8ad2f434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:46.270904 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e454775-f8f9-46bf-ba56-013b8ad2f434 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:46.271623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e454775-f8f9-46bf-ba56-013b8ad2f434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:46.273336 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e454775-f8f9-46bf-ba56-013b8ad2f434 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:46.282490 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:46.289675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 940/1856] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:46.291003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e454775-f8f9-46bf-ba56-013b8ad2f434 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:46.303387 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e454775-f8f9-46bf-ba56-013b8ad2f434 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:46.329425 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 917/1857] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:46 2022] POST /identity/v3/projects => generated 399 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:46.334388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f262cec-8f46-4115-b2b0-26fdd0e54a3c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:46.337885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93daca73-15bb-4449-b22c-fff29f607bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:46.338800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daca73-15bb-4449-b22c-fff29f607bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:46.353377 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daca73-15bb-4449-b22c-fff29f607bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:46.353733 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daca73-15bb-4449-b22c-fff29f607bd1 admin admin] PATH_INFO: `/v3/projects/82f16b06e63a40109e0d383c828cf091/users/aba35c5d345c4d738b45e2bf9cef3414/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:46.377654 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93daca73-15bb-4449-b22c-fff29f607bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82f16b06e63a40109e0d383c828cf091, user_id=aba35c5d345c4d738b45e2bf9cef3414, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:46.382073 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93daca73-15bb-4449-b22c-fff29f607bd1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:46.406699 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 941/1858] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:46 2022] PUT /identity/v3/projects/82f16b06e63a40109e0d383c828cf091/users/aba35c5d345c4d738b45e2bf9cef3414/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:46.418995 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ffbdc-e550-4c75-a6f4-60c2f828e47e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:46.419378 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ffbdc-e550-4c75-a6f4-60c2f828e47e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:46.419754 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ffbdc-e550-4c75-a6f4-60c2f828e47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:46.442933 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f262cec-8f46-4115-b2b0-26fdd0e54a3c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:46.459612 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-dd2ffbdc-e550-4c75-a6f4-60c2f828e47e None None] MFA Rules not processed for user `aba35c5d345c4d738b45e2bf9cef3414`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:46.460971 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dd2ffbdc-e550-4c75-a6f4-60c2f828e47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:46.534221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:46.552135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f633f18-8a16-40d3-9cc4-80578f41766e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:46.552560 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f633f18-8a16-40d3-9cc4-80578f41766e admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:46.552936 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f633f18-8a16-40d3-9cc4-80578f41766e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:46.553304 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f633f18-8a16-40d3-9cc4-80578f41766e admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:46.554042 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f633f18-8a16-40d3-9cc4-80578f41766e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:46.556154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f633f18-8a16-40d3-9cc4-80578f41766e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:46.576026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 942/1859] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:56:46.579056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ffbdc-e550-4c75-a6f4-60c2f828e47e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:46.622891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ffbdc-e550-4c75-a6f4-60c2f828e47e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:46.630478 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 918/1860] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:46 2022] POST /identity/v3/users => generated 306 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:56:46.631700 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f633f18-8a16-40d3-9cc4-80578f41766e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:46.639577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179685e-3621-4c42-b8c9-2dbbf2e2a794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:46.641709 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179685e-3621-4c42-b8c9-2dbbf2e2a794 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:46.641884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179685e-3621-4c42-b8c9-2dbbf2e2a794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:46.642152 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1179685e-3621-4c42-b8c9-2dbbf2e2a794 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:46.642803 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179685e-3621-4c42-b8c9-2dbbf2e2a794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:46.646911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f633f18-8a16-40d3-9cc4-80578f41766e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:46.650610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1179685e-3621-4c42-b8c9-2dbbf2e2a794 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:46.669288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfb131-6582-46ed-a20d-6266aa7dd7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:46.671450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfb131-6582-46ed-a20d-6266aa7dd7bf admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:46.673092 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfb131-6582-46ed-a20d-6266aa7dd7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:46.674648 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfb131-6582-46ed-a20d-6266aa7dd7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:46.676212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfb131-6582-46ed-a20d-6266aa7dd7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:46.680358 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cfb131-6582-46ed-a20d-6266aa7dd7bf admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:46.713457 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 943/1861] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:46 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:56:46.717050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179685e-3621-4c42-b8c9-2dbbf2e2a794 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:46.721281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 919/1862] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:46.727466 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfb131-6582-46ed-a20d-6266aa7dd7bf admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:46.740187 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cfb131-6582-46ed-a20d-6266aa7dd7bf admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:46.820182 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9b8cc-566b-481b-b476-40f603390eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:46.820848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9b8cc-566b-481b-b476-40f603390eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:46.821257 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9b8cc-566b-481b-b476-40f603390eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:46.821581 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9b8cc-566b-481b-b476-40f603390eb4 admin admin] PATH_INFO: `/v3/projects/7767d18128554c008e6f57f5e7e8f47b/users/cd42eaa2e8284a9f92c7ffe8078fb540/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:46.845480 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9b8cc-566b-481b-b476-40f603390eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7767d18128554c008e6f57f5e7e8f47b, user_id=cd42eaa2e8284a9f92c7ffe8078fb540, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:46.852299 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9b8cc-566b-481b-b476-40f603390eb4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:46.853904 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1179685e-3621-4c42-b8c9-2dbbf2e2a794 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:46.855208 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:46.872321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41faaf-ce75-42b3-997a-e8887e22a72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:46.874430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41faaf-ce75-42b3-997a-e8887e22a72d admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:46.874724 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41faaf-ce75-42b3-997a-e8887e22a72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:46.875002 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a41faaf-ce75-42b3-997a-e8887e22a72d admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:46.879719 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41faaf-ce75-42b3-997a-e8887e22a72d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:46.881940 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a41faaf-ce75-42b3-997a-e8887e22a72d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:46.887237 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 920/1863] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:46 2022] PUT /identity/v3/projects/7767d18128554c008e6f57f5e7e8f47b/users/cd42eaa2e8284a9f92c7ffe8078fb540/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:46.889249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9b8cc-566b-481b-b476-40f603390eb4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:46.937086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 944/1864] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:46 2022] POST /identity/v3/users => generated 296 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:56:46.940369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41faaf-ce75-42b3-997a-e8887e22a72d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:46.962019 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a41faaf-ce75-42b3-997a-e8887e22a72d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:47.012217 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9b8cc-566b-481b-b476-40f603390eb4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:47.020521 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bfc98-2179-49b2-b79c-daa0cb5d0a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:47.021567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bfc98-2179-49b2-b79c-daa0cb5d0a7f admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:47.022457 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bfc98-2179-49b2-b79c-daa0cb5d0a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:47.022899 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3bfc98-2179-49b2-b79c-daa0cb5d0a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:47.025257 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bfc98-2179-49b2-b79c-daa0cb5d0a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:47.027815 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3bfc98-2179-49b2-b79c-daa0cb5d0a7f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:47.045646 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 921/1865] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:47.050812 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bfc98-2179-49b2-b79c-daa0cb5d0a7f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:47.062665 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb44be-d864-4cab-b464-2cebd04660d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:47.063524 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb44be-d864-4cab-b464-2cebd04660d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:47.063903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb44be-d864-4cab-b464-2cebd04660d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:47.064311 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb44be-d864-4cab-b464-2cebd04660d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:47.065048 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb44be-d864-4cab-b464-2cebd04660d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:47.067404 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb44be-d864-4cab-b464-2cebd04660d6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:47.070989 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3bfc98-2179-49b2-b79c-daa0cb5d0a7f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:47.078578 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c891b-d0c0-4797-804b-1c2e00dfda39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:47.079586 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c891b-d0c0-4797-804b-1c2e00dfda39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:47.079870 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c891b-d0c0-4797-804b-1c2e00dfda39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:47.080176 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c891b-d0c0-4797-804b-1c2e00dfda39 admin admin] PATH_INFO: `/v3/projects/7767d18128554c008e6f57f5e7e8f47b/users/cd42eaa2e8284a9f92c7ffe8078fb540/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:47.082827 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c891b-d0c0-4797-804b-1c2e00dfda39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7767d18128554c008e6f57f5e7e8f47b, user_id=cd42eaa2e8284a9f92c7ffe8078fb540, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:47.084348 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 945/1866] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:47.088128 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb44be-d864-4cab-b464-2cebd04660d6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:47.089795 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c891b-d0c0-4797-804b-1c2e00dfda39 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:47.103880 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 922/1867] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:47 2022] PUT /identity/v3/projects/7767d18128554c008e6f57f5e7e8f47b/users/cd42eaa2e8284a9f92c7ffe8078fb540/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:47.110663 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb44be-d864-4cab-b464-2cebd04660d6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:47.117674 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2c9ea-eee4-45fc-8f4d-770a9a2c6877 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:47.117971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2c9ea-eee4-45fc-8f4d-770a9a2c6877 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:47.118329 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2c9ea-eee4-45fc-8f4d-770a9a2c6877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:47.157928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-74f2c9ea-eee4-45fc-8f4d-770a9a2c6877 None None] MFA Rules not processed for user `cd42eaa2e8284a9f92c7ffe8078fb540`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:47.160613 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-74f2c9ea-eee4-45fc-8f4d-770a9a2c6877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:47.186395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:47.201597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df162baa-c023-46ac-8fab-212126019e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:47.202459 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df162baa-c023-46ac-8fab-212126019e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:47.202940 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df162baa-c023-46ac-8fab-212126019e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:47.203293 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df162baa-c023-46ac-8fab-212126019e2b admin admin] PATH_INFO: `/v3/projects/9e4f1fbf06944f388ea60f8d29860ded/users/29ed3e1bd16c4fe8a1037ee97a6b8de9/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:47.239897 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df162baa-c023-46ac-8fab-212126019e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e4f1fbf06944f388ea60f8d29860ded, user_id=29ed3e1bd16c4fe8a1037ee97a6b8de9, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:47.242951 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df162baa-c023-46ac-8fab-212126019e2b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:47.268350 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 946/1868] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:47 2022] PUT /identity/v3/projects/9e4f1fbf06944f388ea60f8d29860ded/users/29ed3e1bd16c4fe8a1037ee97a6b8de9/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:47.269895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df162baa-c023-46ac-8fab-212126019e2b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:47.297084 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 923/1869] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:47 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:56:47.315306 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2c9ea-eee4-45fc-8f4d-770a9a2c6877 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:47.321210 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-74f2c9ea-eee4-45fc-8f4d-770a9a2c6877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:47.351069 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df162baa-c023-46ac-8fab-212126019e2b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:47.356982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807043d-e568-4f46-b90f-c16767174aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:47.357911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807043d-e568-4f46-b90f-c16767174aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:47.360401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807043d-e568-4f46-b90f-c16767174aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:47.361910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807043d-e568-4f46-b90f-c16767174aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:47.361910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807043d-e568-4f46-b90f-c16767174aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:47.364023 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807043d-e568-4f46-b90f-c16767174aa9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:47.385162 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 947/1870] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:47.387203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807043d-e568-4f46-b90f-c16767174aa9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:47.409236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807043d-e568-4f46-b90f-c16767174aa9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:47.416975 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c999b30-1234-4731-9ae6-5a186322017f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:47.417422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c999b30-1234-4731-9ae6-5a186322017f admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:47.417802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c999b30-1234-4731-9ae6-5a186322017f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:47.418174 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c999b30-1234-4731-9ae6-5a186322017f admin admin] PATH_INFO: `/v3/projects/9e4f1fbf06944f388ea60f8d29860ded/users/29ed3e1bd16c4fe8a1037ee97a6b8de9/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:47.420484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c999b30-1234-4731-9ae6-5a186322017f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e4f1fbf06944f388ea60f8d29860ded, user_id=29ed3e1bd16c4fe8a1037ee97a6b8de9, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:47.423922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c999b30-1234-4731-9ae6-5a186322017f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:47.434003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2c9ea-eee4-45fc-8f4d-770a9a2c6877 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:47.440189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 948/1871] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:47 2022] PUT /identity/v3/projects/9e4f1fbf06944f388ea60f8d29860ded/users/29ed3e1bd16c4fe8a1037ee97a6b8de9/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:47.451571 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86276f-607e-4cff-a92a-9b50d6d9ea06 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:47.451860 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86276f-607e-4cff-a92a-9b50d6d9ea06 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:47.452207 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86276f-607e-4cff-a92a-9b50d6d9ea06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:47.455718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:47.512655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6f86276f-607e-4cff-a92a-9b50d6d9ea06 None None] MFA Rules not processed for user `29ed3e1bd16c4fe8a1037ee97a6b8de9`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:47.514087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6f86276f-607e-4cff-a92a-9b50d6d9ea06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:47.528384 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40869ab8-25b2-403f-880e-b15ee7735f3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:47.529190 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40869ab8-25b2-403f-880e-b15ee7735f3d service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:47.529594 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40869ab8-25b2-403f-880e-b15ee7735f3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:47.530305 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40869ab8-25b2-403f-880e-b15ee7735f3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:47.634912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 949/1872] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:47.648033 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86276f-607e-4cff-a92a-9b50d6d9ea06 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:47.651501 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40869ab8-25b2-403f-880e-b15ee7735f3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:47.652432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6f86276f-607e-4cff-a92a-9b50d6d9ea06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:47.653177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40869ab8-25b2-403f-880e-b15ee7735f3d service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:47.687507 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 924/1873] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:47 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:47.690076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86276f-607e-4cff-a92a-9b50d6d9ea06 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:47.694362 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b41c0-7229-4743-aedb-bebaa5421030 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:47.695153 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b41c0-7229-4743-aedb-bebaa5421030 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:47.695518 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b41c0-7229-4743-aedb-bebaa5421030 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:47.695861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5b41c0-7229-4743-aedb-bebaa5421030 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:47.721058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b41c0-7229-4743-aedb-bebaa5421030 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:47.722716 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5b41c0-7229-4743-aedb-bebaa5421030 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:47.751396 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 950/1874] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:47.824795 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b41c0-7229-4743-aedb-bebaa5421030 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:47.825201 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40869ab8-25b2-403f-880e-b15ee7735f3d service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:47.830815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4b5b41c0-7229-4743-aedb-bebaa5421030 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:47.838504 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40869ab8-25b2-403f-880e-b15ee7735f3d service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:47.844769 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4aa82f-294f-4358-8400-deba978422c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:47.845535 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4aa82f-294f-4358-8400-deba978422c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:47.845935 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4aa82f-294f-4358-8400-deba978422c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:47.846303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4aa82f-294f-4358-8400-deba978422c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:47.885219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:47.962136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4aa82f-294f-4358-8400-deba978422c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:47.964656 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4aa82f-294f-4358-8400-deba978422c1 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:47.968700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5b41c0-7229-4743-aedb-bebaa5421030 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:47.973731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302b08a-681a-4d33-b286-3a0f1bf9b091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:47.974433 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302b08a-681a-4d33-b286-3a0f1bf9b091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:47.974714 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302b08a-681a-4d33-b286-3a0f1bf9b091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:47.974983 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302b08a-681a-4d33-b286-3a0f1bf9b091 admin admin] PATH_INFO: `/v3/users/a5bc663c0bb54528b561d6f857a19e83` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:47.976237 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 925/1875] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:47 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 20:56:47.976496 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302b08a-681a-4d33-b286-3a0f1bf9b091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5bc663c0bb54528b561d6f857a19e83)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:47.977545 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4aa82f-294f-4358-8400-deba978422c1 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:47.979005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302b08a-681a-4d33-b286-3a0f1bf9b091 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:47.988082 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4aa82f-294f-4358-8400-deba978422c1 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:47.992210 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f178b0-e535-4e16-a7c8-b67b1f7f636a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:47.993003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f178b0-e535-4e16-a7c8-b67b1f7f636a service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:47.993566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f178b0-e535-4e16-a7c8-b67b1f7f636a service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:47.994024 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f178b0-e535-4e16-a7c8-b67b1f7f636a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:48.060346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5302b08a-681a-4d33-b286-3a0f1bf9b091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5bc663c0bb54528b561d6f857a19e83'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:48.064629 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f178b0-e535-4e16-a7c8-b67b1f7f636a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:48.066720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f178b0-e535-4e16-a7c8-b67b1f7f636a service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:48.085581 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5302b08a-681a-4d33-b286-3a0f1bf9b091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5bc663c0bb54528b561d6f857a19e83'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:48.091935 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 926/1876] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:48.093979 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09f76c-7568-421e-acd8-5f1e3cf68166 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:48.096269 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09f76c-7568-421e-acd8-5f1e3cf68166 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:48.096412 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09f76c-7568-421e-acd8-5f1e3cf68166 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:48.098931 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 927/1877] 10.222.0.15 () {54 vars in 921 bytes} [Fri Sep 9 20:56:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:56:48.107429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5302b08a-681a-4d33-b286-3a0f1bf9b091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5bc663c0bb54528b561d6f857a19e83'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:48.114134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5302b08a-681a-4d33-b286-3a0f1bf9b091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5bc663c0bb54528b561d6f857a19e83'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:48.114383 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5302b08a-681a-4d33-b286-3a0f1bf9b091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5bc663c0bb54528b561d6f857a19e83'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:48.133704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09f76c-7568-421e-acd8-5f1e3cf68166 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:48.135827 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1a09f76c-7568-421e-acd8-5f1e3cf68166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:48.146725 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 951/1878] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:47 2022] DELETE /identity/v3/users/a5bc663c0bb54528b561d6f857a19e83 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:48.151209 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362d01f-163e-46da-8e23-4fe376db8d45 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:48.151495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362d01f-163e-46da-8e23-4fe376db8d45 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:48.151769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362d01f-163e-46da-8e23-4fe376db8d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:48.153159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:48.164804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09f76c-7568-421e-acd8-5f1e3cf68166 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:48.193638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6362d01f-163e-46da-8e23-4fe376db8d45 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:48.195438 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6362d01f-163e-46da-8e23-4fe376db8d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:48.311655 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd661e-9d9d-469a-b028-7c9988e184f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:48.312771 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd661e-9d9d-469a-b028-7c9988e184f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:48.313083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd661e-9d9d-469a-b028-7c9988e184f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:48.313362 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd661e-9d9d-469a-b028-7c9988e184f3 admin admin] PATH_INFO: `/v3/users/ccae18a992e04710905cdd9a948a3b4a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:48.321206 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd661e-9d9d-469a-b028-7c9988e184f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccae18a992e04710905cdd9a948a3b4a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:48.324549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd661e-9d9d-469a-b028-7c9988e184f3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:48.343269 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 952/1879] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:48.354003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca520f21-d6cf-44ec-8abd-8818d9bea9c8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:48.354294 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca520f21-d6cf-44ec-8abd-8818d9bea9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:48.354573 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca520f21-d6cf-44ec-8abd-8818d9bea9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:48.402517 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ca520f21-d6cf-44ec-8abd-8818d9bea9c8 None None] MFA Rules not processed for user `dc210376e57a41e6b3812110db249099`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:48.405098 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ca520f21-d6cf-44ec-8abd-8818d9bea9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:48.445935 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a0dd661e-9d9d-469a-b028-7c9988e184f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccae18a992e04710905cdd9a948a3b4a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:48.474695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a0dd661e-9d9d-469a-b028-7c9988e184f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccae18a992e04710905cdd9a948a3b4a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:48.474695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a0dd661e-9d9d-469a-b028-7c9988e184f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccae18a992e04710905cdd9a948a3b4a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:48.474695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a0dd661e-9d9d-469a-b028-7c9988e184f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccae18a992e04710905cdd9a948a3b4a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:48.480158 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a0dd661e-9d9d-469a-b028-7c9988e184f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccae18a992e04710905cdd9a948a3b4a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:48.517326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:48.543273 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 928/1880] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:48 2022] DELETE /identity/v3/users/ccae18a992e04710905cdd9a948a3b4a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:48.551436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd661e-9d9d-469a-b028-7c9988e184f3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:48.569981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a0dd661e-9d9d-469a-b028-7c9988e184f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:48.614451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 953/1881] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Sep 9 20:56:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:48.617495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedc79d-2dbe-48c4-aa35-e14e69ef1e30 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:48.617831 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedc79d-2dbe-48c4-aa35-e14e69ef1e30 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:48.618103 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedc79d-2dbe-48c4-aa35-e14e69ef1e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:48.671608 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3cedc79d-2dbe-48c4-aa35-e14e69ef1e30 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:48.673612 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3cedc79d-2dbe-48c4-aa35-e14e69ef1e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:48.760319 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd661e-9d9d-469a-b028-7c9988e184f3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:48.779618 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756aad3-98db-49a9-ae3d-0e1f022c6199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:48.780571 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756aad3-98db-49a9-ae3d-0e1f022c6199 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:48.780855 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756aad3-98db-49a9-ae3d-0e1f022c6199 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:48.781137 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756aad3-98db-49a9-ae3d-0e1f022c6199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:48.786099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a756aad3-98db-49a9-ae3d-0e1f022c6199 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:48.840525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 954/1882] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:48.841578 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedc79d-2dbe-48c4-aa35-e14e69ef1e30 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:48.842988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3cedc79d-2dbe-48c4-aa35-e14e69ef1e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:48.880253 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:48.920288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756aad3-98db-49a9-ae3d-0e1f022c6199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:48.922704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756aad3-98db-49a9-ae3d-0e1f022c6199 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:48.937428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 929/1883] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:48.938412 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756aad3-98db-49a9-ae3d-0e1f022c6199 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:48.941011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a756aad3-98db-49a9-ae3d-0e1f022c6199 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:48.962430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756aad3-98db-49a9-ae3d-0e1f022c6199 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:48.975349 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5459caa-5041-48ad-8f11-ac25a4ce11a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:48.977667 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5459caa-5041-48ad-8f11-ac25a4ce11a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:48.977957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5459caa-5041-48ad-8f11-ac25a4ce11a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:48.978237 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5459caa-5041-48ad-8f11-ac25a4ce11a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:48.998271 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5459caa-5041-48ad-8f11-ac25a4ce11a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:49.000290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5459caa-5041-48ad-8f11-ac25a4ce11a8 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:49.014044 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 930/1884] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:49.053328 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedc79d-2dbe-48c4-aa35-e14e69ef1e30 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:49.068725 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6827e-44b4-4d45-9614-c42239b687ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:49.069405 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6827e-44b4-4d45-9614-c42239b687ae service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:49.069706 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6827e-44b4-4d45-9614-c42239b687ae service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:49.070220 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6827e-44b4-4d45-9614-c42239b687ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:49.087939 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6827e-44b4-4d45-9614-c42239b687ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:49.091635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6827e-44b4-4d45-9614-c42239b687ae service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:49.111098 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 955/1885] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:49.448502 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5459caa-5041-48ad-8f11-ac25a4ce11a8 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:49.450006 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a5459caa-5041-48ad-8f11-ac25a4ce11a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:49.454794 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6827e-44b4-4d45-9614-c42239b687ae service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:49.456223 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e0c6827e-44b4-4d45-9614-c42239b687ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:49.464463 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5459caa-5041-48ad-8f11-ac25a4ce11a8 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:49.470007 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76576d06-911f-423f-b07b-8aef13b6f10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:49.470672 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76576d06-911f-423f-b07b-8aef13b6f10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:49.470945 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76576d06-911f-423f-b07b-8aef13b6f10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:49.471221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76576d06-911f-423f-b07b-8aef13b6f10b admin admin] PATH_INFO: `/v3/projects/7114b4fbaf1a4d048108a23720f4e4c7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:49.472690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76576d06-911f-423f-b07b-8aef13b6f10b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7114b4fbaf1a4d048108a23720f4e4c7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:49.472873 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6827e-44b4-4d45-9614-c42239b687ae service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:49.475071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76576d06-911f-423f-b07b-8aef13b6f10b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:49.478381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a990f6-997b-4f57-bb9c-6ea596db9619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:49.479020 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a990f6-997b-4f57-bb9c-6ea596db9619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:49.479295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a990f6-997b-4f57-bb9c-6ea596db9619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:49.479566 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a990f6-997b-4f57-bb9c-6ea596db9619 admin admin] PATH_INFO: `/v3/projects/220bc1578a244b0fb138e0d995a7b4c6` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:49.480727 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a990f6-997b-4f57-bb9c-6ea596db9619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=220bc1578a244b0fb138e0d995a7b4c6)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:49.482882 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a990f6-997b-4f57-bb9c-6ea596db9619 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:49.538213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-76576d06-911f-423f-b07b-8aef13b6f10b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7114b4fbaf1a4d048108a23720f4e4c7', 'request_id': 'req-76576d06-911f-423f-b07b-8aef13b6f10b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:49.539979 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a7a990f6-997b-4f57-bb9c-6ea596db9619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '220bc1578a244b0fb138e0d995a7b4c6', 'request_id': 'req-a7a990f6-997b-4f57-bb9c-6ea596db9619'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:49.548489 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-76576d06-911f-423f-b07b-8aef13b6f10b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7114b4fbaf1a4d048108a23720f4e4c7', 'request_id': 'req-76576d06-911f-423f-b07b-8aef13b6f10b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:49.551211 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a7a990f6-997b-4f57-bb9c-6ea596db9619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '220bc1578a244b0fb138e0d995a7b4c6', 'request_id': 'req-a7a990f6-997b-4f57-bb9c-6ea596db9619'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:49.557996 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:49.559568 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-76576d06-911f-423f-b07b-8aef13b6f10b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7114b4fbaf1a4d048108a23720f4e4c7', 'request_id': 'req-76576d06-911f-423f-b07b-8aef13b6f10b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:49.560289 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a7a990f6-997b-4f57-bb9c-6ea596db9619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '220bc1578a244b0fb138e0d995a7b4c6', 'request_id': 'req-a7a990f6-997b-4f57-bb9c-6ea596db9619'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:49.572356 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-76576d06-911f-423f-b07b-8aef13b6f10b admin admin] The token cache is being invalidate because project 7114b4fbaf1a4d048108a23720f4e4c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:49.572625 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-76576d06-911f-423f-b07b-8aef13b6f10b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:49.573290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-76576d06-911f-423f-b07b-8aef13b6f10b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:49.574844 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 931/1886] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:49 2022] DELETE /identity/v3/projects/7114b4fbaf1a4d048108a23720f4e4c7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:49.579206 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad5f44-01aa-4fa0-b776-697ffe99ba80 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:49.579562 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad5f44-01aa-4fa0-b776-697ffe99ba80 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:49.579906 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad5f44-01aa-4fa0-b776-697ffe99ba80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:49.582597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a7a990f6-997b-4f57-bb9c-6ea596db9619 admin admin] The token cache is being invalidate because project 220bc1578a244b0fb138e0d995a7b4c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:49.582970 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a7a990f6-997b-4f57-bb9c-6ea596db9619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:49.583963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a7a990f6-997b-4f57-bb9c-6ea596db9619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:49.585637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 956/1887] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:49 2022] DELETE /identity/v3/projects/220bc1578a244b0fb138e0d995a7b4c6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:49.589449 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a990f6-997b-4f57-bb9c-6ea596db9619 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:49.590960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a7a990f6-997b-4f57-bb9c-6ea596db9619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:49.604089 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-85ad5f44-01aa-4fa0-b776-697ffe99ba80 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:49.605544 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-85ad5f44-01aa-4fa0-b776-697ffe99ba80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:49.683897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 932/1888] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:56:49.692559 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b0676-3c81-4c5e-af87-af2e34f2b07e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:49.693228 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b0676-3c81-4c5e-af87-af2e34f2b07e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:49.693228 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b0676-3c81-4c5e-af87-af2e34f2b07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:49.736181 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6a6b0676-3c81-4c5e-af87-af2e34f2b07e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:49.738332 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6a6b0676-3c81-4c5e-af87-af2e34f2b07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:49.742345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a990f6-997b-4f57-bb9c-6ea596db9619 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:49.755786 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcabd86-6abb-437d-ab95-2b5d07bcc153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:49.756526 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcabd86-6abb-437d-ab95-2b5d07bcc153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:49.757175 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcabd86-6abb-437d-ab95-2b5d07bcc153 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:49.757591 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcabd86-6abb-437d-ab95-2b5d07bcc153 admin admin] PATH_INFO: `/v3/users/2898bfe641704ebfb5e56c15d0f9439e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:49.763926 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcabd86-6abb-437d-ab95-2b5d07bcc153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2898bfe641704ebfb5e56c15d0f9439e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:49.764136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 933/1889] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:49.764221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcabd86-6abb-437d-ab95-2b5d07bcc153 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:49.765425 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b0676-3c81-4c5e-af87-af2e34f2b07e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:49.783148 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b0676-3c81-4c5e-af87-af2e34f2b07e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:49.797665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a065b-2d60-4323-b704-2baac7709b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:49.798406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a065b-2d60-4323-b704-2baac7709b34 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:49.798586 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a065b-2d60-4323-b704-2baac7709b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:49.798956 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a065b-2d60-4323-b704-2baac7709b34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:49.800612 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a065b-2d60-4323-b704-2baac7709b34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:56:49.800931 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a065b-2d60-4323-b704-2baac7709b34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:49.804015 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a065b-2d60-4323-b704-2baac7709b34 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:49.829394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 934/1890] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:56:49.834168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a065b-2d60-4323-b704-2baac7709b34 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:49.856765 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a065b-2d60-4323-b704-2baac7709b34 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:49.870511 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b2962-6516-42cc-97f6-a192bf384fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:49.871149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b2962-6516-42cc-97f6-a192bf384fcf admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:49.871550 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b2962-6516-42cc-97f6-a192bf384fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:49.871887 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b2962-6516-42cc-97f6-a192bf384fcf admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:49.873745 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b2962-6516-42cc-97f6-a192bf384fcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:49.875217 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b2962-6516-42cc-97f6-a192bf384fcf admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:49.889951 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8bcabd86-6abb-437d-ab95-2b5d07bcc153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2898bfe641704ebfb5e56c15d0f9439e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:49.901097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8bcabd86-6abb-437d-ab95-2b5d07bcc153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2898bfe641704ebfb5e56c15d0f9439e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:49.930666 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8bcabd86-6abb-437d-ab95-2b5d07bcc153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2898bfe641704ebfb5e56c15d0f9439e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:49.930891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8bcabd86-6abb-437d-ab95-2b5d07bcc153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2898bfe641704ebfb5e56c15d0f9439e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:49.931404 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8bcabd86-6abb-437d-ab95-2b5d07bcc153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2898bfe641704ebfb5e56c15d0f9439e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:49.938654 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 935/1891] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:49 2022] POST /identity/v3/projects => generated 361 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:49.941623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b2962-6516-42cc-97f6-a192bf384fcf admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:49.949604 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6e6b2962-6516-42cc-97f6-a192bf384fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:49.965730 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:49.971741 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 957/1892] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:49 2022] DELETE /identity/v3/users/2898bfe641704ebfb5e56c15d0f9439e => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:50.145843 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b2962-6516-42cc-97f6-a192bf384fcf admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:50.241863 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696128c4-757b-451e-be61-0ff9b44e91e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:50.242842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696128c4-757b-451e-be61-0ff9b44e91e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:50.243359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696128c4-757b-451e-be61-0ff9b44e91e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:50.243932 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696128c4-757b-451e-be61-0ff9b44e91e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:50.245366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696128c4-757b-451e-be61-0ff9b44e91e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:50.247728 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696128c4-757b-451e-be61-0ff9b44e91e9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:50.279879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcabd86-6abb-437d-ab95-2b5d07bcc153 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:50.280279 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 936/1893] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:49 2022] POST /identity/v3/users => generated 281 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:50.295036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcabd86-6abb-437d-ab95-2b5d07bcc153 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:50.312904 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b096e-5b2c-40cb-b8fd-a387f78554c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:50.313539 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b096e-5b2c-40cb-b8fd-a387f78554c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:50.313817 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b096e-5b2c-40cb-b8fd-a387f78554c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:50.314092 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b096e-5b2c-40cb-b8fd-a387f78554c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:50.314746 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b096e-5b2c-40cb-b8fd-a387f78554c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:50.316493 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b096e-5b2c-40cb-b8fd-a387f78554c1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:50.339112 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 958/1894] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:56:50.341094 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696128c4-757b-451e-be61-0ff9b44e91e9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:50.354148 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696128c4-757b-451e-be61-0ff9b44e91e9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:50.362329 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d2d74-dde1-4177-b2f0-cc661af3a096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:50.365817 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d2d74-dde1-4177-b2f0-cc661af3a096 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:50.366456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d2d74-dde1-4177-b2f0-cc661af3a096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:50.367179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d2d74-dde1-4177-b2f0-cc661af3a096 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:50.368232 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d2d74-dde1-4177-b2f0-cc661af3a096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:50.370032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d2d74-dde1-4177-b2f0-cc661af3a096 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:50.389880 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 937/1895] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:50.390223 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b096e-5b2c-40cb-b8fd-a387f78554c1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:50.413673 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b096e-5b2c-40cb-b8fd-a387f78554c1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:50.421375 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ea19e-968b-4b6d-b490-67d3cc0c2dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:50.422193 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ea19e-968b-4b6d-b490-67d3cc0c2dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:50.422481 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ea19e-968b-4b6d-b490-67d3cc0c2dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:50.422773 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ea19e-968b-4b6d-b490-67d3cc0c2dd4 admin admin] PATH_INFO: `/v3/projects/33290444a6894c7ea0034d161ec97a63/users/7b079edf27eb4b53b9bcaaf89d101ab6/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:50.469345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ea19e-968b-4b6d-b490-67d3cc0c2dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33290444a6894c7ea0034d161ec97a63, user_id=7b079edf27eb4b53b9bcaaf89d101ab6, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:50.474083 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485ea19e-968b-4b6d-b490-67d3cc0c2dd4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:50.492029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 959/1896] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:50 2022] PUT /identity/v3/projects/33290444a6894c7ea0034d161ec97a63/users/7b079edf27eb4b53b9bcaaf89d101ab6/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:50.501488 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b2feb-37de-47fc-81e4-f85f43c64b2d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:50.502019 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b2feb-37de-47fc-81e4-f85f43c64b2d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:50.504074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b2feb-37de-47fc-81e4-f85f43c64b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:50.539400 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1e0b2feb-37de-47fc-81e4-f85f43c64b2d None None] MFA Rules not processed for user `7b079edf27eb4b53b9bcaaf89d101ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:50.540850 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1e0b2feb-37de-47fc-81e4-f85f43c64b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:50.653522 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 938/1897] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:50.704217 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ea19e-968b-4b6d-b490-67d3cc0c2dd4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:50.704217 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-485ea19e-968b-4b6d-b490-67d3cc0c2dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:50.789770 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:50.808082 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485ea19e-968b-4b6d-b490-67d3cc0c2dd4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:50.811751 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678653c-a859-4b4a-bfef-e21a34c31785 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:50.813079 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678653c-a859-4b4a-bfef-e21a34c31785 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:50.813363 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678653c-a859-4b4a-bfef-e21a34c31785 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:50.813635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678653c-a859-4b4a-bfef-e21a34c31785 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:50.824118 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678653c-a859-4b4a-bfef-e21a34c31785 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:50.825233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678653c-a859-4b4a-bfef-e21a34c31785 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:50.835419 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 960/1898] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:50.858897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b2feb-37de-47fc-81e4-f85f43c64b2d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:50.883328 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:50.938011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b2feb-37de-47fc-81e4-f85f43c64b2d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:50.954543 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30a756-ecc9-4bb8-b517-64d6caab681e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:50.955241 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30a756-ecc9-4bb8-b517-64d6caab681e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:50.955535 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30a756-ecc9-4bb8-b517-64d6caab681e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:50.955794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30a756-ecc9-4bb8-b517-64d6caab681e admin admin] PATH_INFO: `/v3/users/7b079edf27eb4b53b9bcaaf89d101ab6` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:50.957704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30a756-ecc9-4bb8-b517-64d6caab681e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b079edf27eb4b53b9bcaaf89d101ab6)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:50.959780 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30a756-ecc9-4bb8-b517-64d6caab681e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:50.992801 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678653c-a859-4b4a-bfef-e21a34c31785 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:50.994498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4678653c-a859-4b4a-bfef-e21a34c31785 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:51.016167 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678653c-a859-4b4a-bfef-e21a34c31785 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:51.021772 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5f30a756-ecc9-4bb8-b517-64d6caab681e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b079edf27eb4b53b9bcaaf89d101ab6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:51.029369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273699a2-8d8a-4986-8816-da0bedb176c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:51.029960 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5f30a756-ecc9-4bb8-b517-64d6caab681e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b079edf27eb4b53b9bcaaf89d101ab6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:51.030075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273699a2-8d8a-4986-8816-da0bedb176c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:51.030302 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273699a2-8d8a-4986-8816-da0bedb176c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:51.030583 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273699a2-8d8a-4986-8816-da0bedb176c1 admin admin] PATH_INFO: `/v3/projects/10d394c110974b2eaa264f778ad9b44b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:51.031031 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5f30a756-ecc9-4bb8-b517-64d6caab681e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b079edf27eb4b53b9bcaaf89d101ab6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:51.031671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5f30a756-ecc9-4bb8-b517-64d6caab681e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b079edf27eb4b53b9bcaaf89d101ab6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:51.032195 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273699a2-8d8a-4986-8816-da0bedb176c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d394c110974b2eaa264f778ad9b44b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:51.034442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273699a2-8d8a-4986-8816-da0bedb176c1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:51.039511 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5f30a756-ecc9-4bb8-b517-64d6caab681e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b079edf27eb4b53b9bcaaf89d101ab6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:51.057600 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 939/1899] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:50 2022] DELETE /identity/v3/users/7b079edf27eb4b53b9bcaaf89d101ab6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:51.062144 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecf5d8-5fbb-4410-923e-1e6f3fa96476 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:51.062506 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecf5d8-5fbb-4410-923e-1e6f3fa96476 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:51.062811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecf5d8-5fbb-4410-923e-1e6f3fa96476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:51.084106 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3aecf5d8-5fbb-4410-923e-1e6f3fa96476 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:51.085345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3aecf5d8-5fbb-4410-923e-1e6f3fa96476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:51.085686 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-273699a2-8d8a-4986-8816-da0bedb176c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d394c110974b2eaa264f778ad9b44b', 'request_id': 'req-273699a2-8d8a-4986-8816-da0bedb176c1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:51.093752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-273699a2-8d8a-4986-8816-da0bedb176c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d394c110974b2eaa264f778ad9b44b', 'request_id': 'req-273699a2-8d8a-4986-8816-da0bedb176c1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:51.101531 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-273699a2-8d8a-4986-8816-da0bedb176c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d394c110974b2eaa264f778ad9b44b', 'request_id': 'req-273699a2-8d8a-4986-8816-da0bedb176c1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:51.113762 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-273699a2-8d8a-4986-8816-da0bedb176c1 admin admin] The token cache is being invalidate because project 10d394c110974b2eaa264f778ad9b44b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:51.114191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-273699a2-8d8a-4986-8816-da0bedb176c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:51.114954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-273699a2-8d8a-4986-8816-da0bedb176c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:51.116595 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 961/1900] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:50 2022] DELETE /identity/v3/projects/10d394c110974b2eaa264f778ad9b44b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:51.121226 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dff385-f933-4f0f-8938-6ff36b90755a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:51.121579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dff385-f933-4f0f-8938-6ff36b90755a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:51.121923 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dff385-f933-4f0f-8938-6ff36b90755a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:51.142555 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-37dff385-f933-4f0f-8938-6ff36b90755a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:51.144554 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-37dff385-f933-4f0f-8938-6ff36b90755a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:51.154932 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 940/1901] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:51.171430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecf5d8-5fbb-4410-923e-1e6f3fa96476 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:51.172906 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3aecf5d8-5fbb-4410-923e-1e6f3fa96476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:51.218143 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 962/1902] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:56:51.226678 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb6642-2ff6-418d-ae0d-bb42ffc0d154 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:51.227039 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb6642-2ff6-418d-ae0d-bb42ffc0d154 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:51.227323 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb6642-2ff6-418d-ae0d-bb42ffc0d154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:51.234859 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:51.248277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-efeb6642-2ff6-418d-ae0d-bb42ffc0d154 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:51.249656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-efeb6642-2ff6-418d-ae0d-bb42ffc0d154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:51.255595 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecf5d8-5fbb-4410-923e-1e6f3fa96476 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:51.259304 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaa8a0-f7d0-4e22-8ea6-7f95cc62ee7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:51.259929 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaa8a0-f7d0-4e22-8ea6-7f95cc62ee7c service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:51.260240 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaa8a0-f7d0-4e22-8ea6-7f95cc62ee7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:51.260519 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaa8a0-f7d0-4e22-8ea6-7f95cc62ee7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:51.263598 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 963/1903] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:56:51.267615 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb6642-2ff6-418d-ae0d-bb42ffc0d154 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:51.272502 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edaa8a0-f7d0-4e22-8ea6-7f95cc62ee7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:51.273962 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edaa8a0-f7d0-4e22-8ea6-7f95cc62ee7c service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:51.278995 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb6642-2ff6-418d-ae0d-bb42ffc0d154 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:51.289563 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a37fe-6560-4b64-9542-7f2fe2b41715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:51.289563 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a37fe-6560-4b64-9542-7f2fe2b41715 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:51.289563 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a37fe-6560-4b64-9542-7f2fe2b41715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:51.289563 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a37fe-6560-4b64-9542-7f2fe2b41715 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:51.290006 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a37fe-6560-4b64-9542-7f2fe2b41715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:56:51.290006 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a37fe-6560-4b64-9542-7f2fe2b41715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:51.290006 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a37fe-6560-4b64-9542-7f2fe2b41715 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:51.294059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 941/1904] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 20:56:51.308040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 964/1905] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:56:51.311072 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaa8a0-f7d0-4e22-8ea6-7f95cc62ee7c service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:51.324487 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaa8a0-f7d0-4e22-8ea6-7f95cc62ee7c service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:51.329366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b00128-1490-4d64-b935-35cc08098d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:51.329986 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b00128-1490-4d64-b935-35cc08098d02 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:51.330270 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b00128-1490-4d64-b935-35cc08098d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:51.330548 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b00128-1490-4d64-b935-35cc08098d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:51.331197 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b00128-1490-4d64-b935-35cc08098d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:51.333784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b00128-1490-4d64-b935-35cc08098d02 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:51.369824 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 942/1906] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:51 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:56:51.371031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a37fe-6560-4b64-9542-7f2fe2b41715 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:51.381475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a37fe-6560-4b64-9542-7f2fe2b41715 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:51.432631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:51.482094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1ae6f-abe6-467c-b1c3-f916772c7325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:51.483824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1ae6f-abe6-467c-b1c3-f916772c7325 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:51.484958 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1ae6f-abe6-467c-b1c3-f916772c7325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:51.484958 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1ae6f-abe6-467c-b1c3-f916772c7325 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:51.485164 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1ae6f-abe6-467c-b1c3-f916772c7325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:51.487286 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1ae6f-abe6-467c-b1c3-f916772c7325 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:51.516032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 965/1907] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:51 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:51.519914 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b00128-1490-4d64-b935-35cc08098d02 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:51.535441 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b00128-1490-4d64-b935-35cc08098d02 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:51.542111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d037f-bd0a-47ad-a550-9b96c3d34091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:51.542747 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d037f-bd0a-47ad-a550-9b96c3d34091 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:51.543228 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d037f-bd0a-47ad-a550-9b96c3d34091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:51.543641 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9d037f-bd0a-47ad-a550-9b96c3d34091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:51.544184 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d037f-bd0a-47ad-a550-9b96c3d34091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:51.546469 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9d037f-bd0a-47ad-a550-9b96c3d34091 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:51.565065 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 943/1908] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:51.570233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1ae6f-abe6-467c-b1c3-f916772c7325 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:51.589566 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1ae6f-abe6-467c-b1c3-f916772c7325 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:51.601696 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b3498-068e-44ef-af74-a202bf1d28dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:51.602393 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b3498-068e-44ef-af74-a202bf1d28dc admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:51.603193 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b3498-068e-44ef-af74-a202bf1d28dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:51.603484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b3498-068e-44ef-af74-a202bf1d28dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:51.604388 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b3498-068e-44ef-af74-a202bf1d28dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:51.607132 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b3498-068e-44ef-af74-a202bf1d28dc admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:51.650552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 966/1909] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:51.651180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d037f-bd0a-47ad-a550-9b96c3d34091 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:51.696768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9d037f-bd0a-47ad-a550-9b96c3d34091 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:51.701128 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504fbf3-a9b0-4729-b79b-dd85784c7197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:51.701994 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504fbf3-a9b0-4729-b79b-dd85784c7197 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:51.702734 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504fbf3-a9b0-4729-b79b-dd85784c7197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:51.702734 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504fbf3-a9b0-4729-b79b-dd85784c7197 admin admin] PATH_INFO: `/v3/projects/6dd015745e164cc1849d2b4c35da8212/users/2a1826ea1f864e68828b0f8f11201c42/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:51.728675 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504fbf3-a9b0-4729-b79b-dd85784c7197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dd015745e164cc1849d2b4c35da8212, user_id=2a1826ea1f864e68828b0f8f11201c42, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:51.732427 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504fbf3-a9b0-4729-b79b-dd85784c7197 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:51.759525 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 944/1910] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:51 2022] PUT /identity/v3/projects/6dd015745e164cc1849d2b4c35da8212/users/2a1826ea1f864e68828b0f8f11201c42/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:51.771164 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0c036-3b4a-4d6a-bc7a-c75c5cb7ed4d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:51.771459 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0c036-3b4a-4d6a-bc7a-c75c5cb7ed4d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:51.773380 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0c036-3b4a-4d6a-bc7a-c75c5cb7ed4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:51.840205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0cb0c036-3b4a-4d6a-bc7a-c75c5cb7ed4d None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:51.843391 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0cb0c036-3b4a-4d6a-bc7a-c75c5cb7ed4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:51.882806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504fbf3-a9b0-4729-b79b-dd85784c7197 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:51.884959 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b504fbf3-a9b0-4729-b79b-dd85784c7197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:52.024173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 967/1911] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:52.024173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0c036-3b4a-4d6a-bc7a-c75c5cb7ed4d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:52.025616 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0cb0c036-3b4a-4d6a-bc7a-c75c5cb7ed4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:52.038534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504fbf3-a9b0-4729-b79b-dd85784c7197 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:52.047587 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab546b-fc09-424d-ba59-f8cef547ebd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:52.048881 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab546b-fc09-424d-ba59-f8cef547ebd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:52.049494 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab546b-fc09-424d-ba59-f8cef547ebd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:52.049920 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab546b-fc09-424d-ba59-f8cef547ebd2 admin admin] PATH_INFO: `/v3/users/f4f57769d1b7400c8f850826e9c445d4` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:52.052245 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab546b-fc09-424d-ba59-f8cef547ebd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f57769d1b7400c8f850826e9c445d4)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:52.054678 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab546b-fc09-424d-ba59-f8cef547ebd2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:52.068672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0c036-3b4a-4d6a-bc7a-c75c5cb7ed4d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:52.084955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470439a-747e-40d5-b75b-1f704d802fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:52.086446 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470439a-747e-40d5-b75b-1f704d802fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:52.088425 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470439a-747e-40d5-b75b-1f704d802fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:52.091344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470439a-747e-40d5-b75b-1f704d802fe1 admin admin] PATH_INFO: `/v3/projects/33290444a6894c7ea0034d161ec97a63` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:52.093147 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470439a-747e-40d5-b75b-1f704d802fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33290444a6894c7ea0034d161ec97a63)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:52.100594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470439a-747e-40d5-b75b-1f704d802fe1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:52.166325 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a7ab546b-fc09-424d-ba59-f8cef547ebd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f57769d1b7400c8f850826e9c445d4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:52.177261 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a7ab546b-fc09-424d-ba59-f8cef547ebd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f57769d1b7400c8f850826e9c445d4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:52.180290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a7ab546b-fc09-424d-ba59-f8cef547ebd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f57769d1b7400c8f850826e9c445d4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:52.181060 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a7ab546b-fc09-424d-ba59-f8cef547ebd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f57769d1b7400c8f850826e9c445d4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:52.189718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a7ab546b-fc09-424d-ba59-f8cef547ebd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f57769d1b7400c8f850826e9c445d4'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:52.211113 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 945/1912] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:51 2022] DELETE /identity/v3/users/f4f57769d1b7400c8f850826e9c445d4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:52.211599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8470439a-747e-40d5-b75b-1f704d802fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33290444a6894c7ea0034d161ec97a63', 'request_id': 'req-8470439a-747e-40d5-b75b-1f704d802fe1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:52.211924 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab546b-fc09-424d-ba59-f8cef547ebd2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:52.216109 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a7ab546b-fc09-424d-ba59-f8cef547ebd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:52.220069 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8470439a-747e-40d5-b75b-1f704d802fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33290444a6894c7ea0034d161ec97a63', 'request_id': 'req-8470439a-747e-40d5-b75b-1f704d802fe1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:52.222353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:52.229158 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8470439a-747e-40d5-b75b-1f704d802fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33290444a6894c7ea0034d161ec97a63', 'request_id': 'req-8470439a-747e-40d5-b75b-1f704d802fe1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:52.241497 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8470439a-747e-40d5-b75b-1f704d802fe1 admin admin] The token cache is being invalidate because project 33290444a6894c7ea0034d161ec97a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:52.241787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8470439a-747e-40d5-b75b-1f704d802fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:52.242458 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8470439a-747e-40d5-b75b-1f704d802fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:52.247170 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 968/1913] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:52 2022] DELETE /identity/v3/projects/33290444a6894c7ea0034d161ec97a63 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:52.247170 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f0d6f-b080-4924-a5eb-9be16cf0ab04 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:52.247170 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f0d6f-b080-4924-a5eb-9be16cf0ab04 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:52.247170 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f0d6f-b080-4924-a5eb-9be16cf0ab04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:52.266064 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5b3f0d6f-b080-4924-a5eb-9be16cf0ab04 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:52.267306 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5b3f0d6f-b080-4924-a5eb-9be16cf0ab04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:52.289504 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab546b-fc09-424d-ba59-f8cef547ebd2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:52.293268 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdecedb-5953-4dfc-9cf3-1c13fd5720de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:52.293885 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdecedb-5953-4dfc-9cf3-1c13fd5720de service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:52.294160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdecedb-5953-4dfc-9cf3-1c13fd5720de service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:52.294434 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdecedb-5953-4dfc-9cf3-1c13fd5720de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:52.296422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7fdecedb-5953-4dfc-9cf3-1c13fd5720de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:52.312696 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:52.341655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 969/1914] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:52.341655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf3fdf-7c94-4fb3-95e9-00ffbd423db0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:52.341655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf3fdf-7c94-4fb3-95e9-00ffbd423db0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:52.341655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf3fdf-7c94-4fb3-95e9-00ffbd423db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:52.360682 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-82cf3fdf-7c94-4fb3-95e9-00ffbd423db0 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:52.361839 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-82cf3fdf-7c94-4fb3-95e9-00ffbd423db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:52.380257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 970/1915] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:52.380257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf3fdf-7c94-4fb3-95e9-00ffbd423db0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:52.380257 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-82cf3fdf-7c94-4fb3-95e9-00ffbd423db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:52.380554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdecedb-5953-4dfc-9cf3-1c13fd5720de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:52.380554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdecedb-5953-4dfc-9cf3-1c13fd5720de service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:52.391336 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 946/1916] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:52.392242 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf3fdf-7c94-4fb3-95e9-00ffbd423db0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:52.394205 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c975f-41bd-420b-8774-b682c2170bcc None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:52.394581 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c975f-41bd-420b-8774-b682c2170bcc None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:52.394934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c975f-41bd-420b-8774-b682c2170bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:52.397202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76b371-0c55-4b96-8238-fc4b901af543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:52.397900 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76b371-0c55-4b96-8238-fc4b901af543 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:52.398248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76b371-0c55-4b96-8238-fc4b901af543 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:52.398521 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76b371-0c55-4b96-8238-fc4b901af543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:52.411707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76b371-0c55-4b96-8238-fc4b901af543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:52.413549 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76b371-0c55-4b96-8238-fc4b901af543 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:52.420034 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fb6c975f-41bd-420b-8774-b682c2170bcc None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:52.421325 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fb6c975f-41bd-420b-8774-b682c2170bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:52.432031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 971/1917] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:52.432225 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 947/1918] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:52.437195 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76b371-0c55-4b96-8238-fc4b901af543 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:52.451249 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76b371-0c55-4b96-8238-fc4b901af543 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:52.457443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27984a3-a998-4f55-a88e-dc392baef96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:52.458075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27984a3-a998-4f55-a88e-dc392baef96d admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:52.458498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27984a3-a998-4f55-a88e-dc392baef96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:52.458775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27984a3-a998-4f55-a88e-dc392baef96d admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:52.459543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27984a3-a998-4f55-a88e-dc392baef96d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:56:52.459868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27984a3-a998-4f55-a88e-dc392baef96d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:52.461515 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27984a3-a998-4f55-a88e-dc392baef96d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:52.480037 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 972/1919] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:56:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:56:52.481781 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c975f-41bd-420b-8774-b682c2170bcc None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:52.500772 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c975f-41bd-420b-8774-b682c2170bcc None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:52.519580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c5ee3-2856-4983-bc64-8032235881fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:52.520251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5ee3-2856-4983-bc64-8032235881fc admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:52.524884 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5ee3-2856-4983-bc64-8032235881fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:52.525245 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c5ee3-2856-4983-bc64-8032235881fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:52.528034 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c5ee3-2856-4983-bc64-8032235881fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:52.538982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c5ee3-2856-4983-bc64-8032235881fc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:52.599629 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 948/1920] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:52 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:56:52.601014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27984a3-a998-4f55-a88e-dc392baef96d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:52.617548 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27984a3-a998-4f55-a88e-dc392baef96d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:52.700541 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad80c8-0383-46bb-8960-079c3592660c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:52.701895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad80c8-0383-46bb-8960-079c3592660c admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:52.702247 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad80c8-0383-46bb-8960-079c3592660c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:52.702467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad80c8-0383-46bb-8960-079c3592660c admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:52.703148 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad80c8-0383-46bb-8960-079c3592660c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:52.705573 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad80c8-0383-46bb-8960-079c3592660c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:52.736299 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c5ee3-2856-4983-bc64-8032235881fc admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:52.738043 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d72c5ee3-2856-4983-bc64-8032235881fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:52.749045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 973/1921] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:52 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:52.752712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad80c8-0383-46bb-8960-079c3592660c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:52.760347 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c5ee3-2856-4983-bc64-8032235881fc admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:52.769487 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf000202-09e6-408a-96f5-afa840c54b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:52.770162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000202-09e6-408a-96f5-afa840c54b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:52.770507 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000202-09e6-408a-96f5-afa840c54b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:52.770876 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf000202-09e6-408a-96f5-afa840c54b1f admin admin] PATH_INFO: `/v3/users/c3fd691866814593add2aa0ee6c2e094` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:52.771129 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad80c8-0383-46bb-8960-079c3592660c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:52.772250 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf000202-09e6-408a-96f5-afa840c54b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3fd691866814593add2aa0ee6c2e094)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:52.776470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf000202-09e6-408a-96f5-afa840c54b1f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:52.781935 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e41fa7-6073-47d3-ad93-09ba3f031b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:52.782590 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e41fa7-6073-47d3-ad93-09ba3f031b48 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:52.782876 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e41fa7-6073-47d3-ad93-09ba3f031b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:52.783909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e41fa7-6073-47d3-ad93-09ba3f031b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:52.785269 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e41fa7-6073-47d3-ad93-09ba3f031b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:52.787242 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e41fa7-6073-47d3-ad93-09ba3f031b48 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:52.813319 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 974/1922] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:52.817903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e41fa7-6073-47d3-ad93-09ba3f031b48 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:52.835242 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e41fa7-6073-47d3-ad93-09ba3f031b48 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:52.847591 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8a61c-803e-4f19-8889-a36ce8cef2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:52.849277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8a61c-803e-4f19-8889-a36ce8cef2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:52.849831 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8a61c-803e-4f19-8889-a36ce8cef2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:52.850305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8a61c-803e-4f19-8889-a36ce8cef2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:52.851462 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8a61c-803e-4f19-8889-a36ce8cef2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:52.853561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d8a61c-803e-4f19-8889-a36ce8cef2f3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:52.880351 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 975/1923] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:52.882098 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8a61c-803e-4f19-8889-a36ce8cef2f3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:52.898798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cf000202-09e6-408a-96f5-afa840c54b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3fd691866814593add2aa0ee6c2e094'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:52.903320 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8a61c-803e-4f19-8889-a36ce8cef2f3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:52.913828 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4868530-f008-4258-8610-8bf5eb94fee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:52.914778 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4868530-f008-4258-8610-8bf5eb94fee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:52.915268 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4868530-f008-4258-8610-8bf5eb94fee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:52.915688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4868530-f008-4258-8610-8bf5eb94fee2 admin admin] PATH_INFO: `/v3/projects/f7e85918030a481b8782ec0b0151613d/users/a07bee515b064f099dbcadb94437de0d/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:52.916071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cf000202-09e6-408a-96f5-afa840c54b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3fd691866814593add2aa0ee6c2e094'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:52.917995 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cf000202-09e6-408a-96f5-afa840c54b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3fd691866814593add2aa0ee6c2e094'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:52.920395 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cf000202-09e6-408a-96f5-afa840c54b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3fd691866814593add2aa0ee6c2e094'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:52.939641 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4868530-f008-4258-8610-8bf5eb94fee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7e85918030a481b8782ec0b0151613d, user_id=a07bee515b064f099dbcadb94437de0d, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:52.943677 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4868530-f008-4258-8610-8bf5eb94fee2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:52.948106 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cf000202-09e6-408a-96f5-afa840c54b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3fd691866814593add2aa0ee6c2e094'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:52.962637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 976/1924] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:52 2022] PUT /identity/v3/projects/f7e85918030a481b8782ec0b0151613d/users/a07bee515b064f099dbcadb94437de0d/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:52.968260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:52.974065 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4868530-f008-4258-8610-8bf5eb94fee2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:52.976826 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f4868530-f008-4258-8610-8bf5eb94fee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:52.990409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 949/1925] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:52 2022] DELETE /identity/v3/users/c3fd691866814593add2aa0ee6c2e094 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:52.992338 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d665a-185e-461a-aef5-06e01d3be75b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:52.993858 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d665a-185e-461a-aef5-06e01d3be75b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:52.994399 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d665a-185e-461a-aef5-06e01d3be75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:53.030532 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8b5d665a-185e-461a-aef5-06e01d3be75b None None] MFA Rules not processed for user `a07bee515b064f099dbcadb94437de0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:53.033563 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8b5d665a-185e-461a-aef5-06e01d3be75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:53.063625 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:53.076963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4868530-f008-4258-8610-8bf5eb94fee2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:53.150015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cafa22-dbe1-43b8-864e-9ff806525ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:53.150579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cafa22-dbe1-43b8-864e-9ff806525ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:53.150878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cafa22-dbe1-43b8-864e-9ff806525ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:53.151133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cafa22-dbe1-43b8-864e-9ff806525ff5 admin admin] PATH_INFO: `/v3/projects/4de62930c75943c38cc8f167899c24a7` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:53.152954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cafa22-dbe1-43b8-864e-9ff806525ff5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4de62930c75943c38cc8f167899c24a7)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:53.154873 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cafa22-dbe1-43b8-864e-9ff806525ff5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:53.158894 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 950/1926] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:53.161424 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a41bf3-d068-47c9-bf3e-20f1e56a512d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:53.161868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a41bf3-d068-47c9-bf3e-20f1e56a512d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:53.162314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a41bf3-d068-47c9-bf3e-20f1e56a512d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:53.211626 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-86a41bf3-d068-47c9-bf3e-20f1e56a512d None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:53.212895 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-86a41bf3-d068-47c9-bf3e-20f1e56a512d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:53.246261 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b8cafa22-dbe1-43b8-864e-9ff806525ff5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4de62930c75943c38cc8f167899c24a7', 'request_id': 'req-b8cafa22-dbe1-43b8-864e-9ff806525ff5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:53.272495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b8cafa22-dbe1-43b8-864e-9ff806525ff5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4de62930c75943c38cc8f167899c24a7', 'request_id': 'req-b8cafa22-dbe1-43b8-864e-9ff806525ff5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:53.290429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b8cafa22-dbe1-43b8-864e-9ff806525ff5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4de62930c75943c38cc8f167899c24a7', 'request_id': 'req-b8cafa22-dbe1-43b8-864e-9ff806525ff5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:53.337340 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b8cafa22-dbe1-43b8-864e-9ff806525ff5 admin admin] The token cache is being invalidate because project 4de62930c75943c38cc8f167899c24a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:53.341165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b8cafa22-dbe1-43b8-864e-9ff806525ff5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:53.342445 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b8cafa22-dbe1-43b8-864e-9ff806525ff5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:53.344411 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 977/1927] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:52 2022] DELETE /identity/v3/projects/4de62930c75943c38cc8f167899c24a7 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:53.345208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cafa22-dbe1-43b8-864e-9ff806525ff5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:53.350213 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b8cafa22-dbe1-43b8-864e-9ff806525ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:53.371548 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 951/1928] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:53.372617 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a41bf3-d068-47c9-bf3e-20f1e56a512d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:53.374446 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-86a41bf3-d068-47c9-bf3e-20f1e56a512d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:53.398579 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a41bf3-d068-47c9-bf3e-20f1e56a512d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:53.413528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19980c0e-e63d-48fd-9efc-f0706e8484c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:53.414302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19980c0e-e63d-48fd-9efc-f0706e8484c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:53.414590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19980c0e-e63d-48fd-9efc-f0706e8484c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:53.414868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19980c0e-e63d-48fd-9efc-f0706e8484c3 admin admin] PATH_INFO: `/v3/users/aba35c5d345c4d738b45e2bf9cef3414` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:53.416155 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19980c0e-e63d-48fd-9efc-f0706e8484c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba35c5d345c4d738b45e2bf9cef3414)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:53.418371 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19980c0e-e63d-48fd-9efc-f0706e8484c3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:53.462239 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cafa22-dbe1-43b8-864e-9ff806525ff5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:53.466881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261cc12-a00f-47ab-b26a-a8e7013f4751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:53.467518 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261cc12-a00f-47ab-b26a-a8e7013f4751 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:53.467908 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261cc12-a00f-47ab-b26a-a8e7013f4751 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:53.468403 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261cc12-a00f-47ab-b26a-a8e7013f4751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:53.470381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f261cc12-a00f-47ab-b26a-a8e7013f4751 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:53.495737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-19980c0e-e63d-48fd-9efc-f0706e8484c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba35c5d345c4d738b45e2bf9cef3414'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:53.507076 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-19980c0e-e63d-48fd-9efc-f0706e8484c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba35c5d345c4d738b45e2bf9cef3414'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:53.509771 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-19980c0e-e63d-48fd-9efc-f0706e8484c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba35c5d345c4d738b45e2bf9cef3414'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:53.512505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-19980c0e-e63d-48fd-9efc-f0706e8484c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba35c5d345c4d738b45e2bf9cef3414'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:53.536784 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:53.539175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-19980c0e-e63d-48fd-9efc-f0706e8484c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba35c5d345c4d738b45e2bf9cef3414'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:53.561806 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261cc12-a00f-47ab-b26a-a8e7013f4751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:53.563121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:53.563841 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261cc12-a00f-47ab-b26a-a8e7013f4751 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:53.576854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 952/1929] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:53 2022] DELETE /identity/v3/users/aba35c5d345c4d738b45e2bf9cef3414 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:53.576854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19980c0e-e63d-48fd-9efc-f0706e8484c3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:53.579902 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-19980c0e-e63d-48fd-9efc-f0706e8484c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:53.584927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 978/1930] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:53.736520 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19980c0e-e63d-48fd-9efc-f0706e8484c3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:53.750747 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fca16-794a-429b-958e-97b37d004d96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:53.751394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fca16-794a-429b-958e-97b37d004d96 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:53.751826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fca16-794a-429b-958e-97b37d004d96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:53.752152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fca16-794a-429b-958e-97b37d004d96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:53.756236 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-aa6fca16-794a-429b-958e-97b37d004d96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:53.798577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a6888-40f7-449b-a354-fc56c1a28518 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:53.798868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a6888-40f7-449b-a354-fc56c1a28518 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:53.799210 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a6888-40f7-449b-a354-fc56c1a28518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:53.861730 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e74a6888-40f7-449b-a354-fc56c1a28518 None None] MFA Rules not processed for user `2a1826ea1f864e68828b0f8f11201c42`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:53.876436 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e74a6888-40f7-449b-a354-fc56c1a28518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:53.892024 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fca16-794a-429b-958e-97b37d004d96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:53.893650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6fca16-794a-429b-958e-97b37d004d96 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:53.907928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 953/1931] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:54.057954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 979/1932] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:56:54.060685 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fca16-794a-429b-958e-97b37d004d96 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:54.062579 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-aa6fca16-794a-429b-958e-97b37d004d96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:54.087775 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fca16-794a-429b-958e-97b37d004d96 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:54.094329 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0e6ff-82ff-4840-a5fe-d9df86d12f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:54.094970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0e6ff-82ff-4840-a5fe-d9df86d12f57 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:54.095241 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0e6ff-82ff-4840-a5fe-d9df86d12f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:54.095520 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0e6ff-82ff-4840-a5fe-d9df86d12f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:54.096306 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0e6ff-82ff-4840-a5fe-d9df86d12f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:54.099303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0e6ff-82ff-4840-a5fe-d9df86d12f57 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:54.142291 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 954/1933] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:54 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:54.146208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a6888-40f7-449b-a354-fc56c1a28518 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:54.173784 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a6888-40f7-449b-a354-fc56c1a28518 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:54.279333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254e67b-71a8-4f58-bb40-6120393c0266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:54.280562 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254e67b-71a8-4f58-bb40-6120393c0266 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:54.280562 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254e67b-71a8-4f58-bb40-6120393c0266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:54.280735 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254e67b-71a8-4f58-bb40-6120393c0266 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:54.281258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254e67b-71a8-4f58-bb40-6120393c0266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:54.283489 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254e67b-71a8-4f58-bb40-6120393c0266 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:54.312316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 980/1934] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:54 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:54.317163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0e6ff-82ff-4840-a5fe-d9df86d12f57 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:54.330305 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0e6ff-82ff-4840-a5fe-d9df86d12f57 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:54.338450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc4d57-fcb7-4bf9-8079-8a1a763b9d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:54.339433 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc4d57-fcb7-4bf9-8079-8a1a763b9d25 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:54.343059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc4d57-fcb7-4bf9-8079-8a1a763b9d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:54.343059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc4d57-fcb7-4bf9-8079-8a1a763b9d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:54.343059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc4d57-fcb7-4bf9-8079-8a1a763b9d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:54.343059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc4d57-fcb7-4bf9-8079-8a1a763b9d25 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:54.346059 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254e67b-71a8-4f58-bb40-6120393c0266 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:54.350385 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2254e67b-71a8-4f58-bb40-6120393c0266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:54.360564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 955/1935] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:54.373497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc4d57-fcb7-4bf9-8079-8a1a763b9d25 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:54.373875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254e67b-71a8-4f58-bb40-6120393c0266 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:54.381370 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3b911-1211-4a41-850e-8e96afd27f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:54.382361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3b911-1211-4a41-850e-8e96afd27f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:54.382648 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3b911-1211-4a41-850e-8e96afd27f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:54.383111 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3b911-1211-4a41-850e-8e96afd27f19 admin admin] PATH_INFO: `/v3/projects/82f16b06e63a40109e0d383c828cf091` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:54.384306 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3b911-1211-4a41-850e-8e96afd27f19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82f16b06e63a40109e0d383c828cf091)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:54.386297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3b911-1211-4a41-850e-8e96afd27f19 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:54.395555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc4d57-fcb7-4bf9-8079-8a1a763b9d25 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:54.400631 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1dd68-7e2e-43e3-91c4-400dae75efc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:54.401332 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1dd68-7e2e-43e3-91c4-400dae75efc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:54.401605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1dd68-7e2e-43e3-91c4-400dae75efc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:54.401879 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba1dd68-7e2e-43e3-91c4-400dae75efc6 admin admin] PATH_INFO: `/v3/projects/5b91457ad5e5476b832f5eb0df616611/users/95dc0665b81a4179b087df25d37f1473/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:54.420499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1dd68-7e2e-43e3-91c4-400dae75efc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b91457ad5e5476b832f5eb0df616611, user_id=95dc0665b81a4179b087df25d37f1473, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:54.423394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba1dd68-7e2e-43e3-91c4-400dae75efc6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:54.439435 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 956/1936] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:54 2022] PUT /identity/v3/projects/5b91457ad5e5476b832f5eb0df616611/users/95dc0665b81a4179b087df25d37f1473/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:54.443895 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1dd68-7e2e-43e3-91c4-400dae75efc6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:54.453725 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-05e3b911-1211-4a41-850e-8e96afd27f19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82f16b06e63a40109e0d383c828cf091', 'request_id': 'req-05e3b911-1211-4a41-850e-8e96afd27f19'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:54.462491 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-05e3b911-1211-4a41-850e-8e96afd27f19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82f16b06e63a40109e0d383c828cf091', 'request_id': 'req-05e3b911-1211-4a41-850e-8e96afd27f19'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:54.464844 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:54.470936 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-05e3b911-1211-4a41-850e-8e96afd27f19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82f16b06e63a40109e0d383c828cf091', 'request_id': 'req-05e3b911-1211-4a41-850e-8e96afd27f19'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:54.489393 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-05e3b911-1211-4a41-850e-8e96afd27f19 admin admin] The token cache is being invalidate because project 82f16b06e63a40109e0d383c828cf091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:54.489685 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-05e3b911-1211-4a41-850e-8e96afd27f19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:54.491765 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-05e3b911-1211-4a41-850e-8e96afd27f19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:54.493356 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 981/1937] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:54 2022] DELETE /identity/v3/projects/82f16b06e63a40109e0d383c828cf091 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:54.497382 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3b911-1211-4a41-850e-8e96afd27f19 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:54.499877 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-05e3b911-1211-4a41-850e-8e96afd27f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:54.507380 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:54.521123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba1dd68-7e2e-43e3-91c4-400dae75efc6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:54.595675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3b911-1211-4a41-850e-8e96afd27f19 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:54.610075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4545b5e-a5b7-4c1b-aed8-7dac9a4dd207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:54.611619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4545b5e-a5b7-4c1b-aed8-7dac9a4dd207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:54.611939 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4545b5e-a5b7-4c1b-aed8-7dac9a4dd207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:54.612250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4545b5e-a5b7-4c1b-aed8-7dac9a4dd207 admin admin] PATH_INFO: `/v3/users/29ed3e1bd16c4fe8a1037ee97a6b8de9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:54.614802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4545b5e-a5b7-4c1b-aed8-7dac9a4dd207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29ed3e1bd16c4fe8a1037ee97a6b8de9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:54.617689 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4545b5e-a5b7-4c1b-aed8-7dac9a4dd207 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:54.656616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf19a8-04aa-4977-ba13-d605ca4b85c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:54.657378 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf19a8-04aa-4977-ba13-d605ca4b85c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:54.657914 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf19a8-04aa-4977-ba13-d605ca4b85c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:54.658110 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf19a8-04aa-4977-ba13-d605ca4b85c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:54.659210 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf19a8-04aa-4977-ba13-d605ca4b85c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:54.661607 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf19a8-04aa-4977-ba13-d605ca4b85c9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:54.686700 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 957/1938] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:56:54.692861 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf19a8-04aa-4977-ba13-d605ca4b85c9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:54.698748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-23bf19a8-04aa-4977-ba13-d605ca4b85c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:54.699954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b4545b5e-a5b7-4c1b-aed8-7dac9a4dd207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29ed3e1bd16c4fe8a1037ee97a6b8de9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:54.713909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b4545b5e-a5b7-4c1b-aed8-7dac9a4dd207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29ed3e1bd16c4fe8a1037ee97a6b8de9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:54.723854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf19a8-04aa-4977-ba13-d605ca4b85c9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:54.728987 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51b3b5-bfc9-4867-8a41-ee61e670abe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:54.729671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51b3b5-bfc9-4867-8a41-ee61e670abe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:54.729958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51b3b5-bfc9-4867-8a41-ee61e670abe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:54.730237 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51b3b5-bfc9-4867-8a41-ee61e670abe9 admin admin] PATH_INFO: `/v3/projects/5b91457ad5e5476b832f5eb0df616611/users/95dc0665b81a4179b087df25d37f1473/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:54.732490 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51b3b5-bfc9-4867-8a41-ee61e670abe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b91457ad5e5476b832f5eb0df616611, user_id=95dc0665b81a4179b087df25d37f1473, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:54.736066 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51b3b5-bfc9-4867-8a41-ee61e670abe9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:54.748279 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b4545b5e-a5b7-4c1b-aed8-7dac9a4dd207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29ed3e1bd16c4fe8a1037ee97a6b8de9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:54.750472 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b4545b5e-a5b7-4c1b-aed8-7dac9a4dd207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29ed3e1bd16c4fe8a1037ee97a6b8de9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:54.755158 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 958/1939] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:54 2022] PUT /identity/v3/projects/5b91457ad5e5476b832f5eb0df616611/users/95dc0665b81a4179b087df25d37f1473/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:54.755793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b4545b5e-a5b7-4c1b-aed8-7dac9a4dd207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29ed3e1bd16c4fe8a1037ee97a6b8de9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:54.776259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 982/1940] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:54 2022] DELETE /identity/v3/users/29ed3e1bd16c4fe8a1037ee97a6b8de9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:55.369048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51b3b5-bfc9-4867-8a41-ee61e670abe9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:55.371764 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ba51b3b5-bfc9-4867-8a41-ee61e670abe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:55.491668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51b3b5-bfc9-4867-8a41-ee61e670abe9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:55.560303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad7a92-3afb-4381-9ee3-fa56bc9522d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:55.560946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad7a92-3afb-4381-9ee3-fa56bc9522d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:55.561253 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad7a92-3afb-4381-9ee3-fa56bc9522d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:55.561527 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad7a92-3afb-4381-9ee3-fa56bc9522d7 admin admin] PATH_INFO: `/v3/projects/1390ba0886884bd690779dbf7e756668` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:55.562683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad7a92-3afb-4381-9ee3-fa56bc9522d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1390ba0886884bd690779dbf7e756668)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:55.564638 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad7a92-3afb-4381-9ee3-fa56bc9522d7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:55.607229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:55.633197 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ccad7a92-3afb-4381-9ee3-fa56bc9522d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1390ba0886884bd690779dbf7e756668', 'request_id': 'req-ccad7a92-3afb-4381-9ee3-fa56bc9522d7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:55.641866 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ccad7a92-3afb-4381-9ee3-fa56bc9522d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1390ba0886884bd690779dbf7e756668', 'request_id': 'req-ccad7a92-3afb-4381-9ee3-fa56bc9522d7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:55.649263 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ccad7a92-3afb-4381-9ee3-fa56bc9522d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1390ba0886884bd690779dbf7e756668', 'request_id': 'req-ccad7a92-3afb-4381-9ee3-fa56bc9522d7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:55.661453 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ccad7a92-3afb-4381-9ee3-fa56bc9522d7 admin admin] The token cache is being invalidate because project 1390ba0886884bd690779dbf7e756668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:55.662111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ccad7a92-3afb-4381-9ee3-fa56bc9522d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:55.662749 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ccad7a92-3afb-4381-9ee3-fa56bc9522d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:55.664411 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 959/1941] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:55 2022] DELETE /identity/v3/projects/1390ba0886884bd690779dbf7e756668 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:55.668745 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4545b5e-a5b7-4c1b-aed8-7dac9a4dd207 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:55.686748 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4545b5e-a5b7-4c1b-aed8-7dac9a4dd207 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:55.762837 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b303c40-a0d0-42c5-b2e8-bd4cab7154ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:55.763640 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b303c40-a0d0-42c5-b2e8-bd4cab7154ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:55.764110 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b303c40-a0d0-42c5-b2e8-bd4cab7154ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:55.764384 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b303c40-a0d0-42c5-b2e8-bd4cab7154ca admin admin] PATH_INFO: `/v3/users/cd42eaa2e8284a9f92c7ffe8078fb540` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:55.766293 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b303c40-a0d0-42c5-b2e8-bd4cab7154ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd42eaa2e8284a9f92c7ffe8078fb540)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:55.768872 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b303c40-a0d0-42c5-b2e8-bd4cab7154ca admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:55.781068 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:55.840226 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad7a92-3afb-4381-9ee3-fa56bc9522d7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:55.843128 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ccad7a92-3afb-4381-9ee3-fa56bc9522d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:55.869647 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad7a92-3afb-4381-9ee3-fa56bc9522d7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:55.877504 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d2bd7-b676-4c6d-939d-9d39836de3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:55.879097 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d2bd7-b676-4c6d-939d-9d39836de3bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:55.879635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d2bd7-b676-4c6d-939d-9d39836de3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:55.880017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d2bd7-b676-4c6d-939d-9d39836de3bb admin admin] PATH_INFO: `/v3/projects/9e4f1fbf06944f388ea60f8d29860ded` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:55.882025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d2bd7-b676-4c6d-939d-9d39836de3bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e4f1fbf06944f388ea60f8d29860ded)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:55.885191 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d2bd7-b676-4c6d-939d-9d39836de3bb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:55.887455 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9b303c40-a0d0-42c5-b2e8-bd4cab7154ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd42eaa2e8284a9f92c7ffe8078fb540'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:55.904511 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9b303c40-a0d0-42c5-b2e8-bd4cab7154ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd42eaa2e8284a9f92c7ffe8078fb540'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:55.930629 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9b303c40-a0d0-42c5-b2e8-bd4cab7154ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd42eaa2e8284a9f92c7ffe8078fb540'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:55.933353 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9b303c40-a0d0-42c5-b2e8-bd4cab7154ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd42eaa2e8284a9f92c7ffe8078fb540'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:55.934601 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9b303c40-a0d0-42c5-b2e8-bd4cab7154ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd42eaa2e8284a9f92c7ffe8078fb540'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:55.964140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3b7d2bd7-b676-4c6d-939d-9d39836de3bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e4f1fbf06944f388ea60f8d29860ded', 'request_id': 'req-3b7d2bd7-b676-4c6d-939d-9d39836de3bb'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:55.964362 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 983/1942] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:56:55 2022] DELETE /identity/v3/users/cd42eaa2e8284a9f92c7ffe8078fb540 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:55.974175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3b7d2bd7-b676-4c6d-939d-9d39836de3bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e4f1fbf06944f388ea60f8d29860ded', 'request_id': 'req-3b7d2bd7-b676-4c6d-939d-9d39836de3bb'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:55.983267 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3b7d2bd7-b676-4c6d-939d-9d39836de3bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e4f1fbf06944f388ea60f8d29860ded', 'request_id': 'req-3b7d2bd7-b676-4c6d-939d-9d39836de3bb'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:56.001292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3b7d2bd7-b676-4c6d-939d-9d39836de3bb admin admin] The token cache is being invalidate because project 9e4f1fbf06944f388ea60f8d29860ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:56.001292 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3b7d2bd7-b676-4c6d-939d-9d39836de3bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:56.002123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3b7d2bd7-b676-4c6d-939d-9d39836de3bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:56.009694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 960/1943] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:55 2022] DELETE /identity/v3/projects/9e4f1fbf06944f388ea60f8d29860ded => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:56.014262 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9e78b-5526-44d2-b626-7a07b1f87da4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:56.018159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9e78b-5526-44d2-b626-7a07b1f87da4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:56.018159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9e78b-5526-44d2-b626-7a07b1f87da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:56.052429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-72c9e78b-5526-44d2-b626-7a07b1f87da4 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:56.053677 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-72c9e78b-5526-44d2-b626-7a07b1f87da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:56.135737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 984/1944] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:56.144604 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bb0fb-6c8e-4857-96aa-b97e9462714b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:56.145208 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bb0fb-6c8e-4857-96aa-b97e9462714b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:56.145685 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bb0fb-6c8e-4857-96aa-b97e9462714b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:56.171540 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6c7bb0fb-6c8e-4857-96aa-b97e9462714b None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:56.172865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6c7bb0fb-6c8e-4857-96aa-b97e9462714b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:56.211198 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 961/1945] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:56.215156 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9e78b-5526-44d2-b626-7a07b1f87da4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:56.230892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9e78b-5526-44d2-b626-7a07b1f87da4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:56.235867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e02649-da2b-42cd-aeed-5e99183c449b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:56.237160 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e02649-da2b-42cd-aeed-5e99183c449b admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:56.238113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e02649-da2b-42cd-aeed-5e99183c449b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:56.238584 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e02649-da2b-42cd-aeed-5e99183c449b admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:56.239285 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e02649-da2b-42cd-aeed-5e99183c449b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:56:56.240291 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e02649-da2b-42cd-aeed-5e99183c449b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:56.242419 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e02649-da2b-42cd-aeed-5e99183c449b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:56.275776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bb0fb-6c8e-4857-96aa-b97e9462714b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:56.287141 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bb0fb-6c8e-4857-96aa-b97e9462714b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:56.288205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 985/1946] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:56:56.294336 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987bac50-ed6b-48f7-8da6-e6faba1828eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:56.295513 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987bac50-ed6b-48f7-8da6-e6faba1828eb admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:56.295953 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987bac50-ed6b-48f7-8da6-e6faba1828eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:56.296405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987bac50-ed6b-48f7-8da6-e6faba1828eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:56.297379 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987bac50-ed6b-48f7-8da6-e6faba1828eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:56.299882 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987bac50-ed6b-48f7-8da6-e6faba1828eb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:56.344613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e02649-da2b-42cd-aeed-5e99183c449b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:56.355833 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 962/1947] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:56 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:56.357435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e02649-da2b-42cd-aeed-5e99183c449b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:56.477804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987bac50-ed6b-48f7-8da6-e6faba1828eb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:56.479540 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-987bac50-ed6b-48f7-8da6-e6faba1828eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:56.504815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403fe53-7b8a-47a7-93ab-f3534519edd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:56.505454 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403fe53-7b8a-47a7-93ab-f3534519edd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:56.505734 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403fe53-7b8a-47a7-93ab-f3534519edd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:56.506006 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403fe53-7b8a-47a7-93ab-f3534519edd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:56.515014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403fe53-7b8a-47a7-93ab-f3534519edd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:56.520278 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987bac50-ed6b-48f7-8da6-e6faba1828eb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:56.521480 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403fe53-7b8a-47a7-93ab-f3534519edd3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:56.536716 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345eccd-7f6b-4273-a6c9-137f03452f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:56.541711 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345eccd-7f6b-4273-a6c9-137f03452f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:56.542140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345eccd-7f6b-4273-a6c9-137f03452f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:56.542299 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345eccd-7f6b-4273-a6c9-137f03452f57 admin admin] PATH_INFO: `/v3/projects/7767d18128554c008e6f57f5e7e8f47b` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:56.544973 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345eccd-7f6b-4273-a6c9-137f03452f57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7767d18128554c008e6f57f5e7e8f47b)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:56.549505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2345eccd-7f6b-4273-a6c9-137f03452f57 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:56.600640 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 986/1948] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:56 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:56.601587 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403fe53-7b8a-47a7-93ab-f3534519edd3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:56.613130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:56.629349 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403fe53-7b8a-47a7-93ab-f3534519edd3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:56.646019 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848909f6-fbcd-4e8e-bee9-49b9a3c9a16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:56.646872 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848909f6-fbcd-4e8e-bee9-49b9a3c9a16f admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:56.646872 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848909f6-fbcd-4e8e-bee9-49b9a3c9a16f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:56.647159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848909f6-fbcd-4e8e-bee9-49b9a3c9a16f admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:56.647810 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848909f6-fbcd-4e8e-bee9-49b9a3c9a16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:56.649444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848909f6-fbcd-4e8e-bee9-49b9a3c9a16f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:56.679584 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 987/1949] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:56.681278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848909f6-fbcd-4e8e-bee9-49b9a3c9a16f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:56.706050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848909f6-fbcd-4e8e-bee9-49b9a3c9a16f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:56.721005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b667482-48f4-4c90-ab05-017392cb7d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:56.722415 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b667482-48f4-4c90-ab05-017392cb7d68 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:56.725338 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b667482-48f4-4c90-ab05-017392cb7d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:56.725832 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b667482-48f4-4c90-ab05-017392cb7d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:56.727790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b667482-48f4-4c90-ab05-017392cb7d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:56.732392 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b667482-48f4-4c90-ab05-017392cb7d68 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:56.735490 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2345eccd-7f6b-4273-a6c9-137f03452f57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7767d18128554c008e6f57f5e7e8f47b', 'request_id': 'req-2345eccd-7f6b-4273-a6c9-137f03452f57'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:56.752234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2345eccd-7f6b-4273-a6c9-137f03452f57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7767d18128554c008e6f57f5e7e8f47b', 'request_id': 'req-2345eccd-7f6b-4273-a6c9-137f03452f57'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:56.752633 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 988/1950] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:56.754029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b667482-48f4-4c90-ab05-017392cb7d68 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:56.761208 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2345eccd-7f6b-4273-a6c9-137f03452f57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7767d18128554c008e6f57f5e7e8f47b', 'request_id': 'req-2345eccd-7f6b-4273-a6c9-137f03452f57'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:56.764082 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=77,keystone:DELETE=19,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:56.772559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b667482-48f4-4c90-ab05-017392cb7d68 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:56.787840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2345eccd-7f6b-4273-a6c9-137f03452f57 admin admin] The token cache is being invalidate because project 7767d18128554c008e6f57f5e7e8f47b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:56:56.788162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2345eccd-7f6b-4273-a6c9-137f03452f57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:56.789691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2345eccd-7f6b-4273-a6c9-137f03452f57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:56:56.791352 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 963/1951] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:56:56 2022] DELETE /identity/v3/projects/7767d18128554c008e6f57f5e7e8f47b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:56.796352 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b839b0-e47e-45c0-bbfa-b252eed1f5aa None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:56.796649 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b839b0-e47e-45c0-bbfa-b252eed1f5aa None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:56.797232 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b839b0-e47e-45c0-bbfa-b252eed1f5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:56.836803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b7b839b0-e47e-45c0-bbfa-b252eed1f5aa None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:56.838593 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b7b839b0-e47e-45c0-bbfa-b252eed1f5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:56.892009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00fdbc-f591-47a3-af03-c59a44669921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:56.893228 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00fdbc-f591-47a3-af03-c59a44669921 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:56.894348 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00fdbc-f591-47a3-af03-c59a44669921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:56.894731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00fdbc-f591-47a3-af03-c59a44669921 admin admin] PATH_INFO: `/v3/projects/936e5c86fb3245b596d682b97b3b8114/users/46963b5bb7084c769bf08387abbb92ec/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:56.913611 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00fdbc-f591-47a3-af03-c59a44669921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936e5c86fb3245b596d682b97b3b8114, user_id=46963b5bb7084c769bf08387abbb92ec, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:56.916361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00fdbc-f591-47a3-af03-c59a44669921 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:56.929599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 964/1952] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:56.932234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 989/1953] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:56 2022] PUT /identity/v3/projects/936e5c86fb3245b596d682b97b3b8114/users/46963b5bb7084c769bf08387abbb92ec/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:56.937416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435bc54f-e08f-4061-b883-26103182bdcf None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:56.937699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435bc54f-e08f-4061-b883-26103182bdcf None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:56.937971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435bc54f-e08f-4061-b883-26103182bdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:56.945283 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e8ec9-95c8-434d-817f-3e80bc288a42 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:56.945574 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e8ec9-95c8-434d-817f-3e80bc288a42 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:56.947370 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016e8ec9-95c8-434d-817f-3e80bc288a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:56.963364 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-435bc54f-e08f-4061-b883-26103182bdcf None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:56.965882 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-435bc54f-e08f-4061-b883-26103182bdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:56.983374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-016e8ec9-95c8-434d-817f-3e80bc288a42 None None] MFA Rules not processed for user `46963b5bb7084c769bf08387abbb92ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:56.984721 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-016e8ec9-95c8-434d-817f-3e80bc288a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:57.056079 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 965/1954] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:56:57.057593 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1fd84-9b6e-400f-ac32-60e92de6d854 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:57.063411 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1fd84-9b6e-400f-ac32-60e92de6d854 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:57.064353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c1fd84-9b6e-400f-ac32-60e92de6d854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:57.078960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 990/1955] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:56:57.079848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e8ec9-95c8-434d-817f-3e80bc288a42 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:57.100034 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016e8ec9-95c8-434d-817f-3e80bc288a42 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:57.110396 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb20a33-f476-46df-acce-68e530a09b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:57.111701 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb20a33-f476-46df-acce-68e530a09b19 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:57.112220 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb20a33-f476-46df-acce-68e530a09b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:57.113660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb20a33-f476-46df-acce-68e530a09b19 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:57.114755 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb20a33-f476-46df-acce-68e530a09b19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:56:57.115274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb20a33-f476-46df-acce-68e530a09b19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:57.118002 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb20a33-f476-46df-acce-68e530a09b19 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:57.141045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 991/1956] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:56:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:56:57.145639 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb20a33-f476-46df-acce-68e530a09b19 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:57.148037 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-12c1fd84-9b6e-400f-ac32-60e92de6d854 None None] MFA Rules not processed for user `95dc0665b81a4179b087df25d37f1473`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:57.149120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7eb20a33-f476-46df-acce-68e530a09b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:57.149337 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-12c1fd84-9b6e-400f-ac32-60e92de6d854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:57.168145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb20a33-f476-46df-acce-68e530a09b19 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:57.174638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a84a5f-3900-4ddd-ac86-96fbbdd97e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:57.176535 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a84a5f-3900-4ddd-ac86-96fbbdd97e7a admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:57.177044 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a84a5f-3900-4ddd-ac86-96fbbdd97e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:57.177588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a84a5f-3900-4ddd-ac86-96fbbdd97e7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:57.178438 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a84a5f-3900-4ddd-ac86-96fbbdd97e7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:57.181739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a84a5f-3900-4ddd-ac86-96fbbdd97e7a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:57.231706 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 992/1957] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:57 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:57.232702 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a84a5f-3900-4ddd-ac86-96fbbdd97e7a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:57.277313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 966/1958] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:57.277313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1fd84-9b6e-400f-ac32-60e92de6d854 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:57.287175 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:57.291906 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c1fd84-9b6e-400f-ac32-60e92de6d854 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:57.327004 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:57.370969 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a84a5f-3900-4ddd-ac86-96fbbdd97e7a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:57.375777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f7ca6-d060-4984-8d93-7fae8fceeaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:57.377194 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f7ca6-d060-4984-8d93-7fae8fceeaa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:57.377194 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f7ca6-d060-4984-8d93-7fae8fceeaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:57.377436 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f7ca6-d060-4984-8d93-7fae8fceeaa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:57.378456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f7ca6-d060-4984-8d93-7fae8fceeaa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:57.381460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f7ca6-d060-4984-8d93-7fae8fceeaa4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:57.403320 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fbc44-2730-4100-932f-77e125958d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:57.403946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fbc44-2730-4100-932f-77e125958d08 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:57.404275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fbc44-2730-4100-932f-77e125958d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:57.404559 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fbc44-2730-4100-932f-77e125958d08 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:57.405205 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fbc44-2730-4100-932f-77e125958d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:57.407169 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fbc44-2730-4100-932f-77e125958d08 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:57.420297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 993/1959] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:57 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:57.422010 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4523d99-7ed1-4671-a799-e4a47f82b68d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:57.422448 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4523d99-7ed1-4671-a799-e4a47f82b68d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:57.422948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4523d99-7ed1-4671-a799-e4a47f82b68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:57.445953 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 967/1960] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:57 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:57.445953 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fbc44-2730-4100-932f-77e125958d08 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:57.456988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a4523d99-7ed1-4671-a799-e4a47f82b68d None None] MFA Rules not processed for user `2a1826ea1f864e68828b0f8f11201c42`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:57.458573 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a4523d99-7ed1-4671-a799-e4a47f82b68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:57.480839 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fbc44-2730-4100-932f-77e125958d08 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:57.548483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 994/1961] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:57.548483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4523d99-7ed1-4671-a799-e4a47f82b68d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:57.584797 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7277d76-ab21-4148-8cae-3e9103cfe2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:57.585668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7277d76-ab21-4148-8cae-3e9103cfe2de admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:57.585951 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7277d76-ab21-4148-8cae-3e9103cfe2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:57.586225 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7277d76-ab21-4148-8cae-3e9103cfe2de admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:57.586919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7277d76-ab21-4148-8cae-3e9103cfe2de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:57.590118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7277d76-ab21-4148-8cae-3e9103cfe2de admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:57.627132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 968/1962] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:57 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:57.627132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7277d76-ab21-4148-8cae-3e9103cfe2de admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:57.627132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d7277d76-ab21-4148-8cae-3e9103cfe2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:57.640132 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4523d99-7ed1-4671-a799-e4a47f82b68d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:57.647508 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3513c-ad8e-4773-9dca-2bd5050fe780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:57.648163 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3513c-ad8e-4773-9dca-2bd5050fe780 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:57.648433 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3513c-ad8e-4773-9dca-2bd5050fe780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:57.648706 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3513c-ad8e-4773-9dca-2bd5050fe780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:57.649354 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3513c-ad8e-4773-9dca-2bd5050fe780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:57.650959 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3513c-ad8e-4773-9dca-2bd5050fe780 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:57.664782 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 995/1963] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:57.666345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3513c-ad8e-4773-9dca-2bd5050fe780 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:57.679793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3513c-ad8e-4773-9dca-2bd5050fe780 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:57.685885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e87d2-a840-4c78-b108-e10eef472db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:57.686958 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e87d2-a840-4c78-b108-e10eef472db7 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:57.686958 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e87d2-a840-4c78-b108-e10eef472db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:57.687138 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e87d2-a840-4c78-b108-e10eef472db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:57.687633 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e87d2-a840-4c78-b108-e10eef472db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:57.689536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e87d2-a840-4c78-b108-e10eef472db7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:57.712414 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 996/1964] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:57.713558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e87d2-a840-4c78-b108-e10eef472db7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:57.726383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7277d76-ab21-4148-8cae-3e9103cfe2de admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:57.726549 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e87d2-a840-4c78-b108-e10eef472db7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:57.733831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41e7f7-4e54-45f3-a9f9-dacefd001832 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:57.734602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41e7f7-4e54-45f3-a9f9-dacefd001832 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:57.735551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41e7f7-4e54-45f3-a9f9-dacefd001832 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:57.735551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41e7f7-4e54-45f3-a9f9-dacefd001832 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:57.738331 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fb41e7f7-4e54-45f3-a9f9-dacefd001832 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:57.739259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55456629-eee9-46d9-af75-cfde59777961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:57.743819 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55456629-eee9-46d9-af75-cfde59777961 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:57.744150 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55456629-eee9-46d9-af75-cfde59777961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:57.744442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55456629-eee9-46d9-af75-cfde59777961 admin admin] PATH_INFO: `/v3/projects/e7e1c82381994309853d16dd90b3ad34/users/9ae1126faa6845bca21dfa7ab8ab3780/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:57.753740 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41e7f7-4e54-45f3-a9f9-dacefd001832 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:57.755675 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41e7f7-4e54-45f3-a9f9-dacefd001832 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:57.768316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55456629-eee9-46d9-af75-cfde59777961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e1c82381994309853d16dd90b3ad34, user_id=9ae1126faa6845bca21dfa7ab8ab3780, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:57.772614 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55456629-eee9-46d9-af75-cfde59777961 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:57.784648 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 969/1965] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:57.786222 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41e7f7-4e54-45f3-a9f9-dacefd001832 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:57.795495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 997/1966] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:57 2022] PUT /identity/v3/projects/e7e1c82381994309853d16dd90b3ad34/users/9ae1126faa6845bca21dfa7ab8ab3780/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:57.799676 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55456629-eee9-46d9-af75-cfde59777961 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:57.809199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41e7f7-4e54-45f3-a9f9-dacefd001832 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:57.812656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:57.896186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:57.922708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55456629-eee9-46d9-af75-cfde59777961 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:57.928508 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc097f5c-3ca0-4b18-9525-09ad8deb9df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:57.929274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc097f5c-3ca0-4b18-9525-09ad8deb9df2 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:57.929614 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc097f5c-3ca0-4b18-9525-09ad8deb9df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:57.929895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc097f5c-3ca0-4b18-9525-09ad8deb9df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:57.930883 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc097f5c-3ca0-4b18-9525-09ad8deb9df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:57.932714 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc097f5c-3ca0-4b18-9525-09ad8deb9df2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:57.946008 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 998/1967] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:56:57.951464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc097f5c-3ca0-4b18-9525-09ad8deb9df2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:57.966876 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580c36a-e184-49d2-bb32-b869826befe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:57.968174 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580c36a-e184-49d2-bb32-b869826befe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:57.968752 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580c36a-e184-49d2-bb32-b869826befe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:57.969262 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e580c36a-e184-49d2-bb32-b869826befe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:57.970064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580c36a-e184-49d2-bb32-b869826befe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:57.972429 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e580c36a-e184-49d2-bb32-b869826befe6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:57.973007 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc097f5c-3ca0-4b18-9525-09ad8deb9df2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:57.984813 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc5a02-277b-4a7d-80c4-0a7449aaa668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:57.985535 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc5a02-277b-4a7d-80c4-0a7449aaa668 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:57.985903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc5a02-277b-4a7d-80c4-0a7449aaa668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:57.986184 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc5a02-277b-4a7d-80c4-0a7449aaa668 admin admin] PATH_INFO: `/v3/projects/e7e1c82381994309853d16dd90b3ad34/users/9ae1126faa6845bca21dfa7ab8ab3780/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:57.988890 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc5a02-277b-4a7d-80c4-0a7449aaa668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e1c82381994309853d16dd90b3ad34, user_id=9ae1126faa6845bca21dfa7ab8ab3780, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:57.992069 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 970/1968] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:57.995273 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc5a02-277b-4a7d-80c4-0a7449aaa668 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:57.997162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580c36a-e184-49d2-bb32-b869826befe6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:58.012414 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e580c36a-e184-49d2-bb32-b869826befe6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:58.038287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 999/1969] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:57 2022] PUT /identity/v3/projects/e7e1c82381994309853d16dd90b3ad34/users/9ae1126faa6845bca21dfa7ab8ab3780/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:56:58.048700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85955f-8caa-442d-89d0-dc102abae468 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:58.049178 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85955f-8caa-442d-89d0-dc102abae468 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:58.049659 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85955f-8caa-442d-89d0-dc102abae468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:58.134031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7f85955f-8caa-442d-89d0-dc102abae468 None None] MFA Rules not processed for user `9ae1126faa6845bca21dfa7ab8ab3780`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:58.135326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7f85955f-8caa-442d-89d0-dc102abae468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:58.179183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc6854b-fe4a-420e-95ae-13f29e08321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:58.180116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6854b-fe4a-420e-95ae-13f29e08321b admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:58.180406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6854b-fe4a-420e-95ae-13f29e08321b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:58.180684 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc6854b-fe4a-420e-95ae-13f29e08321b admin admin] PATH_INFO: `/v3/projects/02a674a005594700b4d0d8e171e0f103/users/25e59048ab474a6b8fe4c390524dd574/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:58.202541 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6854b-fe4a-420e-95ae-13f29e08321b admin admin] RBAC: Authorizing `identity:create_grant(project_id=02a674a005594700b4d0d8e171e0f103, user_id=25e59048ab474a6b8fe4c390524dd574, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:58.206588 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc6854b-fe4a-420e-95ae-13f29e08321b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:58.226059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 971/1970] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:57 2022] PUT /identity/v3/projects/02a674a005594700b4d0d8e171e0f103/users/25e59048ab474a6b8fe4c390524dd574/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:58.236355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1000/1971] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:56:58.239285 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c0670-83b5-4f23-bb53-b3804d377c38 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:58.239576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c0670-83b5-4f23-bb53-b3804d377c38 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:58.239856 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c0670-83b5-4f23-bb53-b3804d377c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:58.258050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85955f-8caa-442d-89d0-dc102abae468 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:58.260450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7f85955f-8caa-442d-89d0-dc102abae468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:58.277820 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-367c0670-83b5-4f23-bb53-b3804d377c38 None None] MFA Rules not processed for user `25e59048ab474a6b8fe4c390524dd574`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:58.280014 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-367c0670-83b5-4f23-bb53-b3804d377c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:58.354302 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85955f-8caa-442d-89d0-dc102abae468 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:58.414401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 972/1972] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:58.415378 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c0670-83b5-4f23-bb53-b3804d377c38 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:58.416118 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:58.447280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dfe97-85d4-46f4-85ff-32c39cdcd45c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:58.448386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dfe97-85d4-46f4-85ff-32c39cdcd45c service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:58.448770 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dfe97-85d4-46f4-85ff-32c39cdcd45c service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:58.450230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37dfe97-85d4-46f4-85ff-32c39cdcd45c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:58.527719 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:58.591187 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c0670-83b5-4f23-bb53-b3804d377c38 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:58.616814 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e5ce7-5857-4c69-ab0b-906acd223d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:58.617404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e5ce7-5857-4c69-ab0b-906acd223d91 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:58.618904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e5ce7-5857-4c69-ab0b-906acd223d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:58.619195 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e5ce7-5857-4c69-ab0b-906acd223d91 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:58.620066 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e5ce7-5857-4c69-ab0b-906acd223d91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:58.623817 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e5ce7-5857-4c69-ab0b-906acd223d91 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:58.714409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 973/1973] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:56:58 2022] POST /identity/v3/projects => generated 383 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:58.719572 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37dfe97-85d4-46f4-85ff-32c39cdcd45c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:58.722375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e5ce7-5857-4c69-ab0b-906acd223d91 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:58.723627 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37dfe97-85d4-46f4-85ff-32c39cdcd45c service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:58.750159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1001/1974] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:56:58.928037 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e5ce7-5857-4c69-ab0b-906acd223d91 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:58.943656 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bee348-6f5b-415f-a6ac-534ce4b69ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:58.944322 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bee348-6f5b-415f-a6ac-534ce4b69ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:58.944606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bee348-6f5b-415f-a6ac-534ce4b69ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:58.944881 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bee348-6f5b-415f-a6ac-534ce4b69ba4 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:58.945991 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bee348-6f5b-415f-a6ac-534ce4b69ba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:58.947463 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bee348-6f5b-415f-a6ac-534ce4b69ba4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:59.003767 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 974/1975] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:56:58 2022] POST /identity/v3/users => generated 298 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:56:59.007886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dfe97-85d4-46f4-85ff-32c39cdcd45c service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:59.027057 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37dfe97-85d4-46f4-85ff-32c39cdcd45c service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:59.032739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e6177-b207-4583-83e3-5600e0f6c795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:59.033245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e6177-b207-4583-83e3-5600e0f6c795 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:59.033788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e6177-b207-4583-83e3-5600e0f6c795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:59.034065 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e6177-b207-4583-83e3-5600e0f6c795 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:59.035939 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e6177-b207-4583-83e3-5600e0f6c795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:59.038193 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e6177-b207-4583-83e3-5600e0f6c795 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:59.063754 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1002/1976] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:59.065987 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bee348-6f5b-415f-a6ac-534ce4b69ba4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:59.103815 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bee348-6f5b-415f-a6ac-534ce4b69ba4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:59.127450 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0fad5-4763-4c07-b3ae-42670b2fb7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:59.128602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0fad5-4763-4c07-b3ae-42670b2fb7f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:59.129155 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0fad5-4763-4c07-b3ae-42670b2fb7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:59.129437 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0fad5-4763-4c07-b3ae-42670b2fb7f3 admin admin] PATH_INFO: `/v3/projects/58c401643627438bbed891669cc0e4c0/users/39f41cbe26414027827782201182f388/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:59.172097 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0fad5-4763-4c07-b3ae-42670b2fb7f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c401643627438bbed891669cc0e4c0, user_id=39f41cbe26414027827782201182f388, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:59.177308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0fad5-4763-4c07-b3ae-42670b2fb7f3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:59.195928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 975/1977] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:59 2022] PUT /identity/v3/projects/58c401643627438bbed891669cc0e4c0/users/39f41cbe26414027827782201182f388/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:59.199932 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e6177-b207-4583-83e3-5600e0f6c795 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:59.213874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e6177-b207-4583-83e3-5600e0f6c795 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:59.379651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84100aa-7adf-4d51-879d-4c7fa5d9b554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:59.380255 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84100aa-7adf-4d51-879d-4c7fa5d9b554 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:59.380537 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84100aa-7adf-4d51-879d-4c7fa5d9b554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:59.380817 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84100aa-7adf-4d51-879d-4c7fa5d9b554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:59.381484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84100aa-7adf-4d51-879d-4c7fa5d9b554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:59.383109 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84100aa-7adf-4d51-879d-4c7fa5d9b554 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:59.417656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1003/1978] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:56:59.419505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0fad5-4763-4c07-b3ae-42670b2fb7f3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:59.445699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0fad5-4763-4c07-b3ae-42670b2fb7f3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:59.452922 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f151c-a5c9-4da6-8e9f-41f52361bdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:59.454233 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f151c-a5c9-4da6-8e9f-41f52361bdcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:59.454724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f151c-a5c9-4da6-8e9f-41f52361bdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:59.455012 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f151c-a5c9-4da6-8e9f-41f52361bdcc admin admin] PATH_INFO: `/v3/projects/58c401643627438bbed891669cc0e4c0/users/39f41cbe26414027827782201182f388/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:59.459397 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f151c-a5c9-4da6-8e9f-41f52361bdcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=58c401643627438bbed891669cc0e4c0, user_id=39f41cbe26414027827782201182f388, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:59.464815 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f151c-a5c9-4da6-8e9f-41f52361bdcc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:59.498594 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 976/1979] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:56:59 2022] PUT /identity/v3/projects/58c401643627438bbed891669cc0e4c0/users/39f41cbe26414027827782201182f388/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:56:59.510785 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6ea01-c7cd-4667-8a45-704587e937a1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:59.511408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6ea01-c7cd-4667-8a45-704587e937a1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:59.512012 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6ea01-c7cd-4667-8a45-704587e937a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:59.578570 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e2d6ea01-c7cd-4667-8a45-704587e937a1 None None] MFA Rules not processed for user `39f41cbe26414027827782201182f388`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:56:59.580387 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e2d6ea01-c7cd-4667-8a45-704587e937a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:59.741760 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:59.785249 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1004/1980] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:56:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:56:59.819591 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f151c-a5c9-4da6-8e9f-41f52361bdcc admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:56:59.821389 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5a8f151c-a5c9-4da6-8e9f-41f52361bdcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:56:59.904874 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f151c-a5c9-4da6-8e9f-41f52361bdcc admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:56:59.909533 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80306dd1-28c4-4b1a-8519-7d9fd80b6f9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:56:59.911085 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80306dd1-28c4-4b1a-8519-7d9fd80b6f9e service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:56:59.911434 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80306dd1-28c4-4b1a-8519-7d9fd80b6f9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:56:59.911827 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80306dd1-28c4-4b1a-8519-7d9fd80b6f9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:56:59.944112 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:56:59.982070 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80306dd1-28c4-4b1a-8519-7d9fd80b6f9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:56:59.983745 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80306dd1-28c4-4b1a-8519-7d9fd80b6f9e service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:56:59.994824 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 977/1981] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:56:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:00.485383 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6ea01-c7cd-4667-8a45-704587e937a1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:00.563526 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6ea01-c7cd-4667-8a45-704587e937a1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:00.568925 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e071b9-fdde-4b44-bc8d-8772a1452647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:00.569788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e071b9-fdde-4b44-bc8d-8772a1452647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:00.570173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e071b9-fdde-4b44-bc8d-8772a1452647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:00.570813 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e071b9-fdde-4b44-bc8d-8772a1452647 admin admin] PATH_INFO: `/v3/users/46963b5bb7084c769bf08387abbb92ec` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:00.572197 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e071b9-fdde-4b44-bc8d-8772a1452647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46963b5bb7084c769bf08387abbb92ec)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:00.574734 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e071b9-fdde-4b44-bc8d-8772a1452647 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:00.657261 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b0e071b9-fdde-4b44-bc8d-8772a1452647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46963b5bb7084c769bf08387abbb92ec'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:00.665708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b0e071b9-fdde-4b44-bc8d-8772a1452647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46963b5bb7084c769bf08387abbb92ec'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:00.678088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b0e071b9-fdde-4b44-bc8d-8772a1452647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46963b5bb7084c769bf08387abbb92ec'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:00.678751 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b0e071b9-fdde-4b44-bc8d-8772a1452647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46963b5bb7084c769bf08387abbb92ec'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:00.679359 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b0e071b9-fdde-4b44-bc8d-8772a1452647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46963b5bb7084c769bf08387abbb92ec'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:00.694118 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1005/1982] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:57:00 2022] DELETE /identity/v3/users/46963b5bb7084c769bf08387abbb92ec => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:57:00.698741 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a1860-96c8-4a65-9aa7-5d3ddda2af31 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:00.699036 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a1860-96c8-4a65-9aa7-5d3ddda2af31 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:00.699316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a1860-96c8-4a65-9aa7-5d3ddda2af31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:00.718870 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d75a1860-96c8-4a65-9aa7-5d3ddda2af31 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:00.720125 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d75a1860-96c8-4a65-9aa7-5d3ddda2af31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:00.782126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 978/1983] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:00.797064 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e071b9-fdde-4b44-bc8d-8772a1452647 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:00.800319 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b0e071b9-fdde-4b44-bc8d-8772a1452647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:00.882501 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e071b9-fdde-4b44-bc8d-8772a1452647 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:00.886730 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ba3dd-6d1c-4cb0-a4a1-fb56a5dd475c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:00.887564 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ba3dd-6d1c-4cb0-a4a1-fb56a5dd475c service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:00.887921 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ba3dd-6d1c-4cb0-a4a1-fb56a5dd475c service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:00.888300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236ba3dd-6d1c-4cb0-a4a1-fb56a5dd475c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:00.914044 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ba3dd-6d1c-4cb0-a4a1-fb56a5dd475c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:00.916351 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236ba3dd-6d1c-4cb0-a4a1-fb56a5dd475c service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:00.932577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1006/1984] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:01.939387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a1860-96c8-4a65-9aa7-5d3ddda2af31 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:01.942094 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d75a1860-96c8-4a65-9aa7-5d3ddda2af31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:01.956467 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a1860-96c8-4a65-9aa7-5d3ddda2af31 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:01.962633 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97ba84-18a5-4f94-b0ca-af6b87dda2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:01.963427 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97ba84-18a5-4f94-b0ca-af6b87dda2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:01.963847 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97ba84-18a5-4f94-b0ca-af6b87dda2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:01.964171 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97ba84-18a5-4f94-b0ca-af6b87dda2c1 admin admin] PATH_INFO: `/v3/projects/936e5c86fb3245b596d682b97b3b8114` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:01.965403 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97ba84-18a5-4f94-b0ca-af6b87dda2c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=936e5c86fb3245b596d682b97b3b8114)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:01.967318 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97ba84-18a5-4f94-b0ca-af6b87dda2c1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:02.047892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ac97ba84-18a5-4f94-b0ca-af6b87dda2c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936e5c86fb3245b596d682b97b3b8114', 'request_id': 'req-ac97ba84-18a5-4f94-b0ca-af6b87dda2c1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:02.058042 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ac97ba84-18a5-4f94-b0ca-af6b87dda2c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936e5c86fb3245b596d682b97b3b8114', 'request_id': 'req-ac97ba84-18a5-4f94-b0ca-af6b87dda2c1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:02.066802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ac97ba84-18a5-4f94-b0ca-af6b87dda2c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936e5c86fb3245b596d682b97b3b8114', 'request_id': 'req-ac97ba84-18a5-4f94-b0ca-af6b87dda2c1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:02.080763 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ac97ba84-18a5-4f94-b0ca-af6b87dda2c1 admin admin] The token cache is being invalidate because project 936e5c86fb3245b596d682b97b3b8114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:57:02.080763 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ac97ba84-18a5-4f94-b0ca-af6b87dda2c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:02.081871 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ac97ba84-18a5-4f94-b0ca-af6b87dda2c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:02.083908 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 979/1985] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:57:01 2022] DELETE /identity/v3/projects/936e5c86fb3245b596d682b97b3b8114 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:02.088939 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ba3dd-6d1c-4cb0-a4a1-fb56a5dd475c service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:02.104128 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236ba3dd-6d1c-4cb0-a4a1-fb56a5dd475c service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:02.120999 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:02.177957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab8b51-072f-4a8e-8123-22f05b8ce936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:02.178598 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab8b51-072f-4a8e-8123-22f05b8ce936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:02.178877 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab8b51-072f-4a8e-8123-22f05b8ce936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:02.179151 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab8b51-072f-4a8e-8123-22f05b8ce936 admin admin] PATH_INFO: `/v3/users/9ae1126faa6845bca21dfa7ab8ab3780` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:02.180337 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab8b51-072f-4a8e-8123-22f05b8ce936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae1126faa6845bca21dfa7ab8ab3780)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:02.182277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab8b51-072f-4a8e-8123-22f05b8ce936 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:02.228661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-15ab8b51-072f-4a8e-8123-22f05b8ce936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae1126faa6845bca21dfa7ab8ab3780'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:02.239588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-15ab8b51-072f-4a8e-8123-22f05b8ce936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae1126faa6845bca21dfa7ab8ab3780'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:02.251977 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-15ab8b51-072f-4a8e-8123-22f05b8ce936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae1126faa6845bca21dfa7ab8ab3780'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:02.252671 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-15ab8b51-072f-4a8e-8123-22f05b8ce936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae1126faa6845bca21dfa7ab8ab3780'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:02.253453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-15ab8b51-072f-4a8e-8123-22f05b8ce936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae1126faa6845bca21dfa7ab8ab3780'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:02.269238 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1007/1986] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:57:02 2022] DELETE /identity/v3/users/9ae1126faa6845bca21dfa7ab8ab3780 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:02.579827 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97ba84-18a5-4f94-b0ca-af6b87dda2c1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:02.582817 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ac97ba84-18a5-4f94-b0ca-af6b87dda2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:02.598574 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97ba84-18a5-4f94-b0ca-af6b87dda2c1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:02.652747 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:02.667627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fa04a-3c36-46cf-9e91-07873e10dcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:02.668545 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fa04a-3c36-46cf-9e91-07873e10dcdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:02.668864 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fa04a-3c36-46cf-9e91-07873e10dcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:02.669129 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fa04a-3c36-46cf-9e91-07873e10dcdf admin admin] PATH_INFO: `/v3/projects/e7e1c82381994309853d16dd90b3ad34` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:02.670529 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fa04a-3c36-46cf-9e91-07873e10dcdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e1c82381994309853d16dd90b3ad34)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:02.672549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fa04a-3c36-46cf-9e91-07873e10dcdf admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:02.730663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0b8fa04a-3c36-46cf-9e91-07873e10dcdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e1c82381994309853d16dd90b3ad34', 'request_id': 'req-0b8fa04a-3c36-46cf-9e91-07873e10dcdf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:02.740633 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0b8fa04a-3c36-46cf-9e91-07873e10dcdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e1c82381994309853d16dd90b3ad34', 'request_id': 'req-0b8fa04a-3c36-46cf-9e91-07873e10dcdf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:02.747871 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0b8fa04a-3c36-46cf-9e91-07873e10dcdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e1c82381994309853d16dd90b3ad34', 'request_id': 'req-0b8fa04a-3c36-46cf-9e91-07873e10dcdf'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:02.772175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0b8fa04a-3c36-46cf-9e91-07873e10dcdf admin admin] The token cache is being invalidate because project e7e1c82381994309853d16dd90b3ad34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:57:02.772175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0b8fa04a-3c36-46cf-9e91-07873e10dcdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:02.772175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0b8fa04a-3c36-46cf-9e91-07873e10dcdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:02.772175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 980/1987] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:57:02 2022] DELETE /identity/v3/projects/e7e1c82381994309853d16dd90b3ad34 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:02.772765 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bcfc9-fa49-4988-b121-6c776a5cb8da None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:02.773056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bcfc9-fa49-4988-b121-6c776a5cb8da None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:02.773367 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9bcfc9-fa49-4988-b121-6c776a5cb8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:02.794442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5b9bcfc9-fa49-4988-b121-6c776a5cb8da None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:02.795700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5b9bcfc9-fa49-4988-b121-6c776a5cb8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:02.860378 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1008/1988] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:02.869715 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dea3b-5f1e-4bec-9694-204e998f90e3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:02.870016 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dea3b-5f1e-4bec-9694-204e998f90e3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:02.870319 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603dea3b-5f1e-4bec-9694-204e998f90e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:02.890851 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-603dea3b-5f1e-4bec-9694-204e998f90e3 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:02.892100 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-603dea3b-5f1e-4bec-9694-204e998f90e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:02.901387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 981/1989] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:02.906281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bcfc9-fa49-4988-b121-6c776a5cb8da None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:02.917282 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9bcfc9-fa49-4988-b121-6c776a5cb8da None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:02.921998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fb03f-ce26-4f7e-bd81-69de059db082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:02.922606 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fb03f-ce26-4f7e-bd81-69de059db082 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:02.922882 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fb03f-ce26-4f7e-bd81-69de059db082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:02.923157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fb03f-ce26-4f7e-bd81-69de059db082 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:02.923800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169fb03f-ce26-4f7e-bd81-69de059db082 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:57:02.924144 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169fb03f-ce26-4f7e-bd81-69de059db082 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:02.925825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169fb03f-ce26-4f7e-bd81-69de059db082 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:02.938290 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1009/1990] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:57:02.943174 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603dea3b-5f1e-4bec-9694-204e998f90e3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:02.953689 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603dea3b-5f1e-4bec-9694-204e998f90e3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:02.959764 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da265b3-8933-4273-aa2b-c1efdc87fb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:02.960402 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da265b3-8933-4273-aa2b-c1efdc87fb6d admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:02.960681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da265b3-8933-4273-aa2b-c1efdc87fb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:02.960956 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da265b3-8933-4273-aa2b-c1efdc87fb6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:02.961593 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da265b3-8933-4273-aa2b-c1efdc87fb6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:02.963538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da265b3-8933-4273-aa2b-c1efdc87fb6d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:03.019833 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 982/1991] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:57:02 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:03.021090 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fb03f-ce26-4f7e-bd81-69de059db082 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:03.035182 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fb03f-ce26-4f7e-bd81-69de059db082 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:03.065211 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:03.167170 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c296f-85d7-4a4f-b92e-35e2effd66d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:03.167718 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c296f-85d7-4a4f-b92e-35e2effd66d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:03.167976 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c296f-85d7-4a4f-b92e-35e2effd66d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:03.168276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c296f-85d7-4a4f-b92e-35e2effd66d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:03.168935 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c296f-85d7-4a4f-b92e-35e2effd66d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:03.172873 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c296f-85d7-4a4f-b92e-35e2effd66d7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:03.219067 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1010/1992] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:57:03 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:57:03.220243 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da265b3-8933-4273-aa2b-c1efdc87fb6d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:03.236922 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da265b3-8933-4273-aa2b-c1efdc87fb6d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:03.243978 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810d3db-5546-41f3-8948-238ddf030102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:03.244840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810d3db-5546-41f3-8948-238ddf030102 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:03.245300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810d3db-5546-41f3-8948-238ddf030102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:03.245749 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2810d3db-5546-41f3-8948-238ddf030102 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:03.246588 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810d3db-5546-41f3-8948-238ddf030102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:03.249028 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2810d3db-5546-41f3-8948-238ddf030102 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:03.266412 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 983/1993] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:57:03.267663 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c296f-85d7-4a4f-b92e-35e2effd66d7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:03.296117 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c296f-85d7-4a4f-b92e-35e2effd66d7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:03.308675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e593acb-a7de-4518-94ab-6db05d253695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:03.308675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e593acb-a7de-4518-94ab-6db05d253695 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:03.308675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e593acb-a7de-4518-94ab-6db05d253695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:03.308675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e593acb-a7de-4518-94ab-6db05d253695 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:03.309133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e593acb-a7de-4518-94ab-6db05d253695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:03.309831 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e593acb-a7de-4518-94ab-6db05d253695 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:03.325376 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1011/1994] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:03.329506 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810d3db-5546-41f3-8948-238ddf030102 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:03.343105 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2810d3db-5546-41f3-8948-238ddf030102 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:03.348573 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0302e93-f49d-4c6d-867b-c9597f8cf286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:03.349910 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0302e93-f49d-4c6d-867b-c9597f8cf286 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:03.349910 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0302e93-f49d-4c6d-867b-c9597f8cf286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:03.349910 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0302e93-f49d-4c6d-867b-c9597f8cf286 admin admin] PATH_INFO: `/v3/projects/6feac10753aa447499ef12223fe6410f/users/adede5511e93459daefbdd747485bfe5/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:03.370766 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0302e93-f49d-4c6d-867b-c9597f8cf286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6feac10753aa447499ef12223fe6410f, user_id=adede5511e93459daefbdd747485bfe5, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:03.374151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0302e93-f49d-4c6d-867b-c9597f8cf286 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:03.407128 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 984/1995] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:03 2022] PUT /identity/v3/projects/6feac10753aa447499ef12223fe6410f/users/adede5511e93459daefbdd747485bfe5/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:03.409761 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee2166-157b-4a18-9f16-53e6029ad1f2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:03.410047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee2166-157b-4a18-9f16-53e6029ad1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:03.410322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee2166-157b-4a18-9f16-53e6029ad1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:03.446567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9eee2166-157b-4a18-9f16-53e6029ad1f2 None None] MFA Rules not processed for user `adede5511e93459daefbdd747485bfe5`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:03.447953 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9eee2166-157b-4a18-9f16-53e6029ad1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:03.569697 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1012/1996] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:03.583883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0302e93-f49d-4c6d-867b-c9597f8cf286 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:03.586228 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b0302e93-f49d-4c6d-867b-c9597f8cf286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:03.703282 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0302e93-f49d-4c6d-867b-c9597f8cf286 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:03.709031 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed09f2-9854-4ebc-bc56-6a088872eae4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:03.709865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed09f2-9854-4ebc-bc56-6a088872eae4 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:03.710384 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed09f2-9854-4ebc-bc56-6a088872eae4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:03.711481 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed09f2-9854-4ebc-bc56-6a088872eae4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:03.725963 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed09f2-9854-4ebc-bc56-6a088872eae4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:03.728715 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed09f2-9854-4ebc-bc56-6a088872eae4 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:03.743356 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 985/1997] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:04.872891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee2166-157b-4a18-9f16-53e6029ad1f2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:04.884049 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee2166-157b-4a18-9f16-53e6029ad1f2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:04.888133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42edaf3-dccb-41f5-8020-49d1c3782256 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:04.889105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42edaf3-dccb-41f5-8020-49d1c3782256 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:04.889615 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42edaf3-dccb-41f5-8020-49d1c3782256 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:04.891022 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42edaf3-dccb-41f5-8020-49d1c3782256 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:04.895267 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b42edaf3-dccb-41f5-8020-49d1c3782256 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:04.991223 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42edaf3-dccb-41f5-8020-49d1c3782256 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:04.991457 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42edaf3-dccb-41f5-8020-49d1c3782256 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:05.005286 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1013/1998] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:06.461883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed09f2-9854-4ebc-bc56-6a088872eae4 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:06.503058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:06.554836 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed09f2-9854-4ebc-bc56-6a088872eae4 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:06.559469 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991de94-b4de-454b-8599-6483841f47ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:06.560130 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991de94-b4de-454b-8599-6483841f47ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:06.560410 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991de94-b4de-454b-8599-6483841f47ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:06.560684 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991de94-b4de-454b-8599-6483841f47ff admin admin] PATH_INFO: `/v3/users/adede5511e93459daefbdd747485bfe5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:06.561807 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991de94-b4de-454b-8599-6483841f47ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=adede5511e93459daefbdd747485bfe5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:06.563736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991de94-b4de-454b-8599-6483841f47ff admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:06.620910 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b991de94-b4de-454b-8599-6483841f47ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adede5511e93459daefbdd747485bfe5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:06.630848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b991de94-b4de-454b-8599-6483841f47ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adede5511e93459daefbdd747485bfe5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:06.631645 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b991de94-b4de-454b-8599-6483841f47ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adede5511e93459daefbdd747485bfe5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:06.632439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b991de94-b4de-454b-8599-6483841f47ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adede5511e93459daefbdd747485bfe5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:06.641413 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b991de94-b4de-454b-8599-6483841f47ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adede5511e93459daefbdd747485bfe5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:06.666411 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 986/1999] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:57:06 2022] DELETE /identity/v3/users/adede5511e93459daefbdd747485bfe5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:57:06.670711 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc666cc0-bb2c-48f0-bce9-8a837de30a5b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:06.671205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc666cc0-bb2c-48f0-bce9-8a837de30a5b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:06.671294 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc666cc0-bb2c-48f0-bce9-8a837de30a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:06.692163 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-cc666cc0-bb2c-48f0-bce9-8a837de30a5b None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:06.693688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cc666cc0-bb2c-48f0-bce9-8a837de30a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:06.734382 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:06.848179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1014/2000] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:06.860348 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991de94-b4de-454b-8599-6483841f47ff admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:06.864121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b991de94-b4de-454b-8599-6483841f47ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:06.961516 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991de94-b4de-454b-8599-6483841f47ff admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:06.967853 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc6c02-ee4a-401b-b459-bacba8807dd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:06.968733 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc6c02-ee4a-401b-b459-bacba8807dd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:06.969140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc6c02-ee4a-401b-b459-bacba8807dd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:06.969681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc6c02-ee4a-401b-b459-bacba8807dd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:06.985706 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc6c02-ee4a-401b-b459-bacba8807dd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:06.987444 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc6c02-ee4a-401b-b459-bacba8807dd8 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:06.988960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc666cc0-bb2c-48f0-bce9-8a837de30a5b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:06.991027 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cc666cc0-bb2c-48f0-bce9-8a837de30a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:07.001659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 987/2001] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:07.024368 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc666cc0-bb2c-48f0-bce9-8a837de30a5b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:07.039117 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4778a72-dee5-48a4-a46c-28ac25bda7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:07.040021 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4778a72-dee5-48a4-a46c-28ac25bda7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:07.048266 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4778a72-dee5-48a4-a46c-28ac25bda7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:07.048787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4778a72-dee5-48a4-a46c-28ac25bda7fe admin admin] PATH_INFO: `/v3/users/a07bee515b064f099dbcadb94437de0d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:07.050288 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4778a72-dee5-48a4-a46c-28ac25bda7fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07bee515b064f099dbcadb94437de0d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:07.052477 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4778a72-dee5-48a4-a46c-28ac25bda7fe admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:07.127485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a4778a72-dee5-48a4-a46c-28ac25bda7fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07bee515b064f099dbcadb94437de0d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:07.138070 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a4778a72-dee5-48a4-a46c-28ac25bda7fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07bee515b064f099dbcadb94437de0d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:07.156347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a4778a72-dee5-48a4-a46c-28ac25bda7fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07bee515b064f099dbcadb94437de0d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:07.157366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a4778a72-dee5-48a4-a46c-28ac25bda7fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07bee515b064f099dbcadb94437de0d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:07.157996 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a4778a72-dee5-48a4-a46c-28ac25bda7fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07bee515b064f099dbcadb94437de0d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:07.177899 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1015/2002] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:57:06 2022] DELETE /identity/v3/users/a07bee515b064f099dbcadb94437de0d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:07.179687 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5df366-13a7-4176-b4dc-546fb4cfa577 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:07.180306 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5df366-13a7-4176-b4dc-546fb4cfa577 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:07.180643 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5df366-13a7-4176-b4dc-546fb4cfa577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:07.224687 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4f5df366-13a7-4176-b4dc-546fb4cfa577 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:07.226451 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4f5df366-13a7-4176-b4dc-546fb4cfa577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:07.281511 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:07.318751 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 988/2003] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:57:07.329039 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4778a72-dee5-48a4-a46c-28ac25bda7fe admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:07.331679 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a4778a72-dee5-48a4-a46c-28ac25bda7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:07.347483 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5df366-13a7-4176-b4dc-546fb4cfa577 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:07.349065 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4f5df366-13a7-4176-b4dc-546fb4cfa577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:07.361064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5df366-13a7-4176-b4dc-546fb4cfa577 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:07.365895 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37487ed4-a343-41b4-9734-8dfe18d419b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:07.366558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37487ed4-a343-41b4-9734-8dfe18d419b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:07.366842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37487ed4-a343-41b4-9734-8dfe18d419b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:07.367121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37487ed4-a343-41b4-9734-8dfe18d419b2 admin admin] PATH_INFO: `/v3/projects/6feac10753aa447499ef12223fe6410f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:07.368298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37487ed4-a343-41b4-9734-8dfe18d419b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6feac10753aa447499ef12223fe6410f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:07.370247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37487ed4-a343-41b4-9734-8dfe18d419b2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:07.406587 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4778a72-dee5-48a4-a46c-28ac25bda7fe admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:07.420781 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-37487ed4-a343-41b4-9734-8dfe18d419b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6feac10753aa447499ef12223fe6410f', 'request_id': 'req-37487ed4-a343-41b4-9734-8dfe18d419b2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:07.431355 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-37487ed4-a343-41b4-9734-8dfe18d419b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6feac10753aa447499ef12223fe6410f', 'request_id': 'req-37487ed4-a343-41b4-9734-8dfe18d419b2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:07.437310 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-37487ed4-a343-41b4-9734-8dfe18d419b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6feac10753aa447499ef12223fe6410f', 'request_id': 'req-37487ed4-a343-41b4-9734-8dfe18d419b2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:07.451543 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-37487ed4-a343-41b4-9734-8dfe18d419b2 admin admin] The token cache is being invalidate because project 6feac10753aa447499ef12223fe6410f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:57:07.452440 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-37487ed4-a343-41b4-9734-8dfe18d419b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:07.453114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-37487ed4-a343-41b4-9734-8dfe18d419b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:07.454825 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 989/2004] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:57:07 2022] DELETE /identity/v3/projects/6feac10753aa447499ef12223fe6410f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:57:07.459853 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbe13c-eaef-4216-b4c2-1fcf68ce02c5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:07.460171 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbe13c-eaef-4216-b4c2-1fcf68ce02c5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:07.460452 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbe13c-eaef-4216-b4c2-1fcf68ce02c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:07.461848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0d91e-9eb6-4e1e-bb21-b9dda3919424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:07.462465 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0d91e-9eb6-4e1e-bb21-b9dda3919424 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:07.462744 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0d91e-9eb6-4e1e-bb21-b9dda3919424 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:07.463017 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0d91e-9eb6-4e1e-bb21-b9dda3919424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:07.464814 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aea0d91e-9eb6-4e1e-bb21-b9dda3919424 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:07.470956 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:07.489762 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7bcbe13c-eaef-4216-b4c2-1fcf68ce02c5 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:07.491452 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7bcbe13c-eaef-4216-b4c2-1fcf68ce02c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:07.561429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0d91e-9eb6-4e1e-bb21-b9dda3919424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:07.562980 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0d91e-9eb6-4e1e-bb21-b9dda3919424 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:07.578766 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1016/2005] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:07.586152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 990/2006] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:57:07.593872 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532efd1-b6a1-45d2-aa07-cbdcfb4b200b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:07.594235 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532efd1-b6a1-45d2-aa07-cbdcfb4b200b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:07.594580 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532efd1-b6a1-45d2-aa07-cbdcfb4b200b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:07.615781 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a532efd1-b6a1-45d2-aa07-cbdcfb4b200b None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:07.617037 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a532efd1-b6a1-45d2-aa07-cbdcfb4b200b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:07.625247 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1017/2007] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:07.630001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbe13c-eaef-4216-b4c2-1fcf68ce02c5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:07.644664 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbe13c-eaef-4216-b4c2-1fcf68ce02c5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:07.649763 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a139a8-f41c-4433-8478-22a5ebb290fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:07.650426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a139a8-f41c-4433-8478-22a5ebb290fa admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:07.650894 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a139a8-f41c-4433-8478-22a5ebb290fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:07.651370 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a139a8-f41c-4433-8478-22a5ebb290fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:07.652577 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a139a8-f41c-4433-8478-22a5ebb290fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:57:07.653141 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a139a8-f41c-4433-8478-22a5ebb290fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:07.656304 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a139a8-f41c-4433-8478-22a5ebb290fa admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:07.671025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 991/2008] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:57:07.675926 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532efd1-b6a1-45d2-aa07-cbdcfb4b200b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:07.685630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532efd1-b6a1-45d2-aa07-cbdcfb4b200b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:07.691626 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61bbd7-e3ad-4705-92dc-7d974664928c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:07.692432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61bbd7-e3ad-4705-92dc-7d974664928c admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:07.692707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61bbd7-e3ad-4705-92dc-7d974664928c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:07.693068 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61bbd7-e3ad-4705-92dc-7d974664928c admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:07.693807 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61bbd7-e3ad-4705-92dc-7d974664928c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:07.695712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61bbd7-e3ad-4705-92dc-7d974664928c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:07.728172 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1018/2009] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:57:07 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:57:07.729510 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a139a8-f41c-4433-8478-22a5ebb290fa admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:07.740314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a139a8-f41c-4433-8478-22a5ebb290fa admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:07.794676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:07.805702 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f8a3c-959f-4c5f-887c-021c1509c4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:07.806711 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f8a3c-959f-4c5f-887c-021c1509c4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:07.807156 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f8a3c-959f-4c5f-887c-021c1509c4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:07.807534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609f8a3c-959f-4c5f-887c-021c1509c4c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:07.808372 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f8a3c-959f-4c5f-887c-021c1509c4c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:07.810349 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609f8a3c-959f-4c5f-887c-021c1509c4c8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:07.840019 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 992/2010] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:57:07 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:07.843373 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61bbd7-e3ad-4705-92dc-7d974664928c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:07.856929 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61bbd7-e3ad-4705-92dc-7d974664928c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:07.862844 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918163d8-f663-4d61-a67c-9264a29fc69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:07.863589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918163d8-f663-4d61-a67c-9264a29fc69b admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:07.864009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918163d8-f663-4d61-a67c-9264a29fc69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:07.864391 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918163d8-f663-4d61-a67c-9264a29fc69b admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:07.865213 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918163d8-f663-4d61-a67c-9264a29fc69b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:07.866838 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918163d8-f663-4d61-a67c-9264a29fc69b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:07.883736 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1019/2011] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:07.888198 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f8a3c-959f-4c5f-887c-021c1509c4c8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:07.902411 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609f8a3c-959f-4c5f-887c-021c1509c4c8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:07.907962 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926b9f2-5d3b-4e57-ab88-f110a2b7b98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:07.910215 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926b9f2-5d3b-4e57-ab88-f110a2b7b98a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:07.910548 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926b9f2-5d3b-4e57-ab88-f110a2b7b98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:07.910856 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926b9f2-5d3b-4e57-ab88-f110a2b7b98a admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:07.911718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926b9f2-5d3b-4e57-ab88-f110a2b7b98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:07.913201 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926b9f2-5d3b-4e57-ab88-f110a2b7b98a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:07.925114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 993/2012] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:07.929609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918163d8-f663-4d61-a67c-9264a29fc69b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:07.940879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918163d8-f663-4d61-a67c-9264a29fc69b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:07.946325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefec30-068a-4b16-b0c7-cf006ed9c96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:07.947069 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefec30-068a-4b16-b0c7-cf006ed9c96a admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:07.947352 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefec30-068a-4b16-b0c7-cf006ed9c96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:07.948145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefec30-068a-4b16-b0c7-cf006ed9c96a admin admin] PATH_INFO: `/v3/projects/f8a0e372446c49518f3f8c841580691b/users/b8fa813fd0d14d0cbcc0080f44f8ebc3/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:07.965348 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefec30-068a-4b16-b0c7-cf006ed9c96a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a0e372446c49518f3f8c841580691b, user_id=b8fa813fd0d14d0cbcc0080f44f8ebc3, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:07.968177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acefec30-068a-4b16-b0c7-cf006ed9c96a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:07.989237 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1020/2013] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:07 2022] PUT /identity/v3/projects/f8a0e372446c49518f3f8c841580691b/users/b8fa813fd0d14d0cbcc0080f44f8ebc3/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:08.001336 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f166a-3b42-41cb-846c-cf9d4f7c4d8c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:08.001628 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f166a-3b42-41cb-846c-cf9d4f7c4d8c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:08.001914 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f166a-3b42-41cb-846c-cf9d4f7c4d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:08.034782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5b9f166a-3b42-41cb-846c-cf9d4f7c4d8c None None] MFA Rules not processed for user `b8fa813fd0d14d0cbcc0080f44f8ebc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:08.036540 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5b9f166a-3b42-41cb-846c-cf9d4f7c4d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:08.136753 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 994/2014] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:08.151331 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefec30-068a-4b16-b0c7-cf006ed9c96a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:08.153292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-acefec30-068a-4b16-b0c7-cf006ed9c96a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:08.211278 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f166a-3b42-41cb-846c-cf9d4f7c4d8c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:08.213862 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5b9f166a-3b42-41cb-846c-cf9d4f7c4d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:08.253696 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acefec30-068a-4b16-b0c7-cf006ed9c96a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:08.257629 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fe92f-bd4a-4d05-b6df-7a28dda49a5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:08.260028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fe92f-bd4a-4d05-b6df-7a28dda49a5b service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:08.260028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fe92f-bd4a-4d05-b6df-7a28dda49a5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:08.260028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fe92f-bd4a-4d05-b6df-7a28dda49a5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:08.269562 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fe92f-bd4a-4d05-b6df-7a28dda49a5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:08.271003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fe92f-bd4a-4d05-b6df-7a28dda49a5b service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:08.293626 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1021/2015] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 20:57:08.312259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fe92f-bd4a-4d05-b6df-7a28dda49a5b service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:08.324439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fe92f-bd4a-4d05-b6df-7a28dda49a5b service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:08.325368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f166a-3b42-41cb-846c-cf9d4f7c4d8c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:08.330572 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3299b-0b53-4d1d-9e33-cd5d94a800e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:08.331261 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3299b-0b53-4d1d-9e33-cd5d94a800e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:08.331546 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d559ee-bc89-4bfa-8399-f2cc53a89154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:08.331671 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3299b-0b53-4d1d-9e33-cd5d94a800e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:08.331969 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3299b-0b53-4d1d-9e33-cd5d94a800e3 admin admin] PATH_INFO: `/v3/users/b8fa813fd0d14d0cbcc0080f44f8ebc3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:08.332246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d559ee-bc89-4bfa-8399-f2cc53a89154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:08.332533 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d559ee-bc89-4bfa-8399-f2cc53a89154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:08.332830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d559ee-bc89-4bfa-8399-f2cc53a89154 admin admin] PATH_INFO: `/v3/projects/f7e85918030a481b8782ec0b0151613d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:08.333376 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3299b-0b53-4d1d-9e33-cd5d94a800e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8fa813fd0d14d0cbcc0080f44f8ebc3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:08.333971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d559ee-bc89-4bfa-8399-f2cc53a89154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7e85918030a481b8782ec0b0151613d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:08.335277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3299b-0b53-4d1d-9e33-cd5d94a800e3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:08.336460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d559ee-bc89-4bfa-8399-f2cc53a89154 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:08.382787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:08.404781 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-74d559ee-bc89-4bfa-8399-f2cc53a89154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7e85918030a481b8782ec0b0151613d', 'request_id': 'req-74d559ee-bc89-4bfa-8399-f2cc53a89154'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:08.410269 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1ba3299b-0b53-4d1d-9e33-cd5d94a800e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8fa813fd0d14d0cbcc0080f44f8ebc3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:08.416252 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-74d559ee-bc89-4bfa-8399-f2cc53a89154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7e85918030a481b8782ec0b0151613d', 'request_id': 'req-74d559ee-bc89-4bfa-8399-f2cc53a89154'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:08.419080 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1ba3299b-0b53-4d1d-9e33-cd5d94a800e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8fa813fd0d14d0cbcc0080f44f8ebc3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:08.422094 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:08.423645 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-74d559ee-bc89-4bfa-8399-f2cc53a89154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7e85918030a481b8782ec0b0151613d', 'request_id': 'req-74d559ee-bc89-4bfa-8399-f2cc53a89154'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:08.436031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1ba3299b-0b53-4d1d-9e33-cd5d94a800e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8fa813fd0d14d0cbcc0080f44f8ebc3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:08.436895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1ba3299b-0b53-4d1d-9e33-cd5d94a800e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8fa813fd0d14d0cbcc0080f44f8ebc3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:08.437901 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-1ba3299b-0b53-4d1d-9e33-cd5d94a800e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8fa813fd0d14d0cbcc0080f44f8ebc3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:08.440881 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-74d559ee-bc89-4bfa-8399-f2cc53a89154 admin admin] The token cache is being invalidate because project f7e85918030a481b8782ec0b0151613d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:57:08.441337 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-74d559ee-bc89-4bfa-8399-f2cc53a89154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:08.442184 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-74d559ee-bc89-4bfa-8399-f2cc53a89154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:08.445869 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 995/2016] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:57:08 2022] DELETE /identity/v3/projects/f7e85918030a481b8782ec0b0151613d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:08.464330 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1022/2017] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:57:08 2022] DELETE /identity/v3/users/b8fa813fd0d14d0cbcc0080f44f8ebc3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:08.469015 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d6949-90b8-470f-a7a9-32006c9d3c0f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:08.469387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d6949-90b8-470f-a7a9-32006c9d3c0f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:08.469747 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d6949-90b8-470f-a7a9-32006c9d3c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:08.498130 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-bf1d6949-90b8-470f-a7a9-32006c9d3c0f None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:08.499494 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bf1d6949-90b8-470f-a7a9-32006c9d3c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:08.579290 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 996/2018] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:08.589735 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3299b-0b53-4d1d-9e33-cd5d94a800e3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:08.591368 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1ba3299b-0b53-4d1d-9e33-cd5d94a800e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:08.654553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3299b-0b53-4d1d-9e33-cd5d94a800e3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:08.658236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7e4e7-7e78-4079-9039-25e2efb1780e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:08.659114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7e4e7-7e78-4079-9039-25e2efb1780e service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:08.659394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7e4e7-7e78-4079-9039-25e2efb1780e service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:08.659694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7e4e7-7e78-4079-9039-25e2efb1780e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:08.669124 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7e4e7-7e78-4079-9039-25e2efb1780e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:08.670552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7e4e7-7e78-4079-9039-25e2efb1780e service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:08.681181 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1023/2019] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:08.975005 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d6949-90b8-470f-a7a9-32006c9d3c0f None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:08.976648 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bf1d6949-90b8-470f-a7a9-32006c9d3c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:08.990814 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d6949-90b8-470f-a7a9-32006c9d3c0f None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:08.995588 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eedff7-5e4b-4103-8093-2ef700b22a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:08.996299 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eedff7-5e4b-4103-8093-2ef700b22a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:08.996585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eedff7-5e4b-4103-8093-2ef700b22a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:08.996873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eedff7-5e4b-4103-8093-2ef700b22a80 admin admin] PATH_INFO: `/v3/projects/f8a0e372446c49518f3f8c841580691b` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:08.998085 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eedff7-5e4b-4103-8093-2ef700b22a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8a0e372446c49518f3f8c841580691b)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:09.000110 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eedff7-5e4b-4103-8093-2ef700b22a80 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:09.053467 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-21eedff7-5e4b-4103-8093-2ef700b22a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a0e372446c49518f3f8c841580691b', 'request_id': 'req-21eedff7-5e4b-4103-8093-2ef700b22a80'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:09.061512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-21eedff7-5e4b-4103-8093-2ef700b22a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a0e372446c49518f3f8c841580691b', 'request_id': 'req-21eedff7-5e4b-4103-8093-2ef700b22a80'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:09.068492 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-21eedff7-5e4b-4103-8093-2ef700b22a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a0e372446c49518f3f8c841580691b', 'request_id': 'req-21eedff7-5e4b-4103-8093-2ef700b22a80'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:09.079932 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-21eedff7-5e4b-4103-8093-2ef700b22a80 admin admin] The token cache is being invalidate because project f8a0e372446c49518f3f8c841580691b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:57:09.080252 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-21eedff7-5e4b-4103-8093-2ef700b22a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:09.081537 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-21eedff7-5e4b-4103-8093-2ef700b22a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:09.083064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 997/2020] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:57:08 2022] DELETE /identity/v3/projects/f8a0e372446c49518f3f8c841580691b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:09.088464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d59c35-accd-4b1f-9b28-8b8996ba3901 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:09.088782 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d59c35-accd-4b1f-9b28-8b8996ba3901 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:09.089064 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d59c35-accd-4b1f-9b28-8b8996ba3901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:09.109974 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-79d59c35-accd-4b1f-9b28-8b8996ba3901 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:09.111201 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-79d59c35-accd-4b1f-9b28-8b8996ba3901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:09.183021 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1024/2021] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:09.190715 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2d30a-0ac2-47a9-aec1-7af400849821 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:09.191000 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2d30a-0ac2-47a9-aec1-7af400849821 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:09.191275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2d30a-0ac2-47a9-aec1-7af400849821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:09.218305 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-65d2d30a-0ac2-47a9-aec1-7af400849821 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:09.220869 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-65d2d30a-0ac2-47a9-aec1-7af400849821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:09.244878 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 998/2022] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:09.249286 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d59c35-accd-4b1f-9b28-8b8996ba3901 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:09.260221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d59c35-accd-4b1f-9b28-8b8996ba3901 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:09.265807 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de947c-0bc5-4f34-9928-3d73672c5424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:09.266521 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de947c-0bc5-4f34-9928-3d73672c5424 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:09.266880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de947c-0bc5-4f34-9928-3d73672c5424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:09.267141 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de947c-0bc5-4f34-9928-3d73672c5424 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:09.267898 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de947c-0bc5-4f34-9928-3d73672c5424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:57:09.268879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de947c-0bc5-4f34-9928-3d73672c5424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:09.270567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de947c-0bc5-4f34-9928-3d73672c5424 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:09.286906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1025/2023] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:57:09.291446 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2d30a-0ac2-47a9-aec1-7af400849821 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:09.305487 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2d30a-0ac2-47a9-aec1-7af400849821 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:09.311467 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d88407-06c2-4cd2-8662-bece7c1b6770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:09.312017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d88407-06c2-4cd2-8662-bece7c1b6770 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:09.312395 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d88407-06c2-4cd2-8662-bece7c1b6770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:09.312921 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d88407-06c2-4cd2-8662-bece7c1b6770 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:09.313683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d88407-06c2-4cd2-8662-bece7c1b6770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:09.316337 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d88407-06c2-4cd2-8662-bece7c1b6770 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:09.360826 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de947c-0bc5-4f34-9928-3d73672c5424 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:09.360945 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 999/2024] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:57:09 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:09.382162 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de947c-0bc5-4f34-9928-3d73672c5424 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:09.457341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:09.477734 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a08e89-b278-40e4-93f8-fa3afea2c2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:09.478618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a08e89-b278-40e4-93f8-fa3afea2c2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:09.479097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a08e89-b278-40e4-93f8-fa3afea2c2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:09.479570 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a08e89-b278-40e4-93f8-fa3afea2c2e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:09.480300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a08e89-b278-40e4-93f8-fa3afea2c2e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:09.492575 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a08e89-b278-40e4-93f8-fa3afea2c2e1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:09.509673 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1026/2025] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:57:09 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:09.514022 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d88407-06c2-4cd2-8662-bece7c1b6770 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:09.524826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d88407-06c2-4cd2-8662-bece7c1b6770 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:09.530501 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ab655-60b8-4b41-b3b7-94a4cb021391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:09.531268 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ab655-60b8-4b41-b3b7-94a4cb021391 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:09.531653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ab655-60b8-4b41-b3b7-94a4cb021391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:09.532059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ab655-60b8-4b41-b3b7-94a4cb021391 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:09.532819 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ab655-60b8-4b41-b3b7-94a4cb021391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:09.535692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ab655-60b8-4b41-b3b7-94a4cb021391 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:09.549152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1000/2026] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:09.554137 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a08e89-b278-40e4-93f8-fa3afea2c2e1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:09.567447 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a08e89-b278-40e4-93f8-fa3afea2c2e1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:09.573323 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbee5d-4375-4229-bf6b-0797856e14c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:09.573939 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbee5d-4375-4229-bf6b-0797856e14c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:09.574218 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbee5d-4375-4229-bf6b-0797856e14c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:09.574508 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbee5d-4375-4229-bf6b-0797856e14c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:09.575135 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbee5d-4375-4229-bf6b-0797856e14c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:09.576912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbee5d-4375-4229-bf6b-0797856e14c7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:09.588900 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1027/2027] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:57:09.593351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ab655-60b8-4b41-b3b7-94a4cb021391 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:09.604632 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ab655-60b8-4b41-b3b7-94a4cb021391 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:09.618938 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad391fe1-0c4b-4e7c-a441-0801af019132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:09.619619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad391fe1-0c4b-4e7c-a441-0801af019132 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:09.619894 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad391fe1-0c4b-4e7c-a441-0801af019132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:09.620214 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad391fe1-0c4b-4e7c-a441-0801af019132 admin admin] PATH_INFO: `/v3/projects/93361291e79949e3a9062c7be5ae6ddf/users/d4e5f1d369d94d00a56cbcfb69be01e9/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:09.636941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad391fe1-0c4b-4e7c-a441-0801af019132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93361291e79949e3a9062c7be5ae6ddf, user_id=d4e5f1d369d94d00a56cbcfb69be01e9, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:09.640843 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad391fe1-0c4b-4e7c-a441-0801af019132 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:09.657532 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1001/2028] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:09 2022] PUT /identity/v3/projects/93361291e79949e3a9062c7be5ae6ddf/users/d4e5f1d369d94d00a56cbcfb69be01e9/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:09.663607 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156e3bd-d75c-4ea0-abd2-6f6a557cbadc None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:09.663954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156e3bd-d75c-4ea0-abd2-6f6a557cbadc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:09.664361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156e3bd-d75c-4ea0-abd2-6f6a557cbadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:09.684785 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f156e3bd-d75c-4ea0-abd2-6f6a557cbadc None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:09.686086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f156e3bd-d75c-4ea0-abd2-6f6a557cbadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:09.760398 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1028/2029] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:57:09.770956 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad391fe1-0c4b-4e7c-a441-0801af019132 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:09.772819 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ad391fe1-0c4b-4e7c-a441-0801af019132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:09.788294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:09.856681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad391fe1-0c4b-4e7c-a441-0801af019132 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:09.861414 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87902d24-9803-4a1e-9492-0ed58d90ffcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:09.863053 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87902d24-9803-4a1e-9492-0ed58d90ffcd service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:09.863517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87902d24-9803-4a1e-9492-0ed58d90ffcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:09.863936 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87902d24-9803-4a1e-9492-0ed58d90ffcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:09.881176 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87902d24-9803-4a1e-9492-0ed58d90ffcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:09.888299 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87902d24-9803-4a1e-9492-0ed58d90ffcd service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:09.900408 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1002/2030] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:10.530078 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156e3bd-d75c-4ea0-abd2-6f6a557cbadc None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:10.531521 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f156e3bd-d75c-4ea0-abd2-6f6a557cbadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:10.545580 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156e3bd-d75c-4ea0-abd2-6f6a557cbadc None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:10.551204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b063a-5eb4-44bc-a50c-0ec0fa17d750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:10.551847 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b063a-5eb4-44bc-a50c-0ec0fa17d750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:10.552336 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b063a-5eb4-44bc-a50c-0ec0fa17d750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:10.552776 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b063a-5eb4-44bc-a50c-0ec0fa17d750 admin admin] PATH_INFO: `/v3/users/25e59048ab474a6b8fe4c390524dd574` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:10.554080 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b063a-5eb4-44bc-a50c-0ec0fa17d750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e59048ab474a6b8fe4c390524dd574)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:10.556278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b063a-5eb4-44bc-a50c-0ec0fa17d750 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:10.654365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5b5b063a-5eb4-44bc-a50c-0ec0fa17d750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e59048ab474a6b8fe4c390524dd574'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:10.665326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5b5b063a-5eb4-44bc-a50c-0ec0fa17d750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e59048ab474a6b8fe4c390524dd574'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:10.691195 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5b5b063a-5eb4-44bc-a50c-0ec0fa17d750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e59048ab474a6b8fe4c390524dd574'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:10.692133 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5b5b063a-5eb4-44bc-a50c-0ec0fa17d750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e59048ab474a6b8fe4c390524dd574'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:10.692909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5b5b063a-5eb4-44bc-a50c-0ec0fa17d750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e59048ab474a6b8fe4c390524dd574'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:10.706667 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1029/2031] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:57:10 2022] DELETE /identity/v3/users/25e59048ab474a6b8fe4c390524dd574 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:10.711342 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4fb73-8643-4776-a44c-bdb0d9b3cb06 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:10.712814 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4fb73-8643-4776-a44c-bdb0d9b3cb06 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:10.713263 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4fb73-8643-4776-a44c-bdb0d9b3cb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:10.732325 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-93a4fb73-8643-4776-a44c-bdb0d9b3cb06 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:10.733628 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-93a4fb73-8643-4776-a44c-bdb0d9b3cb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:10.826615 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1003/2032] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:10.836864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b063a-5eb4-44bc-a50c-0ec0fa17d750 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:10.838490 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5b5b063a-5eb4-44bc-a50c-0ec0fa17d750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:10.885481 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:10.908124 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b063a-5eb4-44bc-a50c-0ec0fa17d750 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:10.912330 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91098c-2d6e-41c2-bd79-b611a53f5457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:10.912955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91098c-2d6e-41c2-bd79-b611a53f5457 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:10.913242 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91098c-2d6e-41c2-bd79-b611a53f5457 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:10.913511 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb91098c-2d6e-41c2-bd79-b611a53f5457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:10.923260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91098c-2d6e-41c2-bd79-b611a53f5457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:10.925538 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb91098c-2d6e-41c2-bd79-b611a53f5457 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:10.941134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1030/2033] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:11.980375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4fb73-8643-4776-a44c-bdb0d9b3cb06 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:11.982114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-93a4fb73-8643-4776-a44c-bdb0d9b3cb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:11.999840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4fb73-8643-4776-a44c-bdb0d9b3cb06 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:12.011355 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0a6da-cc99-4a75-9ac3-4ebe8773cc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:12.012064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0a6da-cc99-4a75-9ac3-4ebe8773cc4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:12.012347 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0a6da-cc99-4a75-9ac3-4ebe8773cc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:12.012620 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0a6da-cc99-4a75-9ac3-4ebe8773cc4b admin admin] PATH_INFO: `/v3/projects/02a674a005594700b4d0d8e171e0f103` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:12.016567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0a6da-cc99-4a75-9ac3-4ebe8773cc4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=02a674a005594700b4d0d8e171e0f103)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:12.021842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0a6da-cc99-4a75-9ac3-4ebe8773cc4b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:12.103189 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a5f0a6da-cc99-4a75-9ac3-4ebe8773cc4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02a674a005594700b4d0d8e171e0f103', 'request_id': 'req-a5f0a6da-cc99-4a75-9ac3-4ebe8773cc4b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:12.116575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a5f0a6da-cc99-4a75-9ac3-4ebe8773cc4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02a674a005594700b4d0d8e171e0f103', 'request_id': 'req-a5f0a6da-cc99-4a75-9ac3-4ebe8773cc4b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:12.124460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a5f0a6da-cc99-4a75-9ac3-4ebe8773cc4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02a674a005594700b4d0d8e171e0f103', 'request_id': 'req-a5f0a6da-cc99-4a75-9ac3-4ebe8773cc4b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:12.143940 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a5f0a6da-cc99-4a75-9ac3-4ebe8773cc4b admin admin] The token cache is being invalidate because project 02a674a005594700b4d0d8e171e0f103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:57:12.144433 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a5f0a6da-cc99-4a75-9ac3-4ebe8773cc4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:12.145853 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a5f0a6da-cc99-4a75-9ac3-4ebe8773cc4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:12.148212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1004/2034] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:57:11 2022] DELETE /identity/v3/projects/02a674a005594700b4d0d8e171e0f103 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:12.151967 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91098c-2d6e-41c2-bd79-b611a53f5457 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:12.184779 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb91098c-2d6e-41c2-bd79-b611a53f5457 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:12.333497 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096db17b-6e31-4c90-9a7d-969e07ad751a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:12.335295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096db17b-6e31-4c90-9a7d-969e07ad751a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:12.335768 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096db17b-6e31-4c90-9a7d-969e07ad751a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:12.336207 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096db17b-6e31-4c90-9a7d-969e07ad751a admin admin] PATH_INFO: `/v3/users/39f41cbe26414027827782201182f388` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:12.337669 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096db17b-6e31-4c90-9a7d-969e07ad751a admin admin] RBAC: Authorizing `identity:delete_user(user_id=39f41cbe26414027827782201182f388)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:12.340969 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096db17b-6e31-4c90-9a7d-969e07ad751a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:12.472502 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-096db17b-6e31-4c90-9a7d-969e07ad751a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39f41cbe26414027827782201182f388'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:12.491054 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-096db17b-6e31-4c90-9a7d-969e07ad751a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39f41cbe26414027827782201182f388'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:12.524300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-096db17b-6e31-4c90-9a7d-969e07ad751a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39f41cbe26414027827782201182f388'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:12.525380 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-096db17b-6e31-4c90-9a7d-969e07ad751a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39f41cbe26414027827782201182f388'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:12.526296 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-096db17b-6e31-4c90-9a7d-969e07ad751a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39f41cbe26414027827782201182f388'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:12.566652 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1031/2035] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:57:12 2022] DELETE /identity/v3/users/39f41cbe26414027827782201182f388 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:13.385888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0a6da-cc99-4a75-9ac3-4ebe8773cc4b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:13.387517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a5f0a6da-cc99-4a75-9ac3-4ebe8773cc4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:13.403943 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0a6da-cc99-4a75-9ac3-4ebe8773cc4b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:13.480418 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:13.511070 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea754b6-d26c-4f97-96fd-f159f4d5f4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:13.511762 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea754b6-d26c-4f97-96fd-f159f4d5f4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:13.512110 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea754b6-d26c-4f97-96fd-f159f4d5f4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:13.512817 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea754b6-d26c-4f97-96fd-f159f4d5f4e0 admin admin] PATH_INFO: `/v3/projects/58c401643627438bbed891669cc0e4c0` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:13.514004 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea754b6-d26c-4f97-96fd-f159f4d5f4e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58c401643627438bbed891669cc0e4c0)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:13.516091 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea754b6-d26c-4f97-96fd-f159f4d5f4e0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:13.608807 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0ea754b6-d26c-4f97-96fd-f159f4d5f4e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58c401643627438bbed891669cc0e4c0', 'request_id': 'req-0ea754b6-d26c-4f97-96fd-f159f4d5f4e0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:13.620759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0ea754b6-d26c-4f97-96fd-f159f4d5f4e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58c401643627438bbed891669cc0e4c0', 'request_id': 'req-0ea754b6-d26c-4f97-96fd-f159f4d5f4e0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:13.631252 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0ea754b6-d26c-4f97-96fd-f159f4d5f4e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58c401643627438bbed891669cc0e4c0', 'request_id': 'req-0ea754b6-d26c-4f97-96fd-f159f4d5f4e0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:13.645628 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0ea754b6-d26c-4f97-96fd-f159f4d5f4e0 admin admin] The token cache is being invalidate because project 58c401643627438bbed891669cc0e4c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:57:13.645930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0ea754b6-d26c-4f97-96fd-f159f4d5f4e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:13.646834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-0ea754b6-d26c-4f97-96fd-f159f4d5f4e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:13.654172 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1005/2036] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:57:13 2022] DELETE /identity/v3/projects/58c401643627438bbed891669cc0e4c0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:13.655981 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b86dc5-459c-4a6d-8d8a-836b435d9cf7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:13.656465 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b86dc5-459c-4a6d-8d8a-836b435d9cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:13.656552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b86dc5-459c-4a6d-8d8a-836b435d9cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:13.666718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed33d27-d6ee-4621-9d35-768a5900fb23 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:13.667064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed33d27-d6ee-4621-9d35-768a5900fb23 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:13.667413 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed33d27-d6ee-4621-9d35-768a5900fb23 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:13.672384 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1006/2037] 10.222.0.15 () {54 vars in 921 bytes} [Fri Sep 9 20:57:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:57:13.685139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b2b86dc5-459c-4a6d-8d8a-836b435d9cf7 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:13.686603 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b2b86dc5-459c-4a6d-8d8a-836b435d9cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:13.714414 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026ecda-f755-491d-8bdb-a8e402cea234 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:13.715042 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026ecda-f755-491d-8bdb-a8e402cea234 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:13.715506 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1026ecda-f755-491d-8bdb-a8e402cea234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:13.741972 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1026ecda-f755-491d-8bdb-a8e402cea234 None None] MFA Rules not processed for user `0fc28d9a1b3f4feca0deeb5f266f8b37`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:13.745027 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1026ecda-f755-491d-8bdb-a8e402cea234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:13.792534 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:13.830392 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1032/2038] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:13.831640 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b86dc5-459c-4a6d-8d8a-836b435d9cf7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:13.845018 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b2b86dc5-459c-4a6d-8d8a-836b435d9cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:13.866948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b86dc5-459c-4a6d-8d8a-836b435d9cf7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:13.873537 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0208aed-17eb-4c7c-a582-5c3f9a90452c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:13.874424 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0208aed-17eb-4c7c-a582-5c3f9a90452c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:13.874839 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0208aed-17eb-4c7c-a582-5c3f9a90452c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:13.875403 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0208aed-17eb-4c7c-a582-5c3f9a90452c admin admin] PATH_INFO: `/v3/users/041b8276308c417fa43afe8d052ac0fb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:13.875893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1007/2039] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Sep 9 20:57:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:13.877028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0208aed-17eb-4c7c-a582-5c3f9a90452c admin admin] RBAC: Authorizing `identity:delete_user(user_id=041b8276308c417fa43afe8d052ac0fb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:13.881747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0208aed-17eb-4c7c-a582-5c3f9a90452c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:13.882131 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bfebf-6a5f-41d1-b0c8-af626df5fdd3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:13.882530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bfebf-6a5f-41d1-b0c8-af626df5fdd3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:13.882933 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bfebf-6a5f-41d1-b0c8-af626df5fdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:13.925220 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-232bfebf-6a5f-41d1-b0c8-af626df5fdd3 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:13.926967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-232bfebf-6a5f-41d1-b0c8-af626df5fdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:13.946510 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1008/2040] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:13.950859 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bfebf-6a5f-41d1-b0c8-af626df5fdd3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:13.984515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bfebf-6a5f-41d1-b0c8-af626df5fdd3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:13.985297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b0208aed-17eb-4c7c-a582-5c3f9a90452c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '041b8276308c417fa43afe8d052ac0fb'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:13.991770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1e8a4-bcf5-4136-9147-1df82d75e9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:13.992699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1e8a4-bcf5-4136-9147-1df82d75e9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:13.993166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1e8a4-bcf5-4136-9147-1df82d75e9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:13.994406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1e8a4-bcf5-4136-9147-1df82d75e9b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:13.995413 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1e8a4-bcf5-4136-9147-1df82d75e9b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:57:13.996105 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1e8a4-bcf5-4136-9147-1df82d75e9b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:13.998421 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1e8a4-bcf5-4136-9147-1df82d75e9b8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:14.007318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b0208aed-17eb-4c7c-a582-5c3f9a90452c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '041b8276308c417fa43afe8d052ac0fb'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:14.020536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1009/2041] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:57:14.022122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1e8a4-bcf5-4136-9147-1df82d75e9b8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:14.024873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-27e1e8a4-bcf5-4136-9147-1df82d75e9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:14.025396 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b0208aed-17eb-4c7c-a582-5c3f9a90452c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '041b8276308c417fa43afe8d052ac0fb'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:14.027584 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b0208aed-17eb-4c7c-a582-5c3f9a90452c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '041b8276308c417fa43afe8d052ac0fb'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:14.029882 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b0208aed-17eb-4c7c-a582-5c3f9a90452c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '041b8276308c417fa43afe8d052ac0fb'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:14.060396 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1e8a4-bcf5-4136-9147-1df82d75e9b8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:14.066668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e988070-5256-4afd-a217-56caf67098cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc28d9a1b3f4feca0deeb5f266f8b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:14.067301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e988070-5256-4afd-a217-56caf67098cf service placement] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:14.067965 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1033/2042] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:57:13 2022] DELETE /identity/v3/users/041b8276308c417fa43afe8d052ac0fb => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:14.068324 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e988070-5256-4afd-a217-56caf67098cf service placement] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:14.068626 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e988070-5256-4afd-a217-56caf67098cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:14.068738 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0208aed-17eb-4c7c-a582-5c3f9a90452c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:14.072105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b0208aed-17eb-4c7c-a582-5c3f9a90452c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:14.085148 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7e988070-5256-4afd-a217-56caf67098cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:14.118533 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e988070-5256-4afd-a217-56caf67098cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:14.125147 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e988070-5256-4afd-a217-56caf67098cf service placement] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:14.152349 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1010/2043] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:14.207212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0208aed-17eb-4c7c-a582-5c3f9a90452c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:14.214100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c16fa-982e-43eb-a440-2383c6b796fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:14.214485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c16fa-982e-43eb-a440-2383c6b796fc admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:14.214774 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c16fa-982e-43eb-a440-2383c6b796fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:14.215053 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c16fa-982e-43eb-a440-2383c6b796fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:14.215705 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c16fa-982e-43eb-a440-2383c6b796fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:14.217843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c16fa-982e-43eb-a440-2383c6b796fc admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:14.278215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1034/2044] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:57:14 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:14.279262 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e988070-5256-4afd-a217-56caf67098cf service placement] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:14.298614 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e988070-5256-4afd-a217-56caf67098cf service placement] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:14.351000 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:14.390111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b62e5b-b9e1-4d2d-85e0-10c4626a8e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:14.390763 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b62e5b-b9e1-4d2d-85e0-10c4626a8e02 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:14.391018 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b62e5b-b9e1-4d2d-85e0-10c4626a8e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:14.391211 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b62e5b-b9e1-4d2d-85e0-10c4626a8e02 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:14.391855 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b62e5b-b9e1-4d2d-85e0-10c4626a8e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:14.394059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b62e5b-b9e1-4d2d-85e0-10c4626a8e02 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:14.406212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c16fa-982e-43eb-a440-2383c6b796fc admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:14.409265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-328c16fa-982e-43eb-a440-2383c6b796fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:14.433292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c16fa-982e-43eb-a440-2383c6b796fc admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:14.443176 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1d512-c870-4104-b51e-2af063702b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:14.443827 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1d512-c870-4104-b51e-2af063702b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:14.444134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1d512-c870-4104-b51e-2af063702b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:14.444410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1d512-c870-4104-b51e-2af063702b7f admin admin] PATH_INFO: `/v3/projects/f727d3f348504a00859acb47fcaf976f` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:14.449451 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1011/2045] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:57:14 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:14.449812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1d512-c870-4104-b51e-2af063702b7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f727d3f348504a00859acb47fcaf976f)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:14.452753 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b62e5b-b9e1-4d2d-85e0-10c4626a8e02 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:14.452880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1d512-c870-4104-b51e-2af063702b7f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:14.464680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b62e5b-b9e1-4d2d-85e0-10c4626a8e02 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:14.477155 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ea01e-a6cf-4eb8-a665-d6d973845362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:14.478937 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ea01e-a6cf-4eb8-a665-d6d973845362 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:14.478937 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ea01e-a6cf-4eb8-a665-d6d973845362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:14.478937 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ea01e-a6cf-4eb8-a665-d6d973845362 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:14.479180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ea01e-a6cf-4eb8-a665-d6d973845362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:14.490769 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ea01e-a6cf-4eb8-a665-d6d973845362 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:14.504028 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1012/2046] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:57:14.508643 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ea01e-a6cf-4eb8-a665-d6d973845362 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:14.528565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ea01e-a6cf-4eb8-a665-d6d973845362 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:14.543152 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3eb1d512-c870-4104-b51e-2af063702b7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f727d3f348504a00859acb47fcaf976f', 'request_id': 'req-3eb1d512-c870-4104-b51e-2af063702b7f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:14.545472 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:14.561475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3eb1d512-c870-4104-b51e-2af063702b7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f727d3f348504a00859acb47fcaf976f', 'request_id': 'req-3eb1d512-c870-4104-b51e-2af063702b7f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:14.575190 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3eb1d512-c870-4104-b51e-2af063702b7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f727d3f348504a00859acb47fcaf976f', 'request_id': 'req-3eb1d512-c870-4104-b51e-2af063702b7f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:14.594558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3eb1d512-c870-4104-b51e-2af063702b7f admin admin] The token cache is being invalidate because project f727d3f348504a00859acb47fcaf976f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:57:14.595175 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3eb1d512-c870-4104-b51e-2af063702b7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:14.596520 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3eb1d512-c870-4104-b51e-2af063702b7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:14.604847 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1035/2047] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:57:14 2022] DELETE /identity/v3/projects/f727d3f348504a00859acb47fcaf976f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:14.605617 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243ddc2-ea47-4a29-9f68-a8a743c749a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:14.606301 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fe327-2082-4ba1-add7-d8e5fccb4bce None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:14.606414 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243ddc2-ea47-4a29-9f68-a8a743c749a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:14.606591 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fe327-2082-4ba1-add7-d8e5fccb4bce None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:14.606699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243ddc2-ea47-4a29-9f68-a8a743c749a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:14.606893 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fe327-2082-4ba1-add7-d8e5fccb4bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:14.607215 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243ddc2-ea47-4a29-9f68-a8a743c749a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:14.608295 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243ddc2-ea47-4a29-9f68-a8a743c749a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:14.613980 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243ddc2-ea47-4a29-9f68-a8a743c749a9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:14.629829 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1013/2048] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:57:14.635729 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243ddc2-ea47-4a29-9f68-a8a743c749a9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:14.651386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e243ddc2-ea47-4a29-9f68-a8a743c749a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:14.666859 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243ddc2-ea47-4a29-9f68-a8a743c749a9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:14.672839 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbdd66-20d1-4d39-ae53-43480a555ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:14.673527 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbdd66-20d1-4d39-ae53-43480a555ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:14.673854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbdd66-20d1-4d39-ae53-43480a555ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:14.674082 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbdd66-20d1-4d39-ae53-43480a555ddf admin admin] PATH_INFO: `/v3/projects/713063914ed44494bc6c279ef7bd52c7/users/12bff01ba040454290d4fb2b255f4d9e/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:14.679772 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-605fe327-2082-4ba1-add7-d8e5fccb4bce None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:14.682635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-605fe327-2082-4ba1-add7-d8e5fccb4bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:14.692026 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbdd66-20d1-4d39-ae53-43480a555ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=713063914ed44494bc6c279ef7bd52c7, user_id=12bff01ba040454290d4fb2b255f4d9e, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:14.695580 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbdd66-20d1-4d39-ae53-43480a555ddf admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:14.696288 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1036/2049] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:14.706781 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ada7e-363e-495b-b5c5-0722f70090a6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:14.707564 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ada7e-363e-495b-b5c5-0722f70090a6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:14.713483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ada7e-363e-495b-b5c5-0722f70090a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:14.730627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1014/2050] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:14 2022] PUT /identity/v3/projects/713063914ed44494bc6c279ef7bd52c7/users/12bff01ba040454290d4fb2b255f4d9e/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:14.746140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca4666-c321-4032-8a73-b6ce227d29c2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:14.746479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca4666-c321-4032-8a73-b6ce227d29c2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:14.746760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca4666-c321-4032-8a73-b6ce227d29c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:14.772209 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f45ada7e-363e-495b-b5c5-0722f70090a6 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:14.778517 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f45ada7e-363e-495b-b5c5-0722f70090a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:14.802300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-07ca4666-c321-4032-8a73-b6ce227d29c2 None None] MFA Rules not processed for user `12bff01ba040454290d4fb2b255f4d9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:14.803578 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-07ca4666-c321-4032-8a73-b6ce227d29c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:14.911682 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1015/2051] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:14.915974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca4666-c321-4032-8a73-b6ce227d29c2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:14.941162 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1037/2052] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:14.945443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ada7e-363e-495b-b5c5-0722f70090a6 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:14.951912 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:14.967916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ada7e-363e-495b-b5c5-0722f70090a6 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:14.974766 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0440ce-d6e3-4e5f-a2e2-8b62c88e14f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:14.975420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0440ce-d6e3-4e5f-a2e2-8b62c88e14f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:14.975697 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0440ce-d6e3-4e5f-a2e2-8b62c88e14f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:14.975970 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0440ce-d6e3-4e5f-a2e2-8b62c88e14f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:14.976950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0440ce-d6e3-4e5f-a2e2-8b62c88e14f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:57:14.977323 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0440ce-d6e3-4e5f-a2e2-8b62c88e14f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:14.979863 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0440ce-d6e3-4e5f-a2e2-8b62c88e14f9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:15.003562 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1038/2053] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:57:15.019438 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0440ce-d6e3-4e5f-a2e2-8b62c88e14f9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:15.021676 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0440ce-d6e3-4e5f-a2e2-8b62c88e14f9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:15.026259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca4666-c321-4032-8a73-b6ce227d29c2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:15.028468 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003540e-0dac-4bb3-8872-0d64db01a688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:15.029447 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003540e-0dac-4bb3-8872-0d64db01a688 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:15.030196 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003540e-0dac-4bb3-8872-0d64db01a688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:15.030621 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003540e-0dac-4bb3-8872-0d64db01a688 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:15.031276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003540e-0dac-4bb3-8872-0d64db01a688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:15.035324 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36699ce6-1197-42cc-a5a5-cf8c8c442e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:15.035906 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003540e-0dac-4bb3-8872-0d64db01a688 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:15.036057 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36699ce6-1197-42cc-a5a5-cf8c8c442e18 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:15.036495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36699ce6-1197-42cc-a5a5-cf8c8c442e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:15.036842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36699ce6-1197-42cc-a5a5-cf8c8c442e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:15.037594 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36699ce6-1197-42cc-a5a5-cf8c8c442e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:15.039773 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36699ce6-1197-42cc-a5a5-cf8c8c442e18 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:15.081328 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1016/2054] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:57:14 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:15.082807 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36699ce6-1197-42cc-a5a5-cf8c8c442e18 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:15.084214 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1039/2055] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:57:15 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:57:15.088668 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003540e-0dac-4bb3-8872-0d64db01a688 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:15.170990 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003540e-0dac-4bb3-8872-0d64db01a688 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:15.180088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c85e8-8684-4d74-9842-8f889a7d3808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:15.180875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c85e8-8684-4d74-9842-8f889a7d3808 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:15.181260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c85e8-8684-4d74-9842-8f889a7d3808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:15.182189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c85e8-8684-4d74-9842-8f889a7d3808 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:15.183874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c85e8-8684-4d74-9842-8f889a7d3808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:15.186216 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36699ce6-1197-42cc-a5a5-cf8c8c442e18 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:15.187265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c85e8-8684-4d74-9842-8f889a7d3808 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:15.191968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e41a3e-63d2-4a64-80e7-d5206bba5be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:15.192989 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e41a3e-63d2-4a64-80e7-d5206bba5be0 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:15.193531 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e41a3e-63d2-4a64-80e7-d5206bba5be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:15.194118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e41a3e-63d2-4a64-80e7-d5206bba5be0 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:15.194897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e41a3e-63d2-4a64-80e7-d5206bba5be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:15.197063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e41a3e-63d2-4a64-80e7-d5206bba5be0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:15.242572 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1017/2056] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:57:15 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:57:15.244444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1040/2057] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:57:15 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:15.244898 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e41a3e-63d2-4a64-80e7-d5206bba5be0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:15.251121 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c85e8-8684-4d74-9842-8f889a7d3808 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:15.261429 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e41a3e-63d2-4a64-80e7-d5206bba5be0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:15.262479 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c85e8-8684-4d74-9842-8f889a7d3808 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:15.271514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543a03b-2e5a-4758-8497-3849ccb466ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:15.272449 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99693d-15e6-4175-81cd-9bc4bf7ec8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:15.273256 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99693d-15e6-4175-81cd-9bc4bf7ec8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:15.273709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99693d-15e6-4175-81cd-9bc4bf7ec8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:15.274179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99693d-15e6-4175-81cd-9bc4bf7ec8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:15.275009 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99693d-15e6-4175-81cd-9bc4bf7ec8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:15.277022 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99693d-15e6-4175-81cd-9bc4bf7ec8c6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:15.277892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543a03b-2e5a-4758-8497-3849ccb466ce admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:15.278357 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543a03b-2e5a-4758-8497-3849ccb466ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:15.280184 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543a03b-2e5a-4758-8497-3849ccb466ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:15.281718 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543a03b-2e5a-4758-8497-3849ccb466ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:15.292860 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543a03b-2e5a-4758-8497-3849ccb466ce admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:15.308050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1041/2058] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:15.309702 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543a03b-2e5a-4758-8497-3849ccb466ce admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:15.313827 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1018/2059] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:15.314801 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99693d-15e6-4175-81cd-9bc4bf7ec8c6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:15.321852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543a03b-2e5a-4758-8497-3849ccb466ce admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:15.336424 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf4e83-0dec-4f02-b4f9-ce6a0384d1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:15.337352 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf4e83-0dec-4f02-b4f9-ce6a0384d1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:15.337808 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf4e83-0dec-4f02-b4f9-ce6a0384d1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:15.338313 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf4e83-0dec-4f02-b4f9-ce6a0384d1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:15.339287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf4e83-0dec-4f02-b4f9-ce6a0384d1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:15.341108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf4e83-0dec-4f02-b4f9-ce6a0384d1e3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:15.348016 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99693d-15e6-4175-81cd-9bc4bf7ec8c6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:15.353062 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087bee6-88f1-49b3-a377-a2c1edabe885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:15.353819 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087bee6-88f1-49b3-a377-a2c1edabe885 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:15.354100 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087bee6-88f1-49b3-a377-a2c1edabe885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:15.354380 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087bee6-88f1-49b3-a377-a2c1edabe885 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:15.355236 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087bee6-88f1-49b3-a377-a2c1edabe885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:15.359093 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1042/2060] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:15.359289 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087bee6-88f1-49b3-a377-a2c1edabe885 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:15.364574 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf4e83-0dec-4f02-b4f9-ce6a0384d1e3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:15.376039 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:15.378988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf4e83-0dec-4f02-b4f9-ce6a0384d1e3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:15.387799 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1019/2061] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:15.388099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e43c6b-b97a-4d55-89d9-8f40e31a304c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:15.388946 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e43c6b-b97a-4d55-89d9-8f40e31a304c admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:15.389445 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e43c6b-b97a-4d55-89d9-8f40e31a304c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:15.389843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e43c6b-b97a-4d55-89d9-8f40e31a304c admin admin] PATH_INFO: `/v3/projects/ebad8afe013747a9982e795613291d8f/users/139c8e5507ca4d799ced63b73ce1f9cb/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:15.394232 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087bee6-88f1-49b3-a377-a2c1edabe885 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:15.407477 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087bee6-88f1-49b3-a377-a2c1edabe885 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:15.411882 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e43c6b-b97a-4d55-89d9-8f40e31a304c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebad8afe013747a9982e795613291d8f, user_id=139c8e5507ca4d799ced63b73ce1f9cb, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:15.414025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fcb104-da2c-46c1-bdf4-4c74140b534e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:15.415359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcb104-da2c-46c1-bdf4-4c74140b534e admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:15.415719 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcb104-da2c-46c1-bdf4-4c74140b534e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:15.416150 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcb104-da2c-46c1-bdf4-4c74140b534e admin admin] PATH_INFO: `/v3/projects/8ad4698c46ec40c8bfff02e1d352abf6/users/6a2e8fc50d1e47bf8a540c35f9094bf0/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:15.417672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e43c6b-b97a-4d55-89d9-8f40e31a304c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:15.440710 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1043/2062] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:15 2022] PUT /identity/v3/projects/ebad8afe013747a9982e795613291d8f/users/139c8e5507ca4d799ced63b73ce1f9cb/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:15.442147 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fcb104-da2c-46c1-bdf4-4c74140b534e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ad4698c46ec40c8bfff02e1d352abf6, user_id=6a2e8fc50d1e47bf8a540c35f9094bf0, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:15.445015 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fcb104-da2c-46c1-bdf4-4c74140b534e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:15.451528 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe54f67-033a-4a96-a753-420e575c061a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:15.452442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe54f67-033a-4a96-a753-420e575c061a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:15.453068 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe54f67-033a-4a96-a753-420e575c061a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:15.480666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1020/2063] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:15 2022] PUT /identity/v3/projects/8ad4698c46ec40c8bfff02e1d352abf6/users/6a2e8fc50d1e47bf8a540c35f9094bf0/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:15.482422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7740ebc-6a7b-440f-b909-537e21c34d5e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:15.482713 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7740ebc-6a7b-440f-b909-537e21c34d5e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:15.482992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7740ebc-6a7b-440f-b909-537e21c34d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:15.491796 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6fe54f67-033a-4a96-a753-420e575c061a None None] MFA Rules not processed for user `139c8e5507ca4d799ced63b73ce1f9cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:15.493297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6fe54f67-033a-4a96-a753-420e575c061a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:15.544181 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f7740ebc-6a7b-440f-b909-537e21c34d5e None None] MFA Rules not processed for user `6a2e8fc50d1e47bf8a540c35f9094bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:15.545806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f7740ebc-6a7b-440f-b909-537e21c34d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:15.587330 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:15.599745 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1044/2064] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:57:15.601700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe54f67-033a-4a96-a753-420e575c061a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:15.667280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1021/2065] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:57:15.672407 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7740ebc-6a7b-440f-b909-537e21c34d5e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:15.711681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe54f67-033a-4a96-a753-420e575c061a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:15.724655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af648c-a926-49a7-be52-47a921233f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:15.725635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af648c-a926-49a7-be52-47a921233f6f admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:15.726140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af648c-a926-49a7-be52-47a921233f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:15.727369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af648c-a926-49a7-be52-47a921233f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:15.729172 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af648c-a926-49a7-be52-47a921233f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:15.732705 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af648c-a926-49a7-be52-47a921233f6f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:15.777132 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1045/2066] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:57:15 2022] POST /identity/v3/projects => generated 369 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:15.781124 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af648c-a926-49a7-be52-47a921233f6f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:15.782382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7740ebc-6a7b-440f-b909-537e21c34d5e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:15.870887 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d6a1c-1459-44aa-8e9e-e20f5bf77364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:15.871675 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d6a1c-1459-44aa-8e9e-e20f5bf77364 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:15.873246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d6a1c-1459-44aa-8e9e-e20f5bf77364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:15.873713 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d6a1c-1459-44aa-8e9e-e20f5bf77364 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:15.874471 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d6a1c-1459-44aa-8e9e-e20f5bf77364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:15.878123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d6a1c-1459-44aa-8e9e-e20f5bf77364 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:15.925398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1022/2067] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:57:15 2022] POST /identity/v3/projects => generated 383 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:15.930755 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d6a1c-1459-44aa-8e9e-e20f5bf77364 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:15.941132 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:15.951818 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af648c-a926-49a7-be52-47a921233f6f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:16.030152 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62001b-1a8b-424d-90ec-29e8e9400e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:16.031017 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62001b-1a8b-424d-90ec-29e8e9400e4e admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:16.031264 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62001b-1a8b-424d-90ec-29e8e9400e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:16.031639 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a62001b-1a8b-424d-90ec-29e8e9400e4e admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:16.032537 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a62001b-1a8b-424d-90ec-29e8e9400e4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:16.035670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a62001b-1a8b-424d-90ec-29e8e9400e4e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:16.039007 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d6a1c-1459-44aa-8e9e-e20f5bf77364 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:16.047562 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761311a8-dbc3-4902-af5d-6df9ca86edcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:16.049137 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761311a8-dbc3-4902-af5d-6df9ca86edcd admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:16.049965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761311a8-dbc3-4902-af5d-6df9ca86edcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:16.050277 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761311a8-dbc3-4902-af5d-6df9ca86edcd admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:16.051379 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761311a8-dbc3-4902-af5d-6df9ca86edcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:16.053686 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761311a8-dbc3-4902-af5d-6df9ca86edcd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:16.064570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:16.069988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1046/2068] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:57:15 2022] POST /identity/v3/users => generated 291 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:16.074859 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62001b-1a8b-424d-90ec-29e8e9400e4e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:16.092687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a62001b-1a8b-424d-90ec-29e8e9400e4e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:16.098673 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b55c8e-e447-44a3-a204-667689d5dd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:16.099425 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b55c8e-e447-44a3-a204-667689d5dd59 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:16.100411 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b55c8e-e447-44a3-a204-667689d5dd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:16.100411 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b55c8e-e447-44a3-a204-667689d5dd59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:16.100998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b55c8e-e447-44a3-a204-667689d5dd59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:16.103056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b55c8e-e447-44a3-a204-667689d5dd59 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:16.105952 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1023/2069] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:57:15 2022] POST /identity/v3/users => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:16.109189 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761311a8-dbc3-4902-af5d-6df9ca86edcd admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:16.118783 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1047/2070] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:16.119917 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b55c8e-e447-44a3-a204-667689d5dd59 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:16.128317 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761311a8-dbc3-4902-af5d-6df9ca86edcd admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:16.134445 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b55c8e-e447-44a3-a204-667689d5dd59 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:16.135570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886e979-8bfb-4d95-9e81-f056b4f812cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:16.137157 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886e979-8bfb-4d95-9e81-f056b4f812cb admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:16.137620 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886e979-8bfb-4d95-9e81-f056b4f812cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:16.138047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886e979-8bfb-4d95-9e81-f056b4f812cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:16.139623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886e979-8bfb-4d95-9e81-f056b4f812cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:16.140253 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00273c84-8a4a-4a90-a46b-830357819284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:16.141771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00273c84-8a4a-4a90-a46b-830357819284 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:16.141771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00273c84-8a4a-4a90-a46b-830357819284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:16.142273 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00273c84-8a4a-4a90-a46b-830357819284 admin admin] PATH_INFO: `/v3/projects/efae0da6cb7347e59aaa67f8333aa2f0/users/46cd1d19d19d4a649010b2a54ba2ec3a/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:16.142965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886e979-8bfb-4d95-9e81-f056b4f812cb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:16.165432 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1024/2071] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:16.169727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886e979-8bfb-4d95-9e81-f056b4f812cb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:16.180774 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00273c84-8a4a-4a90-a46b-830357819284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efae0da6cb7347e59aaa67f8333aa2f0, user_id=46cd1d19d19d4a649010b2a54ba2ec3a, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:16.184840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886e979-8bfb-4d95-9e81-f056b4f812cb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:16.187901 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00273c84-8a4a-4a90-a46b-830357819284 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:16.193991 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c953ef-0bfe-4f5f-8637-1aad303b129b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:16.196264 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c953ef-0bfe-4f5f-8637-1aad303b129b admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:16.196826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c953ef-0bfe-4f5f-8637-1aad303b129b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:16.197491 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c953ef-0bfe-4f5f-8637-1aad303b129b admin admin] PATH_INFO: `/v3/projects/620c6ea0401a4e5f9e3c3b7fea98315d/users/ed2ea5bc9a5746cc9498bf8ce507ff2b/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:16.213070 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1048/2072] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:16 2022] PUT /identity/v3/projects/efae0da6cb7347e59aaa67f8333aa2f0/users/46cd1d19d19d4a649010b2a54ba2ec3a/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:16.216858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00273c84-8a4a-4a90-a46b-830357819284 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:16.224096 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c953ef-0bfe-4f5f-8637-1aad303b129b admin admin] RBAC: Authorizing `identity:create_grant(project_id=620c6ea0401a4e5f9e3c3b7fea98315d, user_id=ed2ea5bc9a5746cc9498bf8ce507ff2b, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:16.228268 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c953ef-0bfe-4f5f-8637-1aad303b129b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:16.251111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1025/2073] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:16 2022] PUT /identity/v3/projects/620c6ea0401a4e5f9e3c3b7fea98315d/users/ed2ea5bc9a5746cc9498bf8ce507ff2b/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:57:16.255347 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c953ef-0bfe-4f5f-8637-1aad303b129b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:16.355336 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00273c84-8a4a-4a90-a46b-830357819284 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:16.399611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c953ef-0bfe-4f5f-8637-1aad303b129b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:16.414064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17e33a-ec7e-453a-bc20-29f4ab0a8c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:16.414950 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17e33a-ec7e-453a-bc20-29f4ab0a8c8c admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:16.415314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17e33a-ec7e-453a-bc20-29f4ab0a8c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:16.415977 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17e33a-ec7e-453a-bc20-29f4ab0a8c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:16.417960 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17e33a-ec7e-453a-bc20-29f4ab0a8c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:16.423553 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17e33a-ec7e-453a-bc20-29f4ab0a8c8c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:16.445068 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1026/2074] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:16.450150 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17e33a-ec7e-453a-bc20-29f4ab0a8c8c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:16.484027 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17e33a-ec7e-453a-bc20-29f4ab0a8c8c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:16.497781 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b69f63-11f4-45dd-8ac8-6d85de309dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:16.498478 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b69f63-11f4-45dd-8ac8-6d85de309dea admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:16.498766 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b69f63-11f4-45dd-8ac8-6d85de309dea admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:16.499045 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b69f63-11f4-45dd-8ac8-6d85de309dea admin admin] PATH_INFO: `/v3/projects/620c6ea0401a4e5f9e3c3b7fea98315d/users/ed2ea5bc9a5746cc9498bf8ce507ff2b/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:16.503421 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a52a36-fe8d-4117-9cfc-26f704806439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:16.504326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b69f63-11f4-45dd-8ac8-6d85de309dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=620c6ea0401a4e5f9e3c3b7fea98315d, user_id=ed2ea5bc9a5746cc9498bf8ce507ff2b, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:16.505399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a52a36-fe8d-4117-9cfc-26f704806439 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:16.506017 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a52a36-fe8d-4117-9cfc-26f704806439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:16.506445 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a52a36-fe8d-4117-9cfc-26f704806439 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:16.507099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b69f63-11f4-45dd-8ac8-6d85de309dea admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:16.507467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a52a36-fe8d-4117-9cfc-26f704806439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:16.510275 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a52a36-fe8d-4117-9cfc-26f704806439 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:16.518998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:16.531523 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1049/2075] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:57:16.532889 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a52a36-fe8d-4117-9cfc-26f704806439 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:16.546942 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a52a36-fe8d-4117-9cfc-26f704806439 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:16.550224 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1027/2076] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:16 2022] PUT /identity/v3/projects/620c6ea0401a4e5f9e3c3b7fea98315d/users/ed2ea5bc9a5746cc9498bf8ce507ff2b/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:16.551887 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64268d-db83-4215-a665-a758e709de55 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:16.553895 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64268d-db83-4215-a665-a758e709de55 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:16.554314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64268d-db83-4215-a665-a758e709de55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:16.607549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0d64268d-db83-4215-a665-a758e709de55 None None] MFA Rules not processed for user `ed2ea5bc9a5746cc9498bf8ce507ff2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:16.609165 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0d64268d-db83-4215-a665-a758e709de55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:16.715502 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3f6db-3e77-4c26-a177-0f10c7d0576b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:16.716326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3f6db-3e77-4c26-a177-0f10c7d0576b admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:16.716597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3f6db-3e77-4c26-a177-0f10c7d0576b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:16.716914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3f6db-3e77-4c26-a177-0f10c7d0576b admin admin] PATH_INFO: `/v3/projects/efae0da6cb7347e59aaa67f8333aa2f0/users/46cd1d19d19d4a649010b2a54ba2ec3a/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:16.719431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3f6db-3e77-4c26-a177-0f10c7d0576b admin admin] RBAC: Authorizing `identity:create_grant(project_id=efae0da6cb7347e59aaa67f8333aa2f0, user_id=46cd1d19d19d4a649010b2a54ba2ec3a, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:16.722873 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3f6db-3e77-4c26-a177-0f10c7d0576b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:16.750264 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1050/2077] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:16 2022] PUT /identity/v3/projects/efae0da6cb7347e59aaa67f8333aa2f0/users/46cd1d19d19d4a649010b2a54ba2ec3a/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:16.766095 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772bc41-29ab-40c3-b728-818c7001ea16 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:16.766386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772bc41-29ab-40c3-b728-818c7001ea16 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:16.767036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772bc41-29ab-40c3-b728-818c7001ea16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:16.780917 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1028/2078] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:16.802622 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397b6de-dd71-440b-b526-0c420c5b1525 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:16.804406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397b6de-dd71-440b-b526-0c420c5b1525 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:16.805783 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397b6de-dd71-440b-b526-0c420c5b1525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:16.824618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1772bc41-29ab-40c3-b728-818c7001ea16 None None] MFA Rules not processed for user `46cd1d19d19d4a649010b2a54ba2ec3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:16.828754 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1772bc41-29ab-40c3-b728-818c7001ea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:16.850746 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3397b6de-dd71-440b-b526-0c420c5b1525 None None] MFA Rules not processed for user `d4e5f1d369d94d00a56cbcfb69be01e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:16.852136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3397b6de-dd71-440b-b526-0c420c5b1525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:16.890907 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:16.964712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1051/2079] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:57:16.965884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772bc41-29ab-40c3-b728-818c7001ea16 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:16.967601 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1772bc41-29ab-40c3-b728-818c7001ea16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:16.985159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1029/2080] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:57:16.986051 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397b6de-dd71-440b-b526-0c420c5b1525 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:16.987657 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3397b6de-dd71-440b-b526-0c420c5b1525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:17.035701 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772bc41-29ab-40c3-b728-818c7001ea16 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:17.039783 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a0943-5652-4625-bcf1-d2ede1027caa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:17.040435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a0943-5652-4625-bcf1-d2ede1027caa service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:17.040717 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a0943-5652-4625-bcf1-d2ede1027caa service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:17.041125 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a0943-5652-4625-bcf1-d2ede1027caa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:17.064270 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397b6de-dd71-440b-b526-0c420c5b1525 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:17.074110 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a5f8f-a544-4c09-890e-76d4d8833d2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:17.075058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a5f8f-a544-4c09-890e-76d4d8833d2d service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:17.075344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a5f8f-a544-4c09-890e-76d4d8833d2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:17.075623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a5f8f-a544-4c09-890e-76d4d8833d2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:17.087961 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a5f8f-a544-4c09-890e-76d4d8833d2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:17.089621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a5f8f-a544-4c09-890e-76d4d8833d2d service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:17.090827 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:17.103445 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1030/2081] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:17.104264 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a5f8f-a544-4c09-890e-76d4d8833d2d service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:17.106144 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-511a5f8f-a544-4c09-890e-76d4d8833d2d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:17.131126 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a0943-5652-4625-bcf1-d2ede1027caa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:17.133020 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83a0943-5652-4625-bcf1-d2ede1027caa service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:17.152749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1052/2082] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:17.220519 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a0943-5652-4625-bcf1-d2ede1027caa service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:17.229865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a5f8f-a544-4c09-890e-76d4d8833d2d service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:17.230070 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a0943-5652-4625-bcf1-d2ede1027caa service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:17.240794 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf19eec-009a-4861-b832-e8f854cecb4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:17.241853 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf19eec-009a-4861-b832-e8f854cecb4d service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:17.242326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf19eec-009a-4861-b832-e8f854cecb4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:17.242894 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf19eec-009a-4861-b832-e8f854cecb4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:17.247461 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92b029-27c7-4fcf-9aef-86e727ebdcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:17.248262 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92b029-27c7-4fcf-9aef-86e727ebdcd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:17.248662 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92b029-27c7-4fcf-9aef-86e727ebdcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:17.249172 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92b029-27c7-4fcf-9aef-86e727ebdcd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:17.249918 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92b029-27c7-4fcf-9aef-86e727ebdcd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:17.253300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92b029-27c7-4fcf-9aef-86e727ebdcd0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:17.311021 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1031/2083] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:57:17 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:17.315923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92b029-27c7-4fcf-9aef-86e727ebdcd0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:17.373613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf19eec-009a-4861-b832-e8f854cecb4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:17.382525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf19eec-009a-4861-b832-e8f854cecb4d service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:17.399381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:17.400860 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1053/2084] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 20:57:17.431901 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92b029-27c7-4fcf-9aef-86e727ebdcd0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:17.437236 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e034c-427f-4a9a-9b58-65de856188c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:17.438984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e034c-427f-4a9a-9b58-65de856188c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:17.439273 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e034c-427f-4a9a-9b58-65de856188c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:17.439671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e034c-427f-4a9a-9b58-65de856188c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:17.441803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e034c-427f-4a9a-9b58-65de856188c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:17.443886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e034c-427f-4a9a-9b58-65de856188c5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:17.476553 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1032/2085] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:57:17 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:57:17.478380 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf19eec-009a-4861-b832-e8f854cecb4d service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:17.493192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf19eec-009a-4861-b832-e8f854cecb4d service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:17.499392 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3fa6f-19e4-47e3-bfa6-db8d2e811df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:17.500238 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3fa6f-19e4-47e3-bfa6-db8d2e811df0 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:17.500558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3fa6f-19e4-47e3-bfa6-db8d2e811df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:17.500833 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3fa6f-19e4-47e3-bfa6-db8d2e811df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:17.501487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3fa6f-19e4-47e3-bfa6-db8d2e811df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:17.505643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3fa6f-19e4-47e3-bfa6-db8d2e811df0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:17.524419 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1054/2086] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:57:17.526809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e034c-427f-4a9a-9b58-65de856188c5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:17.538511 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e034c-427f-4a9a-9b58-65de856188c5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:17.551235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f859200-2166-481c-870e-f5dfb0f0b5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:17.552989 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f859200-2166-481c-870e-f5dfb0f0b5cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:17.554096 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f859200-2166-481c-870e-f5dfb0f0b5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:17.554823 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f859200-2166-481c-870e-f5dfb0f0b5cf admin admin] PATH_INFO: `/v3/projects/d75d66006e5041cc8ed68c4d0a8df4f0/users/4608e9da3bff4e4cab7ab7f294e8281b/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:17.582805 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f859200-2166-481c-870e-f5dfb0f0b5cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d75d66006e5041cc8ed68c4d0a8df4f0, user_id=4608e9da3bff4e4cab7ab7f294e8281b, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:17.585796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f859200-2166-481c-870e-f5dfb0f0b5cf admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:17.619776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1033/2087] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:17 2022] PUT /identity/v3/projects/d75d66006e5041cc8ed68c4d0a8df4f0/users/4608e9da3bff4e4cab7ab7f294e8281b/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:17.621095 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3fa6f-19e4-47e3-bfa6-db8d2e811df0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:17.642345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3fa6f-19e4-47e3-bfa6-db8d2e811df0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:17.716809 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaea987-9d60-45d7-b156-c377e8d951e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:17.718271 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaea987-9d60-45d7-b156-c377e8d951e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:17.718767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaea987-9d60-45d7-b156-c377e8d951e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:17.719240 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaea987-9d60-45d7-b156-c377e8d951e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:17.720463 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaea987-9d60-45d7-b156-c377e8d951e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:17.723361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaea987-9d60-45d7-b156-c377e8d951e9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:17.736300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1055/2088] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:17.738854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f859200-2166-481c-870e-f5dfb0f0b5cf admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:17.749541 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f859200-2166-481c-870e-f5dfb0f0b5cf admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:17.754358 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea28455-c8e1-4b15-b2ef-e49c4f273bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:17.755026 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea28455-c8e1-4b15-b2ef-e49c4f273bf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:17.755301 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea28455-c8e1-4b15-b2ef-e49c4f273bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:17.755571 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea28455-c8e1-4b15-b2ef-e49c4f273bf0 admin admin] PATH_INFO: `/v3/projects/d75d66006e5041cc8ed68c4d0a8df4f0/users/4608e9da3bff4e4cab7ab7f294e8281b/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:17.757526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea28455-c8e1-4b15-b2ef-e49c4f273bf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d75d66006e5041cc8ed68c4d0a8df4f0, user_id=4608e9da3bff4e4cab7ab7f294e8281b, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:17.760473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea28455-c8e1-4b15-b2ef-e49c4f273bf0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:17.773021 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1034/2089] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:17 2022] PUT /identity/v3/projects/d75d66006e5041cc8ed68c4d0a8df4f0/users/4608e9da3bff4e4cab7ab7f294e8281b/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:18.298526 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaea987-9d60-45d7-b156-c377e8d951e9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:18.402472 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaea987-9d60-45d7-b156-c377e8d951e9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:18.412960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:18.460554 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31796755-1267-4156-9ea6-192c1343e199 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:18.461194 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31796755-1267-4156-9ea6-192c1343e199 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:18.461480 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31796755-1267-4156-9ea6-192c1343e199 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:18.462235 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31796755-1267-4156-9ea6-192c1343e199 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:18.464108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-31796755-1267-4156-9ea6-192c1343e199 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:18.572013 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31796755-1267-4156-9ea6-192c1343e199 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:18.574162 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31796755-1267-4156-9ea6-192c1343e199 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:18.592829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1056/2090] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:19.404721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea28455-c8e1-4b15-b2ef-e49c4f273bf0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:19.421170 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea28455-c8e1-4b15-b2ef-e49c4f273bf0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:19.428047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53e81b-69b5-4a02-bf20-fe5a60d20f4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:19.428945 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53e81b-69b5-4a02-bf20-fe5a60d20f4a service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:19.429663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53e81b-69b5-4a02-bf20-fe5a60d20f4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:19.430087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53e81b-69b5-4a02-bf20-fe5a60d20f4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:19.508385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53e81b-69b5-4a02-bf20-fe5a60d20f4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:19.510107 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53e81b-69b5-4a02-bf20-fe5a60d20f4a service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:19.522456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1035/2091] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:20.525763 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31796755-1267-4156-9ea6-192c1343e199 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:20.537726 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31796755-1267-4156-9ea6-192c1343e199 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:20.546780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd63d0-4fe1-45ad-bc4b-ca4509ef0681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:20.547767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd63d0-4fe1-45ad-bc4b-ca4509ef0681 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:20.548099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd63d0-4fe1-45ad-bc4b-ca4509ef0681 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:20.548381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd63d0-4fe1-45ad-bc4b-ca4509ef0681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:20.645203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd63d0-4fe1-45ad-bc4b-ca4509ef0681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:20.647270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd63d0-4fe1-45ad-bc4b-ca4509ef0681 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:20.676160 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1057/2092] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:23.576933 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce28537-619c-4b6f-a270-8300dfbf51d0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:23.577730 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce28537-619c-4b6f-a270-8300dfbf51d0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:23.578138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce28537-619c-4b6f-a270-8300dfbf51d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:23.620154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2ce28537-619c-4b6f-a270-8300dfbf51d0 None None] MFA Rules not processed for user `4608e9da3bff4e4cab7ab7f294e8281b`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:23.621467 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2ce28537-619c-4b6f-a270-8300dfbf51d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:23.705964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1036/2093] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:23.723669 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd63d0-4fe1-45ad-bc4b-ca4509ef0681 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:23.725348 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8dbd63d0-4fe1-45ad-bc4b-ca4509ef0681 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:23.834289 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:23.866024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd63d0-4fe1-45ad-bc4b-ca4509ef0681 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:23.872800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6693ae-4a53-45b9-98fd-82be3513924f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d298efe48464956b7a03cba1001060b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:23.873513 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6693ae-4a53-45b9-98fd-82be3513924f service glance] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:23.873815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6693ae-4a53-45b9-98fd-82be3513924f service glance] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:23.874088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6693ae-4a53-45b9-98fd-82be3513924f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:23.971902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6693ae-4a53-45b9-98fd-82be3513924f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:23.975249 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6693ae-4a53-45b9-98fd-82be3513924f service glance] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:24.030174 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1058/2094] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:24.253318 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa992ca9-72d6-41de-b60b-4cded2eb3c54 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:24.253980 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa992ca9-72d6-41de-b60b-4cded2eb3c54 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:24.254236 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa992ca9-72d6-41de-b60b-4cded2eb3c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:24.281056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-aa992ca9-72d6-41de-b60b-4cded2eb3c54 None None] MFA Rules not processed for user `e51ae6959aac49898e75c6786c5dbdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:24.282368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-aa992ca9-72d6-41de-b60b-4cded2eb3c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:24.314125 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:24.399194 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1037/2095] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Sep 9 20:57:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:24.464711 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6693ae-4a53-45b9-98fd-82be3513924f service glance] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:24.466377 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2a6693ae-4a53-45b9-98fd-82be3513924f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:24.567211 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6693ae-4a53-45b9-98fd-82be3513924f service glance] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:24.572339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579df34-8b8c-44e8-b04a-7f9f1e328cda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9570eaa112de460cb9e371278bfb300b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:24.572984 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579df34-8b8c-44e8-b04a-7f9f1e328cda service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:24.573262 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579df34-8b8c-44e8-b04a-7f9f1e328cda service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:24.573540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579df34-8b8c-44e8-b04a-7f9f1e328cda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:24.583388 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579df34-8b8c-44e8-b04a-7f9f1e328cda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:24.585681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579df34-8b8c-44e8-b04a-7f9f1e328cda service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:24.599231 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1059/2096] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Sep 9 20:57:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 20:57:25.304603 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa992ca9-72d6-41de-b60b-4cded2eb3c54 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:25.441647 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa992ca9-72d6-41de-b60b-4cded2eb3c54 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:25.451833 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20ecb5-9317-4ced-af2b-9e46b654b5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:25.452623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20ecb5-9317-4ced-af2b-9e46b654b5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:25.453130 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20ecb5-9317-4ced-af2b-9e46b654b5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:25.453632 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20ecb5-9317-4ced-af2b-9e46b654b5d2 admin admin] PATH_INFO: `/v3/users/12bff01ba040454290d4fb2b255f4d9e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:25.454948 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20ecb5-9317-4ced-af2b-9e46b654b5d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12bff01ba040454290d4fb2b255f4d9e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:25.457154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20ecb5-9317-4ced-af2b-9e46b654b5d2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:25.529911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ce20ecb5-9317-4ced-af2b-9e46b654b5d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12bff01ba040454290d4fb2b255f4d9e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:25.544380 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ce20ecb5-9317-4ced-af2b-9e46b654b5d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12bff01ba040454290d4fb2b255f4d9e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:25.547601 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ce20ecb5-9317-4ced-af2b-9e46b654b5d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12bff01ba040454290d4fb2b255f4d9e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:25.550506 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ce20ecb5-9317-4ced-af2b-9e46b654b5d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12bff01ba040454290d4fb2b255f4d9e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:25.561724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ce20ecb5-9317-4ced-af2b-9e46b654b5d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12bff01ba040454290d4fb2b255f4d9e'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:25.583601 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1038/2097] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:57:25 2022] DELETE /identity/v3/users/12bff01ba040454290d4fb2b255f4d9e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:25.587929 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e76c7-dd54-43f6-bfb3-cd0a8bc85999 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:25.588957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e76c7-dd54-43f6-bfb3-cd0a8bc85999 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:25.589384 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e76c7-dd54-43f6-bfb3-cd0a8bc85999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:25.622437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-383e76c7-dd54-43f6-bfb3-cd0a8bc85999 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:25.623678 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-383e76c7-dd54-43f6-bfb3-cd0a8bc85999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:25.742699 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1060/2098] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:57:25.754982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20ecb5-9317-4ced-af2b-9e46b654b5d2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:25.756926 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ce20ecb5-9317-4ced-af2b-9e46b654b5d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:25.850594 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:25.867915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20ecb5-9317-4ced-af2b-9e46b654b5d2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:25.899806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d758e-a171-4620-b039-ed33604a84bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:25.900594 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d758e-a171-4620-b039-ed33604a84bb service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:25.901036 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d758e-a171-4620-b039-ed33604a84bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:25.901736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d758e-a171-4620-b039-ed33604a84bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:25.932862 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d758e-a171-4620-b039-ed33604a84bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:25.934341 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d758e-a171-4620-b039-ed33604a84bb service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:25.947486 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1039/2099] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:26.546455 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e76c7-dd54-43f6-bfb3-cd0a8bc85999 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:26.548837 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-383e76c7-dd54-43f6-bfb3-cd0a8bc85999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:26.575087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e76c7-dd54-43f6-bfb3-cd0a8bc85999 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:26.585449 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24869274-d058-4dbf-b8df-51949fa32eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:26.588416 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24869274-d058-4dbf-b8df-51949fa32eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:26.588416 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24869274-d058-4dbf-b8df-51949fa32eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:26.588416 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24869274-d058-4dbf-b8df-51949fa32eb5 admin admin] PATH_INFO: `/v3/projects/713063914ed44494bc6c279ef7bd52c7` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:26.589227 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24869274-d058-4dbf-b8df-51949fa32eb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=713063914ed44494bc6c279ef7bd52c7)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:26.590439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24869274-d058-4dbf-b8df-51949fa32eb5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:26.619487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:26.661868 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-24869274-d058-4dbf-b8df-51949fa32eb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '713063914ed44494bc6c279ef7bd52c7', 'request_id': 'req-24869274-d058-4dbf-b8df-51949fa32eb5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:26.671921 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-24869274-d058-4dbf-b8df-51949fa32eb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '713063914ed44494bc6c279ef7bd52c7', 'request_id': 'req-24869274-d058-4dbf-b8df-51949fa32eb5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:26.680441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-24869274-d058-4dbf-b8df-51949fa32eb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '713063914ed44494bc6c279ef7bd52c7', 'request_id': 'req-24869274-d058-4dbf-b8df-51949fa32eb5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:26.695077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-24869274-d058-4dbf-b8df-51949fa32eb5 admin admin] The token cache is being invalidate because project 713063914ed44494bc6c279ef7bd52c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:57:26.695475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-24869274-d058-4dbf-b8df-51949fa32eb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:26.696451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-24869274-d058-4dbf-b8df-51949fa32eb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:26.701408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1061/2100] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:57:26 2022] DELETE /identity/v3/projects/713063914ed44494bc6c279ef7bd52c7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:26.702518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d758e-a171-4620-b039-ed33604a84bb service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:26.715439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d758e-a171-4620-b039-ed33604a84bb service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:26.787524 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7941de-5aeb-47a8-90c8-ec5265a5a2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:26.788197 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7941de-5aeb-47a8-90c8-ec5265a5a2cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:26.788477 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7941de-5aeb-47a8-90c8-ec5265a5a2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:26.788756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7941de-5aeb-47a8-90c8-ec5265a5a2cd admin admin] PATH_INFO: `/v3/users/6a2e8fc50d1e47bf8a540c35f9094bf0` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:26.790133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7941de-5aeb-47a8-90c8-ec5265a5a2cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a2e8fc50d1e47bf8a540c35f9094bf0)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:26.792287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7941de-5aeb-47a8-90c8-ec5265a5a2cd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:26.850108 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fa7941de-5aeb-47a8-90c8-ec5265a5a2cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a2e8fc50d1e47bf8a540c35f9094bf0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:26.862360 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fa7941de-5aeb-47a8-90c8-ec5265a5a2cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a2e8fc50d1e47bf8a540c35f9094bf0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:26.863048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fa7941de-5aeb-47a8-90c8-ec5265a5a2cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a2e8fc50d1e47bf8a540c35f9094bf0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:26.864297 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fa7941de-5aeb-47a8-90c8-ec5265a5a2cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a2e8fc50d1e47bf8a540c35f9094bf0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:26.873329 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fa7941de-5aeb-47a8-90c8-ec5265a5a2cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a2e8fc50d1e47bf8a540c35f9094bf0'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:26.899763 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1040/2101] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:57:26 2022] DELETE /identity/v3/users/6a2e8fc50d1e47bf8a540c35f9094bf0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:27.314019 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24869274-d058-4dbf-b8df-51949fa32eb5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:27.318330 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-24869274-d058-4dbf-b8df-51949fa32eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:27.348271 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24869274-d058-4dbf-b8df-51949fa32eb5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:27.504913 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce603df2-3e6d-4bda-9298-2cd15907de7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:27.505571 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce603df2-3e6d-4bda-9298-2cd15907de7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:27.505845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce603df2-3e6d-4bda-9298-2cd15907de7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:27.506116 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce603df2-3e6d-4bda-9298-2cd15907de7e admin admin] PATH_INFO: `/v3/projects/8ad4698c46ec40c8bfff02e1d352abf6` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:27.507256 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce603df2-3e6d-4bda-9298-2cd15907de7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ad4698c46ec40c8bfff02e1d352abf6)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:27.513938 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce603df2-3e6d-4bda-9298-2cd15907de7e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:27.583110 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ce603df2-3e6d-4bda-9298-2cd15907de7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ad4698c46ec40c8bfff02e1d352abf6', 'request_id': 'req-ce603df2-3e6d-4bda-9298-2cd15907de7e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:27.594778 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ce603df2-3e6d-4bda-9298-2cd15907de7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ad4698c46ec40c8bfff02e1d352abf6', 'request_id': 'req-ce603df2-3e6d-4bda-9298-2cd15907de7e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:27.606604 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ce603df2-3e6d-4bda-9298-2cd15907de7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ad4698c46ec40c8bfff02e1d352abf6', 'request_id': 'req-ce603df2-3e6d-4bda-9298-2cd15907de7e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:27.624726 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ce603df2-3e6d-4bda-9298-2cd15907de7e admin admin] The token cache is being invalidate because project 8ad4698c46ec40c8bfff02e1d352abf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:57:27.625626 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ce603df2-3e6d-4bda-9298-2cd15907de7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:27.626309 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ce603df2-3e6d-4bda-9298-2cd15907de7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:27.628244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1062/2102] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:57:27 2022] DELETE /identity/v3/projects/8ad4698c46ec40c8bfff02e1d352abf6 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:27.632448 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7941de-5aeb-47a8-90c8-ec5265a5a2cd admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:27.633880 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fa7941de-5aeb-47a8-90c8-ec5265a5a2cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:27.663789 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7941de-5aeb-47a8-90c8-ec5265a5a2cd admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:27.759265 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e7903-0e72-4e03-bc72-50966f3eddd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:27.760545 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e7903-0e72-4e03-bc72-50966f3eddd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:27.760830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e7903-0e72-4e03-bc72-50966f3eddd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:27.761163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e7903-0e72-4e03-bc72-50966f3eddd0 admin admin] PATH_INFO: `/v3/users/ed2ea5bc9a5746cc9498bf8ce507ff2b` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:27.763636 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e7903-0e72-4e03-bc72-50966f3eddd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed2ea5bc9a5746cc9498bf8ce507ff2b)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:27.769801 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e7903-0e72-4e03-bc72-50966f3eddd0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:27.778148 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:27.879938 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1e2e7903-0e72-4e03-bc72-50966f3eddd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed2ea5bc9a5746cc9498bf8ce507ff2b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:27.889399 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1e2e7903-0e72-4e03-bc72-50966f3eddd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed2ea5bc9a5746cc9498bf8ce507ff2b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:27.890088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1e2e7903-0e72-4e03-bc72-50966f3eddd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed2ea5bc9a5746cc9498bf8ce507ff2b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:27.890908 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1e2e7903-0e72-4e03-bc72-50966f3eddd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed2ea5bc9a5746cc9498bf8ce507ff2b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:27.904115 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1e2e7903-0e72-4e03-bc72-50966f3eddd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed2ea5bc9a5746cc9498bf8ce507ff2b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:27.931206 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1041/2103] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:57:27 2022] DELETE /identity/v3/users/ed2ea5bc9a5746cc9498bf8ce507ff2b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:28.339028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce603df2-3e6d-4bda-9298-2cd15907de7e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:28.348250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ce603df2-3e6d-4bda-9298-2cd15907de7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:28.356739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce603df2-3e6d-4bda-9298-2cd15907de7e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:28.421300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:28.469659 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3852585-892d-4b4e-8863-23723a9d4539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:28.470516 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3852585-892d-4b4e-8863-23723a9d4539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:28.470869 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3852585-892d-4b4e-8863-23723a9d4539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:28.471159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3852585-892d-4b4e-8863-23723a9d4539 admin admin] PATH_INFO: `/v3/projects/620c6ea0401a4e5f9e3c3b7fea98315d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:28.472636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3852585-892d-4b4e-8863-23723a9d4539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=620c6ea0401a4e5f9e3c3b7fea98315d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:28.474766 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3852585-892d-4b4e-8863-23723a9d4539 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:28.566655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d3852585-892d-4b4e-8863-23723a9d4539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '620c6ea0401a4e5f9e3c3b7fea98315d', 'request_id': 'req-d3852585-892d-4b4e-8863-23723a9d4539'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:28.576262 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d3852585-892d-4b4e-8863-23723a9d4539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '620c6ea0401a4e5f9e3c3b7fea98315d', 'request_id': 'req-d3852585-892d-4b4e-8863-23723a9d4539'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:28.583320 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d3852585-892d-4b4e-8863-23723a9d4539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '620c6ea0401a4e5f9e3c3b7fea98315d', 'request_id': 'req-d3852585-892d-4b4e-8863-23723a9d4539'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:28.598776 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d3852585-892d-4b4e-8863-23723a9d4539 admin admin] The token cache is being invalidate because project 620c6ea0401a4e5f9e3c3b7fea98315d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:57:28.599318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d3852585-892d-4b4e-8863-23723a9d4539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:28.600487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d3852585-892d-4b4e-8863-23723a9d4539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:28.602298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1063/2104] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:57:28 2022] DELETE /identity/v3/projects/620c6ea0401a4e5f9e3c3b7fea98315d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:28.609150 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82349c5d-ac17-4dae-94ef-06cf89ecd206 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:28.609539 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82349c5d-ac17-4dae-94ef-06cf89ecd206 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:28.609929 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82349c5d-ac17-4dae-94ef-06cf89ecd206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:28.649582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-82349c5d-ac17-4dae-94ef-06cf89ecd206 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:28.651410 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-82349c5d-ac17-4dae-94ef-06cf89ecd206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:28.759396 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1042/2105] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:28.770674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b401764-2431-4acd-b00e-e437cf529241 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:28.770961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b401764-2431-4acd-b00e-e437cf529241 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:28.771241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b401764-2431-4acd-b00e-e437cf529241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:28.796658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2b401764-2431-4acd-b00e-e437cf529241 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:28.798135 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2b401764-2431-4acd-b00e-e437cf529241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:28.808246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1064/2106] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:28.812782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82349c5d-ac17-4dae-94ef-06cf89ecd206 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:28.842690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82349c5d-ac17-4dae-94ef-06cf89ecd206 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:28.852672 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d2048-b73e-4e51-bea5-66673351c9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:28.854256 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d2048-b73e-4e51-bea5-66673351c9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:28.854694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d2048-b73e-4e51-bea5-66673351c9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:28.855246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d2048-b73e-4e51-bea5-66673351c9a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:28.856439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d2048-b73e-4e51-bea5-66673351c9a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:57:28.857101 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d2048-b73e-4e51-bea5-66673351c9a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:28.860014 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d2048-b73e-4e51-bea5-66673351c9a9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:28.880462 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1043/2107] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:57:28.885576 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b401764-2431-4acd-b00e-e437cf529241 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:28.894533 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b401764-2431-4acd-b00e-e437cf529241 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:28.904314 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e780a1-1a36-4f5d-ad43-378cfc2bbbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:28.905050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e780a1-1a36-4f5d-ad43-378cfc2bbbb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:28.905395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e780a1-1a36-4f5d-ad43-378cfc2bbbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:28.905740 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e780a1-1a36-4f5d-ad43-378cfc2bbbb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:28.906467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e780a1-1a36-4f5d-ad43-378cfc2bbbb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:28.910082 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e780a1-1a36-4f5d-ad43-378cfc2bbbb7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:28.959081 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1065/2108] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:57:28 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:28.963072 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d2048-b73e-4e51-bea5-66673351c9a9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:28.989477 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d2048-b73e-4e51-bea5-66673351c9a9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:29.118435 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840f749-3d95-40fd-b87c-54b22861953c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:29.120824 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840f749-3d95-40fd-b87c-54b22861953c admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:29.121182 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840f749-3d95-40fd-b87c-54b22861953c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:29.121538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840f749-3d95-40fd-b87c-54b22861953c admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:29.123363 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840f749-3d95-40fd-b87c-54b22861953c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:29.125676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840f749-3d95-40fd-b87c-54b22861953c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:29.172715 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:29.184028 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1044/2109] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:57:28 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:29.186188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e780a1-1a36-4f5d-ad43-378cfc2bbbb7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:29.199951 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e780a1-1a36-4f5d-ad43-378cfc2bbbb7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:29.208886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8e989-15d3-4d47-b67c-82d7aaf2618a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:29.210582 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8e989-15d3-4d47-b67c-82d7aaf2618a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:29.210859 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8e989-15d3-4d47-b67c-82d7aaf2618a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:29.211240 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8e989-15d3-4d47-b67c-82d7aaf2618a admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:29.212126 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8e989-15d3-4d47-b67c-82d7aaf2618a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:29.213915 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8e989-15d3-4d47-b67c-82d7aaf2618a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:29.229720 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1066/2110] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:29.230908 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840f749-3d95-40fd-b87c-54b22861953c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:29.244303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840f749-3d95-40fd-b87c-54b22861953c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:29.253881 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951062e0-2925-47e6-80b0-91d2ea14e8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:29.254503 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951062e0-2925-47e6-80b0-91d2ea14e8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:29.254898 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951062e0-2925-47e6-80b0-91d2ea14e8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:29.255180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951062e0-2925-47e6-80b0-91d2ea14e8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:29.255846 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951062e0-2925-47e6-80b0-91d2ea14e8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:29.257561 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951062e0-2925-47e6-80b0-91d2ea14e8e8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:29.278344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1045/2111] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:29.279864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8e989-15d3-4d47-b67c-82d7aaf2618a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:29.292546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8e989-15d3-4d47-b67c-82d7aaf2618a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:29.298019 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14d1e0-7eaa-45f3-a02d-e4fe968c7c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:29.298722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14d1e0-7eaa-45f3-a02d-e4fe968c7c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:29.303743 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14d1e0-7eaa-45f3-a02d-e4fe968c7c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:29.304131 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14d1e0-7eaa-45f3-a02d-e4fe968c7c9e admin admin] PATH_INFO: `/v3/projects/bd3de4b64fb54f69849290ef6f46f66e/users/d98249ef64134e30a6b335dbb73322ae/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:29.336336 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14d1e0-7eaa-45f3-a02d-e4fe968c7c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd3de4b64fb54f69849290ef6f46f66e, user_id=d98249ef64134e30a6b335dbb73322ae, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:29.341836 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14d1e0-7eaa-45f3-a02d-e4fe968c7c9e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:29.375830 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1067/2112] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:29 2022] PUT /identity/v3/projects/bd3de4b64fb54f69849290ef6f46f66e/users/d98249ef64134e30a6b335dbb73322ae/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:57:29.387414 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45147f2-ada6-4cab-a284-46c528e9beb5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:29.387835 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45147f2-ada6-4cab-a284-46c528e9beb5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:29.388240 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45147f2-ada6-4cab-a284-46c528e9beb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:29.424483 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d45147f2-ada6-4cab-a284-46c528e9beb5 None None] MFA Rules not processed for user `d98249ef64134e30a6b335dbb73322ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:29.426647 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d45147f2-ada6-4cab-a284-46c528e9beb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:29.513668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1046/2113] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:29.521512 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14d1e0-7eaa-45f3-a02d-e4fe968c7c9e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:29.523859 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4b14d1e0-7eaa-45f3-a02d-e4fe968c7c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:29.644158 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14d1e0-7eaa-45f3-a02d-e4fe968c7c9e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:29.649120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e393868-f7e2-4937-9b6b-2f865c015c86 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d298efe48464956b7a03cba1001060b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:29.650019 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e393868-f7e2-4937-9b6b-2f865c015c86 service glance] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:29.650412 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e393868-f7e2-4937-9b6b-2f865c015c86 service glance] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:29.650790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e393868-f7e2-4937-9b6b-2f865c015c86 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:29.669240 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e393868-f7e2-4937-9b6b-2f865c015c86 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:29.670710 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e393868-f7e2-4937-9b6b-2f865c015c86 service glance] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:29.690085 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1068/2114] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:36.300495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ab9a5-1a4e-45cb-862c-d34cce78fbcf None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:36.301747 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ab9a5-1a4e-45cb-862c-d34cce78fbcf None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:36.302265 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ab9a5-1a4e-45cb-862c-d34cce78fbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:36.337214 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-183ab9a5-1a4e-45cb-862c-d34cce78fbcf None None] MFA Rules not processed for user `d4e5f1d369d94d00a56cbcfb69be01e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:36.338621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-183ab9a5-1a4e-45cb-862c-d34cce78fbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:36.396909 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1047/2115] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:57:39.683216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:39.708375 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf975cc7-0ab2-49a8-adce-94506b693742 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:39.708664 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf975cc7-0ab2-49a8-adce-94506b693742 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:39.708940 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf975cc7-0ab2-49a8-adce-94506b693742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:39.740461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-cf975cc7-0ab2-49a8-adce-94506b693742 None None] MFA Rules not processed for user `e51ae6959aac49898e75c6786c5dbdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:39.742417 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cf975cc7-0ab2-49a8-adce-94506b693742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:39.819182 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1069/2116] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Sep 9 20:57:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:39.834746 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ab9a5-1a4e-45cb-862c-d34cce78fbcf None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:39.836318 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-183ab9a5-1a4e-45cb-862c-d34cce78fbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:39.927920 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ab9a5-1a4e-45cb-862c-d34cce78fbcf None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:39.933325 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cb8a2-2d65-4fa2-8ce7-f2ee801a5002 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9570eaa112de460cb9e371278bfb300b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:39.934449 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cb8a2-2d65-4fa2-8ce7-f2ee801a5002 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:39.934900 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cb8a2-2d65-4fa2-8ce7-f2ee801a5002 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:39.935181 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cb8a2-2d65-4fa2-8ce7-f2ee801a5002 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:39.945977 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cb8a2-2d65-4fa2-8ce7-f2ee801a5002 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:39.947869 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cb8a2-2d65-4fa2-8ce7-f2ee801a5002 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:39.958011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1048/2117] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Sep 9 20:57:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 20:57:41.627039 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90986463-4168-4ddc-8599-04bc8c500234 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:41.628194 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90986463-4168-4ddc-8599-04bc8c500234 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:41.630772 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90986463-4168-4ddc-8599-04bc8c500234 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:41.634332 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1070/2118] 10.222.0.15 () {54 vars in 921 bytes} [Fri Sep 9 20:57:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:57:41.719325 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4a9fc-4876-4590-ae1c-c2bd3edc04ce None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:41.719775 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4a9fc-4876-4590-ae1c-c2bd3edc04ce None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:41.719934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f4a9fc-4876-4590-ae1c-c2bd3edc04ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:41.756660 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-22f4a9fc-4876-4590-ae1c-c2bd3edc04ce None None] MFA Rules not processed for user `0fc28d9a1b3f4feca0deeb5f266f8b37`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:41.760516 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-22f4a9fc-4876-4590-ae1c-c2bd3edc04ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:41.781675 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:41.985572 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1049/2119] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Sep 9 20:57:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:42.004923 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bce65-ed9a-4afe-bc2b-2d76a4197fbf None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:42.005927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bce65-ed9a-4afe-bc2b-2d76a4197fbf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:42.006302 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bce65-ed9a-4afe-bc2b-2d76a4197fbf None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:42.008405 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1071/2120] 10.222.0.15 () {54 vars in 961 bytes} [Fri Sep 9 20:57:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:57:42.022554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563f36e-d4b4-41f2-8249-700761a21b89 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:42.022867 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563f36e-d4b4-41f2-8249-700761a21b89 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:42.023124 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563f36e-d4b4-41f2-8249-700761a21b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:42.100855 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3563f36e-d4b4-41f2-8249-700761a21b89 None None] MFA Rules not processed for user `0fc28d9a1b3f4feca0deeb5f266f8b37`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:42.102172 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3563f36e-d4b4-41f2-8249-700761a21b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:42.124689 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1050/2121] 10.222.0.15 () {58 vars in 1058 bytes} [Fri Sep 9 20:57:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:42.137717 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bce65-ed9a-4afe-bc2b-2d76a4197fbf None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:42.195197 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bce65-ed9a-4afe-bc2b-2d76a4197fbf None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:42.227272 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea22a7-121e-49f0-8c72-9f8f6e48bd82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc28d9a1b3f4feca0deeb5f266f8b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:42.228304 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea22a7-121e-49f0-8c72-9f8f6e48bd82 service placement] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:42.228838 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea22a7-121e-49f0-8c72-9f8f6e48bd82 service placement] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:42.229265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea22a7-121e-49f0-8c72-9f8f6e48bd82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:42.277905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea22a7-121e-49f0-8c72-9f8f6e48bd82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:42.283334 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea22a7-121e-49f0-8c72-9f8f6e48bd82 service placement] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:42.309236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1072/2122] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:43.045022 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563f36e-d4b4-41f2-8249-700761a21b89 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:43.046654 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3563f36e-d4b4-41f2-8249-700761a21b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:43.127201 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563f36e-d4b4-41f2-8249-700761a21b89 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:43.134195 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc820dd-0b62-4761-9843-85c932e837ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:43.134945 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc820dd-0b62-4761-9843-85c932e837ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:43.135349 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc820dd-0b62-4761-9843-85c932e837ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:43.135847 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc820dd-0b62-4761-9843-85c932e837ff admin admin] PATH_INFO: `/v3/users/2a1826ea1f864e68828b0f8f11201c42` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:43.144724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc820dd-0b62-4761-9843-85c932e837ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1826ea1f864e68828b0f8f11201c42)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:43.146714 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc820dd-0b62-4761-9843-85c932e837ff admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:43.212863 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-acc820dd-0b62-4761-9843-85c932e837ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1826ea1f864e68828b0f8f11201c42'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:43.220464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-acc820dd-0b62-4761-9843-85c932e837ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1826ea1f864e68828b0f8f11201c42'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:43.221113 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-acc820dd-0b62-4761-9843-85c932e837ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1826ea1f864e68828b0f8f11201c42'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:43.222330 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-acc820dd-0b62-4761-9843-85c932e837ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1826ea1f864e68828b0f8f11201c42'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:43.229899 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-acc820dd-0b62-4761-9843-85c932e837ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1826ea1f864e68828b0f8f11201c42'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:43.248010 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1051/2123] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:57:43 2022] DELETE /identity/v3/users/2a1826ea1f864e68828b0f8f11201c42 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:57:43.506881 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea22a7-121e-49f0-8c72-9f8f6e48bd82 service placement] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:43.532817 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea22a7-121e-49f0-8c72-9f8f6e48bd82 service placement] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:43.620223 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aa989-63eb-4ba1-bc6f-51adce754686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:43.620991 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aa989-63eb-4ba1-bc6f-51adce754686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:43.621415 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aa989-63eb-4ba1-bc6f-51adce754686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:43.621940 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35aa989-63eb-4ba1-bc6f-51adce754686 admin admin] PATH_INFO: `/v3/projects/6dd015745e164cc1849d2b4c35da8212` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:43.623194 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35aa989-63eb-4ba1-bc6f-51adce754686 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dd015745e164cc1849d2b4c35da8212)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:43.625241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35aa989-63eb-4ba1-bc6f-51adce754686 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:43.703387 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c35aa989-63eb-4ba1-bc6f-51adce754686 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dd015745e164cc1849d2b4c35da8212', 'request_id': 'req-c35aa989-63eb-4ba1-bc6f-51adce754686'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:43.713687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c35aa989-63eb-4ba1-bc6f-51adce754686 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dd015745e164cc1849d2b4c35da8212', 'request_id': 'req-c35aa989-63eb-4ba1-bc6f-51adce754686'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:43.719959 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c35aa989-63eb-4ba1-bc6f-51adce754686 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dd015745e164cc1849d2b4c35da8212', 'request_id': 'req-c35aa989-63eb-4ba1-bc6f-51adce754686'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:43.733242 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c35aa989-63eb-4ba1-bc6f-51adce754686 admin admin] The token cache is being invalidate because project 6dd015745e164cc1849d2b4c35da8212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:57:43.733546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c35aa989-63eb-4ba1-bc6f-51adce754686 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:43.734226 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-c35aa989-63eb-4ba1-bc6f-51adce754686 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:43.736026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1073/2124] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:57:43 2022] DELETE /identity/v3/projects/6dd015745e164cc1849d2b4c35da8212 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:43.742667 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc820dd-0b62-4761-9843-85c932e837ff admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:43.742667 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-acc820dd-0b62-4761-9843-85c932e837ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:43.767199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc820dd-0b62-4761-9843-85c932e837ff admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:43.808337 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:43.908235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e985a-8110-434a-8bef-226d6b6b3502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:43.910267 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e985a-8110-434a-8bef-226d6b6b3502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:43.911544 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e985a-8110-434a-8bef-226d6b6b3502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:43.911544 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e985a-8110-434a-8bef-226d6b6b3502 admin admin] PATH_INFO: `/v3/users/95dc0665b81a4179b087df25d37f1473` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:43.912593 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e985a-8110-434a-8bef-226d6b6b3502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95dc0665b81a4179b087df25d37f1473)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:43.914628 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293e985a-8110-434a-8bef-226d6b6b3502 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:43.978437 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-293e985a-8110-434a-8bef-226d6b6b3502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95dc0665b81a4179b087df25d37f1473'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:43.988486 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-293e985a-8110-434a-8bef-226d6b6b3502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95dc0665b81a4179b087df25d37f1473'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:43.989597 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-293e985a-8110-434a-8bef-226d6b6b3502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95dc0665b81a4179b087df25d37f1473'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:43.990502 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-293e985a-8110-434a-8bef-226d6b6b3502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95dc0665b81a4179b087df25d37f1473'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:44.000145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-293e985a-8110-434a-8bef-226d6b6b3502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95dc0665b81a4179b087df25d37f1473'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:44.037855 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1052/2125] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:57:43 2022] DELETE /identity/v3/users/95dc0665b81a4179b087df25d37f1473 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:44.301112 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aa989-63eb-4ba1-bc6f-51adce754686 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:44.313445 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c35aa989-63eb-4ba1-bc6f-51adce754686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:44.352693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35aa989-63eb-4ba1-bc6f-51adce754686 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:44.390903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:44.452357 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0748e5-bd35-4233-8908-9edfc002c14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:44.455516 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0748e5-bd35-4233-8908-9edfc002c14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:44.455516 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0748e5-bd35-4233-8908-9edfc002c14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:44.455516 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0748e5-bd35-4233-8908-9edfc002c14f admin admin] PATH_INFO: `/v3/projects/5b91457ad5e5476b832f5eb0df616611` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:44.457605 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0748e5-bd35-4233-8908-9edfc002c14f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b91457ad5e5476b832f5eb0df616611)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:44.459733 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0748e5-bd35-4233-8908-9edfc002c14f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:44.533108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7d0748e5-bd35-4233-8908-9edfc002c14f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b91457ad5e5476b832f5eb0df616611', 'request_id': 'req-7d0748e5-bd35-4233-8908-9edfc002c14f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:44.544492 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7d0748e5-bd35-4233-8908-9edfc002c14f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b91457ad5e5476b832f5eb0df616611', 'request_id': 'req-7d0748e5-bd35-4233-8908-9edfc002c14f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:44.558488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7d0748e5-bd35-4233-8908-9edfc002c14f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b91457ad5e5476b832f5eb0df616611', 'request_id': 'req-7d0748e5-bd35-4233-8908-9edfc002c14f'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:44.575668 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7d0748e5-bd35-4233-8908-9edfc002c14f admin admin] The token cache is being invalidate because project 5b91457ad5e5476b832f5eb0df616611 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:57:44.575965 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7d0748e5-bd35-4233-8908-9edfc002c14f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:44.576802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-7d0748e5-bd35-4233-8908-9edfc002c14f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:44.583099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1074/2126] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:57:44 2022] DELETE /identity/v3/projects/5b91457ad5e5476b832f5eb0df616611 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:57:44.585635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935c7e2-4c75-4297-ac9f-f84b5a1dd872 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:44.586514 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935c7e2-4c75-4297-ac9f-f84b5a1dd872 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:44.587093 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935c7e2-4c75-4297-ac9f-f84b5a1dd872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:44.636086 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-9935c7e2-4c75-4297-ac9f-f84b5a1dd872 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:44.637661 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9935c7e2-4c75-4297-ac9f-f84b5a1dd872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:44.762227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1053/2127] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:44.770908 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c140709-8391-43cc-84a4-d4a362b64f8c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:44.771198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c140709-8391-43cc-84a4-d4a362b64f8c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:44.771503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c140709-8391-43cc-84a4-d4a362b64f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:44.818489 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9c140709-8391-43cc-84a4-d4a362b64f8c None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:44.820137 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9c140709-8391-43cc-84a4-d4a362b64f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:44.837091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1075/2128] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:44.838247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935c7e2-4c75-4297-ac9f-f84b5a1dd872 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:44.865053 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935c7e2-4c75-4297-ac9f-f84b5a1dd872 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:44.871374 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2973000-a6f8-4276-ae3d-aff4e8329ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:44.872478 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2973000-a6f8-4276-ae3d-aff4e8329ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:44.872478 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2973000-a6f8-4276-ae3d-aff4e8329ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:44.872674 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2973000-a6f8-4276-ae3d-aff4e8329ea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:44.873336 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2973000-a6f8-4276-ae3d-aff4e8329ea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:57:44.873558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2973000-a6f8-4276-ae3d-aff4e8329ea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:44.876037 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2973000-a6f8-4276-ae3d-aff4e8329ea0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:44.892736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1054/2129] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:57:44.897277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c140709-8391-43cc-84a4-d4a362b64f8c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:44.906984 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c140709-8391-43cc-84a4-d4a362b64f8c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:44.912496 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2c3c4-e0ef-4bca-9893-e48c10fed302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:44.913186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2c3c4-e0ef-4bca-9893-e48c10fed302 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:44.913473 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2c3c4-e0ef-4bca-9893-e48c10fed302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:44.913799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2c3c4-e0ef-4bca-9893-e48c10fed302 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:44.914550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2c3c4-e0ef-4bca-9893-e48c10fed302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:44.916920 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2c3c4-e0ef-4bca-9893-e48c10fed302 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:44.980160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2973000-a6f8-4276-ae3d-aff4e8329ea0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:44.992280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1076/2130] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:57:44 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:44.998879 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2973000-a6f8-4276-ae3d-aff4e8329ea0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:45.068666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:45.113650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dee4f-aecb-4047-8090-415de8440e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:45.114718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dee4f-aecb-4047-8090-415de8440e44 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:45.115016 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dee4f-aecb-4047-8090-415de8440e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:45.115393 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606dee4f-aecb-4047-8090-415de8440e44 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:45.116185 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606dee4f-aecb-4047-8090-415de8440e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:45.118256 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606dee4f-aecb-4047-8090-415de8440e44 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:45.149984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1055/2131] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:57:44 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:57:45.151705 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2c3c4-e0ef-4bca-9893-e48c10fed302 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:45.167636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2c3c4-e0ef-4bca-9893-e48c10fed302 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:45.172506 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eedb0d-6d1a-406e-9413-68bd18b2adc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:45.173126 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eedb0d-6d1a-406e-9413-68bd18b2adc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:45.173396 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eedb0d-6d1a-406e-9413-68bd18b2adc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:45.173661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eedb0d-6d1a-406e-9413-68bd18b2adc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:45.174314 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eedb0d-6d1a-406e-9413-68bd18b2adc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:45.181346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eedb0d-6d1a-406e-9413-68bd18b2adc4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:45.198396 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1077/2132] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:45.199652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dee4f-aecb-4047-8090-415de8440e44 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:45.220108 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606dee4f-aecb-4047-8090-415de8440e44 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:45.226001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b0f33-4264-427c-a57f-912095695e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:45.226708 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b0f33-4264-427c-a57f-912095695e27 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:45.227063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b0f33-4264-427c-a57f-912095695e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:45.227416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b0f33-4264-427c-a57f-912095695e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:45.228179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b0f33-4264-427c-a57f-912095695e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:45.230119 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b0f33-4264-427c-a57f-912095695e27 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:45.243181 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1056/2133] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:57:45.247466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eedb0d-6d1a-406e-9413-68bd18b2adc4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:45.262599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eedb0d-6d1a-406e-9413-68bd18b2adc4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:45.267529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f47fd1-15b7-4e4f-a919-895d0309e0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:45.272116 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f47fd1-15b7-4e4f-a919-895d0309e0b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:45.272558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f47fd1-15b7-4e4f-a919-895d0309e0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:45.273366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f47fd1-15b7-4e4f-a919-895d0309e0b4 admin admin] PATH_INFO: `/v3/projects/b6d174ce030446c78ac7a21f7d6f3996/users/2b85a5c6ab554052b4c0b7cce6292c95/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:45.299818 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f47fd1-15b7-4e4f-a919-895d0309e0b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6d174ce030446c78ac7a21f7d6f3996, user_id=2b85a5c6ab554052b4c0b7cce6292c95, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:45.303282 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f47fd1-15b7-4e4f-a919-895d0309e0b4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:45.343052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1078/2134] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:45 2022] PUT /identity/v3/projects/b6d174ce030446c78ac7a21f7d6f3996/users/2b85a5c6ab554052b4c0b7cce6292c95/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:45.345124 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b5c6c-185b-4ed7-8a74-b7a413d01cb4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:45.345441 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b5c6c-185b-4ed7-8a74-b7a413d01cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:45.345931 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b5c6c-185b-4ed7-8a74-b7a413d01cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:45.386353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-175b5c6c-185b-4ed7-8a74-b7a413d01cb4 None None] MFA Rules not processed for user `2b85a5c6ab554052b4c0b7cce6292c95`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:45.387627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-175b5c6c-185b-4ed7-8a74-b7a413d01cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:45.468056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1057/2135] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:57:45.476889 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f47fd1-15b7-4e4f-a919-895d0309e0b4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:45.478709 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-55f47fd1-15b7-4e4f-a919-895d0309e0b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:45.566885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:45.572147 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f47fd1-15b7-4e4f-a919-895d0309e0b4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:45.578541 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de174c2f-2262-4674-9b6a-9d5859a3c261 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:45.579319 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de174c2f-2262-4674-9b6a-9d5859a3c261 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:45.579615 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de174c2f-2262-4674-9b6a-9d5859a3c261 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:45.580122 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de174c2f-2262-4674-9b6a-9d5859a3c261 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:45.593588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de174c2f-2262-4674-9b6a-9d5859a3c261 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:45.595177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de174c2f-2262-4674-9b6a-9d5859a3c261 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:45.606171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1079/2136] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:45.630715 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b5c6c-185b-4ed7-8a74-b7a413d01cb4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:45.742070 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b5c6c-185b-4ed7-8a74-b7a413d01cb4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:45.753533 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ec3e0-88fe-4ad7-b103-9a2cd3f6b926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:45.757232 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ec3e0-88fe-4ad7-b103-9a2cd3f6b926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:45.757757 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ec3e0-88fe-4ad7-b103-9a2cd3f6b926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:45.758181 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ec3e0-88fe-4ad7-b103-9a2cd3f6b926 admin admin] PATH_INFO: `/v3/users/2b85a5c6ab554052b4c0b7cce6292c95` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:45.759761 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ec3e0-88fe-4ad7-b103-9a2cd3f6b926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b85a5c6ab554052b4c0b7cce6292c95)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:45.762007 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ec3e0-88fe-4ad7-b103-9a2cd3f6b926 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:45.839400 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:45.847878 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e18ec3e0-88fe-4ad7-b103-9a2cd3f6b926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b85a5c6ab554052b4c0b7cce6292c95'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:45.860141 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e18ec3e0-88fe-4ad7-b103-9a2cd3f6b926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b85a5c6ab554052b4c0b7cce6292c95'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:45.860876 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e18ec3e0-88fe-4ad7-b103-9a2cd3f6b926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b85a5c6ab554052b4c0b7cce6292c95'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:45.862130 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e18ec3e0-88fe-4ad7-b103-9a2cd3f6b926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b85a5c6ab554052b4c0b7cce6292c95'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:45.879211 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e18ec3e0-88fe-4ad7-b103-9a2cd3f6b926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b85a5c6ab554052b4c0b7cce6292c95'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:45.932043 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1058/2137] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:57:45 2022] DELETE /identity/v3/users/2b85a5c6ab554052b4c0b7cce6292c95 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:45.936501 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4538dd-08bd-42a9-b001-7be7d829f34e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:45.937573 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4538dd-08bd-42a9-b001-7be7d829f34e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:45.937873 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4538dd-08bd-42a9-b001-7be7d829f34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:45.961739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1c4538dd-08bd-42a9-b001-7be7d829f34e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:45.963300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1c4538dd-08bd-42a9-b001-7be7d829f34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:46.056857 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1080/2138] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:57:46.066842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ec3e0-88fe-4ad7-b103-9a2cd3f6b926 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:46.068391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e18ec3e0-88fe-4ad7-b103-9a2cd3f6b926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:46.132422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ec3e0-88fe-4ad7-b103-9a2cd3f6b926 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:46.137336 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d436623b-8d48-4961-b826-a34d34aaaabb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:46.137969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436623b-8d48-4961-b826-a34d34aaaabb service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:46.138306 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436623b-8d48-4961-b826-a34d34aaaabb service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:46.138526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d436623b-8d48-4961-b826-a34d34aaaabb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:46.149955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436623b-8d48-4961-b826-a34d34aaaabb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:46.151409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d436623b-8d48-4961-b826-a34d34aaaabb service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:46.164354 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1059/2139] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:46.466698 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4538dd-08bd-42a9-b001-7be7d829f34e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:46.472948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1c4538dd-08bd-42a9-b001-7be7d829f34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:46.523975 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4538dd-08bd-42a9-b001-7be7d829f34e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:46.538292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def66bfe-ff23-4f33-9f30-b142a4bdd176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:46.538292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def66bfe-ff23-4f33-9f30-b142a4bdd176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:46.540228 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def66bfe-ff23-4f33-9f30-b142a4bdd176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:46.540680 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def66bfe-ff23-4f33-9f30-b142a4bdd176 admin admin] PATH_INFO: `/v3/projects/b6d174ce030446c78ac7a21f7d6f3996` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:46.542214 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def66bfe-ff23-4f33-9f30-b142a4bdd176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6d174ce030446c78ac7a21f7d6f3996)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:46.544583 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def66bfe-ff23-4f33-9f30-b142a4bdd176 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:46.599917 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-def66bfe-ff23-4f33-9f30-b142a4bdd176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6d174ce030446c78ac7a21f7d6f3996', 'request_id': 'req-def66bfe-ff23-4f33-9f30-b142a4bdd176'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:46.609017 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-def66bfe-ff23-4f33-9f30-b142a4bdd176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6d174ce030446c78ac7a21f7d6f3996', 'request_id': 'req-def66bfe-ff23-4f33-9f30-b142a4bdd176'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:46.615854 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-def66bfe-ff23-4f33-9f30-b142a4bdd176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6d174ce030446c78ac7a21f7d6f3996', 'request_id': 'req-def66bfe-ff23-4f33-9f30-b142a4bdd176'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:46.628127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-def66bfe-ff23-4f33-9f30-b142a4bdd176 admin admin] The token cache is being invalidate because project b6d174ce030446c78ac7a21f7d6f3996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:57:46.628599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-def66bfe-ff23-4f33-9f30-b142a4bdd176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:46.629331 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-def66bfe-ff23-4f33-9f30-b142a4bdd176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:46.631001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1081/2140] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:57:46 2022] DELETE /identity/v3/projects/b6d174ce030446c78ac7a21f7d6f3996 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:46.635794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a725d55-d558-4d38-812b-c4a454bac012 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:46.636333 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a725d55-d558-4d38-812b-c4a454bac012 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:46.636432 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a725d55-d558-4d38-812b-c4a454bac012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:46.657753 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1a725d55-d558-4d38-812b-c4a454bac012 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:46.661253 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1a725d55-d558-4d38-812b-c4a454bac012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:46.728411 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1060/2141] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:46.738040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a01d45-22a4-445a-9b28-c4a8d68b8341 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:46.738392 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a01d45-22a4-445a-9b28-c4a8d68b8341 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:46.738634 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a01d45-22a4-445a-9b28-c4a8d68b8341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:46.759573 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-07a01d45-22a4-445a-9b28-c4a8d68b8341 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:46.760801 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-07a01d45-22a4-445a-9b28-c4a8d68b8341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:46.770599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1082/2142] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:46.774995 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a725d55-d558-4d38-812b-c4a454bac012 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:46.785845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a725d55-d558-4d38-812b-c4a454bac012 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:46.790819 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e19038-903c-4a11-a886-5cc4626dc5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:46.791557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e19038-903c-4a11-a886-5cc4626dc5eb admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:46.791903 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e19038-903c-4a11-a886-5cc4626dc5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:46.792280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e19038-903c-4a11-a886-5cc4626dc5eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:46.793003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e19038-903c-4a11-a886-5cc4626dc5eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:57:46.793374 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e19038-903c-4a11-a886-5cc4626dc5eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:46.795412 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e19038-903c-4a11-a886-5cc4626dc5eb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:46.811455 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1061/2143] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:57:46.815855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a01d45-22a4-445a-9b28-c4a8d68b8341 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:46.840037 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a01d45-22a4-445a-9b28-c4a8d68b8341 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:46.847683 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffe15c-ddda-4167-a8b1-a2fb1e6feb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:46.848438 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffe15c-ddda-4167-a8b1-a2fb1e6feb57 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:46.848714 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffe15c-ddda-4167-a8b1-a2fb1e6feb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:46.848981 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffe15c-ddda-4167-a8b1-a2fb1e6feb57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:46.849629 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ffe15c-ddda-4167-a8b1-a2fb1e6feb57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:46.851524 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ffe15c-ddda-4167-a8b1-a2fb1e6feb57 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:46.891807 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1083/2144] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:57:46 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:46.893175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e19038-903c-4a11-a886-5cc4626dc5eb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:46.909625 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e19038-903c-4a11-a886-5cc4626dc5eb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:46.979629 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:47.000550 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae983d62-c249-43ee-b654-883be05d5d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:47.001182 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae983d62-c249-43ee-b654-883be05d5d72 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:47.001463 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae983d62-c249-43ee-b654-883be05d5d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:47.001739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae983d62-c249-43ee-b654-883be05d5d72 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:47.004560 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae983d62-c249-43ee-b654-883be05d5d72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:47.006523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae983d62-c249-43ee-b654-883be05d5d72 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:47.040476 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1062/2145] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:57:46 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:57:47.044389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffe15c-ddda-4167-a8b1-a2fb1e6feb57 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:47.078233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffe15c-ddda-4167-a8b1-a2fb1e6feb57 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:47.100017 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf24b7c-0d9d-47c5-a735-a396cc982562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:47.100661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf24b7c-0d9d-47c5-a735-a396cc982562 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:47.100934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf24b7c-0d9d-47c5-a735-a396cc982562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:47.101204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf24b7c-0d9d-47c5-a735-a396cc982562 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:47.101849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf24b7c-0d9d-47c5-a735-a396cc982562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:47.103459 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf24b7c-0d9d-47c5-a735-a396cc982562 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:47.121154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1084/2146] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:47.122499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae983d62-c249-43ee-b654-883be05d5d72 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:47.141049 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae983d62-c249-43ee-b654-883be05d5d72 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:47.153286 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa278a9-ee4a-4ebb-83b8-000b20e0dc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:47.153979 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa278a9-ee4a-4ebb-83b8-000b20e0dc13 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:47.154518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa278a9-ee4a-4ebb-83b8-000b20e0dc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:47.154795 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa278a9-ee4a-4ebb-83b8-000b20e0dc13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:47.156456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa278a9-ee4a-4ebb-83b8-000b20e0dc13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:47.158398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa278a9-ee4a-4ebb-83b8-000b20e0dc13 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:47.177846 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1063/2147] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:47.192234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf24b7c-0d9d-47c5-a735-a396cc982562 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:47.201064 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf24b7c-0d9d-47c5-a735-a396cc982562 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:47.207221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228a242-05cf-488d-8e20-e62f692b55a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:47.208520 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228a242-05cf-488d-8e20-e62f692b55a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:47.209139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228a242-05cf-488d-8e20-e62f692b55a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:47.209610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228a242-05cf-488d-8e20-e62f692b55a7 admin admin] PATH_INFO: `/v3/projects/5c714fb96d104e308f4595eef83b3c73/users/e5a63070e7f342dd911b45bf348c9da3/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:47.242658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228a242-05cf-488d-8e20-e62f692b55a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c714fb96d104e308f4595eef83b3c73, user_id=e5a63070e7f342dd911b45bf348c9da3, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:47.251155 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228a242-05cf-488d-8e20-e62f692b55a7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:47.285311 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1085/2148] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:47 2022] PUT /identity/v3/projects/5c714fb96d104e308f4595eef83b3c73/users/e5a63070e7f342dd911b45bf348c9da3/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:47.289879 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb7939-c874-4b5b-ad58-cda5e6908b61 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:47.290156 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb7939-c874-4b5b-ad58-cda5e6908b61 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:47.292529 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb7939-c874-4b5b-ad58-cda5e6908b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:47.337775 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-dbeb7939-c874-4b5b-ad58-cda5e6908b61 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:47.339441 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-dbeb7939-c874-4b5b-ad58-cda5e6908b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:47.448845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1064/2149] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:47.463389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228a242-05cf-488d-8e20-e62f692b55a7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:47.466244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a228a242-05cf-488d-8e20-e62f692b55a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:47.484654 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:47.559271 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228a242-05cf-488d-8e20-e62f692b55a7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:47.563819 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07ff71-0158-47db-9a0a-ec0db2122aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:47.563819 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07ff71-0158-47db-9a0a-ec0db2122aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:47.564100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07ff71-0158-47db-9a0a-ec0db2122aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:47.564436 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc07ff71-0158-47db-9a0a-ec0db2122aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:47.576174 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07ff71-0158-47db-9a0a-ec0db2122aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:47.577639 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc07ff71-0158-47db-9a0a-ec0db2122aa6 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:47.589879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1086/2150] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:48.507060 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcd9a7-21aa-4955-8ee1-1a4946b60d39 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:48.507784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcd9a7-21aa-4955-8ee1-1a4946b60d39 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:48.507784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcd9a7-21aa-4955-8ee1-1a4946b60d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:48.582296 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-67fcd9a7-21aa-4955-8ee1-1a4946b60d39 None None] MFA Rules not processed for user `e5a63070e7f342dd911b45bf348c9da3`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:48.584680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-67fcd9a7-21aa-4955-8ee1-1a4946b60d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:48.707599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1065/2151] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:48.801554 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07ff71-0158-47db-9a0a-ec0db2122aa6 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:48.804151 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bc07ff71-0158-47db-9a0a-ec0db2122aa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:48.971154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc07ff71-0158-47db-9a0a-ec0db2122aa6 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:48.981317 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231429fd-8843-441c-9bf9-bd48a3bec82b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:48.983367 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231429fd-8843-441c-9bf9-bd48a3bec82b service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:48.984744 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231429fd-8843-441c-9bf9-bd48a3bec82b service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:48.986407 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231429fd-8843-441c-9bf9-bd48a3bec82b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:49.011019 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231429fd-8843-441c-9bf9-bd48a3bec82b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:49.018466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231429fd-8843-441c-9bf9-bd48a3bec82b service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:49.077322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1087/2152] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:50.546330 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcd9a7-21aa-4955-8ee1-1a4946b60d39 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:50.547944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-67fcd9a7-21aa-4955-8ee1-1a4946b60d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:50.562661 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcd9a7-21aa-4955-8ee1-1a4946b60d39 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:50.568264 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d382ab-d6cd-43c0-9877-df156c7c17d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:50.569482 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d382ab-d6cd-43c0-9877-df156c7c17d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:50.569773 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d382ab-d6cd-43c0-9877-df156c7c17d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:50.570055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d382ab-d6cd-43c0-9877-df156c7c17d3 admin admin] PATH_INFO: `/v3/users/139c8e5507ca4d799ced63b73ce1f9cb` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:50.571723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d382ab-d6cd-43c0-9877-df156c7c17d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=139c8e5507ca4d799ced63b73ce1f9cb)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:50.574061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d382ab-d6cd-43c0-9877-df156c7c17d3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:50.641262 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-28d382ab-d6cd-43c0-9877-df156c7c17d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '139c8e5507ca4d799ced63b73ce1f9cb'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:50.643978 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:50.653152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-28d382ab-d6cd-43c0-9877-df156c7c17d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '139c8e5507ca4d799ced63b73ce1f9cb'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:50.654590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-28d382ab-d6cd-43c0-9877-df156c7c17d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '139c8e5507ca4d799ced63b73ce1f9cb'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:50.655847 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-28d382ab-d6cd-43c0-9877-df156c7c17d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '139c8e5507ca4d799ced63b73ce1f9cb'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:50.692170 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-28d382ab-d6cd-43c0-9877-df156c7c17d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '139c8e5507ca4d799ced63b73ce1f9cb'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:50.724724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1066/2153] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:57:50 2022] DELETE /identity/v3/users/139c8e5507ca4d799ced63b73ce1f9cb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:50.729169 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e54fc-212f-4c27-9203-35c362cdb43a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:50.729674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e54fc-212f-4c27-9203-35c362cdb43a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:50.729761 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e54fc-212f-4c27-9203-35c362cdb43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:50.749962 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ea4e54fc-212f-4c27-9203-35c362cdb43a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:50.751370 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ea4e54fc-212f-4c27-9203-35c362cdb43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:50.825444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1088/2154] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:50.835817 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d382ab-d6cd-43c0-9877-df156c7c17d3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:50.837370 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-28d382ab-d6cd-43c0-9877-df156c7c17d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:50.883586 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84845ffe-e567-423c-894b-af5aa3172957 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:50.883978 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84845ffe-e567-423c-894b-af5aa3172957 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:50.883978 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84845ffe-e567-423c-894b-af5aa3172957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:50.906622 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-84845ffe-e567-423c-894b-af5aa3172957 None None] MFA Rules not processed for user `e5a63070e7f342dd911b45bf348c9da3`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:50.908187 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-84845ffe-e567-423c-894b-af5aa3172957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:50.924010 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d382ab-d6cd-43c0-9877-df156c7c17d3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:50.928759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f407c3-9a91-4967-8f42-0c58d0fc5051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:50.929387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f407c3-9a91-4967-8f42-0c58d0fc5051 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:50.929761 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f407c3-9a91-4967-8f42-0c58d0fc5051 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:50.929958 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f407c3-9a91-4967-8f42-0c58d0fc5051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:50.948251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f407c3-9a91-4967-8f42-0c58d0fc5051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:50.949656 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f407c3-9a91-4967-8f42-0c58d0fc5051 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:50.965789 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1067/2155] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:50.998520 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1089/2156] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:57:51.489787 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f407c3-9a91-4967-8f42-0c58d0fc5051 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:51.491808 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-61f407c3-9a91-4967-8f42-0c58d0fc5051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:51.507204 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f407c3-9a91-4967-8f42-0c58d0fc5051 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:51.513350 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43d619-429e-47d5-8baf-25ccc8da6c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:51.514254 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43d619-429e-47d5-8baf-25ccc8da6c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:51.514749 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43d619-429e-47d5-8baf-25ccc8da6c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:51.515233 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43d619-429e-47d5-8baf-25ccc8da6c1a admin admin] PATH_INFO: `/v3/projects/ebad8afe013747a9982e795613291d8f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:51.516842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43d619-429e-47d5-8baf-25ccc8da6c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebad8afe013747a9982e795613291d8f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:51.520998 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43d619-429e-47d5-8baf-25ccc8da6c1a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:51.580345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fd43d619-429e-47d5-8baf-25ccc8da6c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebad8afe013747a9982e795613291d8f', 'request_id': 'req-fd43d619-429e-47d5-8baf-25ccc8da6c1a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:51.593512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fd43d619-429e-47d5-8baf-25ccc8da6c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebad8afe013747a9982e795613291d8f', 'request_id': 'req-fd43d619-429e-47d5-8baf-25ccc8da6c1a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:51.601032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fd43d619-429e-47d5-8baf-25ccc8da6c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebad8afe013747a9982e795613291d8f', 'request_id': 'req-fd43d619-429e-47d5-8baf-25ccc8da6c1a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:51.613681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fd43d619-429e-47d5-8baf-25ccc8da6c1a admin admin] The token cache is being invalidate because project ebad8afe013747a9982e795613291d8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:57:51.613972 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fd43d619-429e-47d5-8baf-25ccc8da6c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:51.614808 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-fd43d619-429e-47d5-8baf-25ccc8da6c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:51.616413 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1068/2157] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:57:51 2022] DELETE /identity/v3/projects/ebad8afe013747a9982e795613291d8f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:51.620451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84845ffe-e567-423c-894b-af5aa3172957 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:51.625882 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:51.632700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84845ffe-e567-423c-894b-af5aa3172957 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:51.694931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e104cca-1e33-402b-84ce-a0fe8d51ec3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:51.696107 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e104cca-1e33-402b-84ce-a0fe8d51ec3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:51.696393 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e104cca-1e33-402b-84ce-a0fe8d51ec3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:51.696672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e104cca-1e33-402b-84ce-a0fe8d51ec3d admin admin] PATH_INFO: `/v3/users/46cd1d19d19d4a649010b2a54ba2ec3a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:51.697823 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e104cca-1e33-402b-84ce-a0fe8d51ec3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=46cd1d19d19d4a649010b2a54ba2ec3a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:51.699759 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e104cca-1e33-402b-84ce-a0fe8d51ec3d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:51.804932 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8e104cca-1e33-402b-84ce-a0fe8d51ec3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46cd1d19d19d4a649010b2a54ba2ec3a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:51.834274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8e104cca-1e33-402b-84ce-a0fe8d51ec3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46cd1d19d19d4a649010b2a54ba2ec3a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:51.862607 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8e104cca-1e33-402b-84ce-a0fe8d51ec3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46cd1d19d19d4a649010b2a54ba2ec3a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:51.863553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8e104cca-1e33-402b-84ce-a0fe8d51ec3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46cd1d19d19d4a649010b2a54ba2ec3a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:51.864226 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8e104cca-1e33-402b-84ce-a0fe8d51ec3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46cd1d19d19d4a649010b2a54ba2ec3a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:51.901561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1090/2158] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:57:51 2022] DELETE /identity/v3/users/46cd1d19d19d4a649010b2a54ba2ec3a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:52.222153 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43d619-429e-47d5-8baf-25ccc8da6c1a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:52.224714 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fd43d619-429e-47d5-8baf-25ccc8da6c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:52.242918 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43d619-429e-47d5-8baf-25ccc8da6c1a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:52.300629 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:52.311245 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872250e4-1d45-4bc5-8d66-49bff228965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:52.312054 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872250e4-1d45-4bc5-8d66-49bff228965f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:52.312512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872250e4-1d45-4bc5-8d66-49bff228965f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:52.312800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872250e4-1d45-4bc5-8d66-49bff228965f admin admin] PATH_INFO: `/v3/projects/efae0da6cb7347e59aaa67f8333aa2f0` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:52.313940 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872250e4-1d45-4bc5-8d66-49bff228965f admin admin] RBAC: Authorizing `identity:delete_project(project_id=efae0da6cb7347e59aaa67f8333aa2f0)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:52.317010 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872250e4-1d45-4bc5-8d66-49bff228965f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:52.367214 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-872250e4-1d45-4bc5-8d66-49bff228965f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efae0da6cb7347e59aaa67f8333aa2f0', 'request_id': 'req-872250e4-1d45-4bc5-8d66-49bff228965f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:52.378300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-872250e4-1d45-4bc5-8d66-49bff228965f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efae0da6cb7347e59aaa67f8333aa2f0', 'request_id': 'req-872250e4-1d45-4bc5-8d66-49bff228965f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:52.391692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-872250e4-1d45-4bc5-8d66-49bff228965f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efae0da6cb7347e59aaa67f8333aa2f0', 'request_id': 'req-872250e4-1d45-4bc5-8d66-49bff228965f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:52.403416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-872250e4-1d45-4bc5-8d66-49bff228965f admin admin] The token cache is being invalidate because project efae0da6cb7347e59aaa67f8333aa2f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:57:52.403713 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-872250e4-1d45-4bc5-8d66-49bff228965f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:52.404407 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-872250e4-1d45-4bc5-8d66-49bff228965f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:52.406065 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1069/2159] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:57:52 2022] DELETE /identity/v3/projects/efae0da6cb7347e59aaa67f8333aa2f0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:52.411244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2b447-4c75-46b8-a4c9-d4a93c7286b5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:52.411528 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2b447-4c75-46b8-a4c9-d4a93c7286b5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:52.411801 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2b447-4c75-46b8-a4c9-d4a93c7286b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:52.432259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-63e2b447-4c75-46b8-a4c9-d4a93c7286b5 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:52.433489 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-63e2b447-4c75-46b8-a4c9-d4a93c7286b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:52.506889 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1091/2160] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:57:52.514833 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac573f5b-1bc0-45ba-87ac-c5b7abb5bd38 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:52.515126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac573f5b-1bc0-45ba-87ac-c5b7abb5bd38 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:52.515405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac573f5b-1bc0-45ba-87ac-c5b7abb5bd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:52.545479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ac573f5b-1bc0-45ba-87ac-c5b7abb5bd38 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:52.546731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ac573f5b-1bc0-45ba-87ac-c5b7abb5bd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:52.555771 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1070/2161] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:52.560098 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2b447-4c75-46b8-a4c9-d4a93c7286b5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:52.571171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2b447-4c75-46b8-a4c9-d4a93c7286b5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:52.575930 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788c837-16e3-4887-8ec4-61823153eab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:52.576569 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788c837-16e3-4887-8ec4-61823153eab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:52.576843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788c837-16e3-4887-8ec4-61823153eab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:52.577112 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788c837-16e3-4887-8ec4-61823153eab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:52.577780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788c837-16e3-4887-8ec4-61823153eab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:57:52.578081 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788c837-16e3-4887-8ec4-61823153eab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:52.580171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788c837-16e3-4887-8ec4-61823153eab7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:52.596031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1092/2162] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:57:52.600148 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac573f5b-1bc0-45ba-87ac-c5b7abb5bd38 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:52.609852 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac573f5b-1bc0-45ba-87ac-c5b7abb5bd38 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:52.615468 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67037c-e884-427d-84ee-a6807bec29d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:52.616112 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67037c-e884-427d-84ee-a6807bec29d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:52.616393 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67037c-e884-427d-84ee-a6807bec29d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:52.616665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67037c-e884-427d-84ee-a6807bec29d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:52.617296 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67037c-e884-427d-84ee-a6807bec29d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:52.619214 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67037c-e884-427d-84ee-a6807bec29d6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:52.656724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1071/2163] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:57:52 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:52.662558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788c837-16e3-4887-8ec4-61823153eab7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:52.672468 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788c837-16e3-4887-8ec4-61823153eab7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:52.678869 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:52.735820 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfaa49b-bee3-4a67-8089-0da80d9524d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:52.736372 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaa49b-bee3-4a67-8089-0da80d9524d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:52.736814 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaa49b-bee3-4a67-8089-0da80d9524d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:52.736945 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaa49b-bee3-4a67-8089-0da80d9524d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:52.738481 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfaa49b-bee3-4a67-8089-0da80d9524d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:52.740525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfaa49b-bee3-4a67-8089-0da80d9524d1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:52.763148 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1093/2164] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:57:52 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:57:52.769681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67037c-e884-427d-84ee-a6807bec29d6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:52.780499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67037c-e884-427d-84ee-a6807bec29d6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:52.785455 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f329d36-5ca6-4b0d-a0a4-7f42f8e2ff00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:52.786057 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f329d36-5ca6-4b0d-a0a4-7f42f8e2ff00 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:52.786341 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f329d36-5ca6-4b0d-a0a4-7f42f8e2ff00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:52.786617 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f329d36-5ca6-4b0d-a0a4-7f42f8e2ff00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:52.787375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f329d36-5ca6-4b0d-a0a4-7f42f8e2ff00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:52.789037 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f329d36-5ca6-4b0d-a0a4-7f42f8e2ff00 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:52.799069 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1072/2165] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:57:52.803223 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfaa49b-bee3-4a67-8089-0da80d9524d1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:52.813080 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfaa49b-bee3-4a67-8089-0da80d9524d1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:52.818274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7b631-c1c1-4a0f-8010-c9f101af75c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:52.818865 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7b631-c1c1-4a0f-8010-c9f101af75c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:52.819143 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7b631-c1c1-4a0f-8010-c9f101af75c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:52.819417 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7b631-c1c1-4a0f-8010-c9f101af75c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:52.820094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7b631-c1c1-4a0f-8010-c9f101af75c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:52.821677 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7b631-c1c1-4a0f-8010-c9f101af75c8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:52.833040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1094/2166] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:52.836971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f329d36-5ca6-4b0d-a0a4-7f42f8e2ff00 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:52.848593 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f329d36-5ca6-4b0d-a0a4-7f42f8e2ff00 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:52.854648 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1b05b-66db-4640-8e04-751ffa0444bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:52.855483 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1b05b-66db-4640-8e04-751ffa0444bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:52.855827 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1b05b-66db-4640-8e04-751ffa0444bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:52.856197 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1b05b-66db-4640-8e04-751ffa0444bf admin admin] PATH_INFO: `/v3/projects/7e0b5ec3fa8a40228cc059101514711c/users/b2aec32a7b5848278ab0eed25083ff27/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:52.880077 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1b05b-66db-4640-8e04-751ffa0444bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0b5ec3fa8a40228cc059101514711c, user_id=b2aec32a7b5848278ab0eed25083ff27, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:52.884519 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1b05b-66db-4640-8e04-751ffa0444bf admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:52.922000 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1073/2167] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:52 2022] PUT /identity/v3/projects/7e0b5ec3fa8a40228cc059101514711c/users/b2aec32a7b5848278ab0eed25083ff27/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:57:52.933032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab18e7-b060-410c-8da2-f924cc5e22d7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:52.933403 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab18e7-b060-410c-8da2-f924cc5e22d7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:52.933749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab18e7-b060-410c-8da2-f924cc5e22d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:52.965393 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-62ab18e7-b060-410c-8da2-f924cc5e22d7 None None] MFA Rules not processed for user `b2aec32a7b5848278ab0eed25083ff27`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:52.966601 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-62ab18e7-b060-410c-8da2-f924cc5e22d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:53.062250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1095/2168] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:57:53.067716 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1b05b-66db-4640-8e04-751ffa0444bf admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:53.150855 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1b05b-66db-4640-8e04-751ffa0444bf admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:53.156411 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c909bd-a172-4c2f-9025-efa0a09cecb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:53.157169 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c909bd-a172-4c2f-9025-efa0a09cecb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:53.157468 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c909bd-a172-4c2f-9025-efa0a09cecb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:53.157737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c909bd-a172-4c2f-9025-efa0a09cecb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:53.158359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c909bd-a172-4c2f-9025-efa0a09cecb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:53.160861 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c909bd-a172-4c2f-9025-efa0a09cecb9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:53.197852 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1074/2169] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:57:53 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:53.199847 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab18e7-b060-410c-8da2-f924cc5e22d7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:53.213120 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab18e7-b060-410c-8da2-f924cc5e22d7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:53.294363 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79daa23-ff84-4215-a7d5-1a1816169ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:53.295000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79daa23-ff84-4215-a7d5-1a1816169ba3 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:53.295277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79daa23-ff84-4215-a7d5-1a1816169ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:53.295576 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79daa23-ff84-4215-a7d5-1a1816169ba3 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:53.296249 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79daa23-ff84-4215-a7d5-1a1816169ba3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:53.298207 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79daa23-ff84-4215-a7d5-1a1816169ba3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:53.325306 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1096/2170] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:57:53 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:53.329435 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c909bd-a172-4c2f-9025-efa0a09cecb9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:53.337235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:53.344343 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c909bd-a172-4c2f-9025-efa0a09cecb9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:53.356193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66120ec-5800-4f52-a617-bb452fe8d242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:53.356823 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66120ec-5800-4f52-a617-bb452fe8d242 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:53.357100 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66120ec-5800-4f52-a617-bb452fe8d242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:53.357935 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66120ec-5800-4f52-a617-bb452fe8d242 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:53.358595 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66120ec-5800-4f52-a617-bb452fe8d242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:53.360223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66120ec-5800-4f52-a617-bb452fe8d242 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:53.372074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1075/2171] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:53.376769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79daa23-ff84-4215-a7d5-1a1816169ba3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:53.388877 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79daa23-ff84-4215-a7d5-1a1816169ba3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:53.396457 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c6082-55f3-4a85-9d7f-0f8860808306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:53.397300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c6082-55f3-4a85-9d7f-0f8860808306 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:53.397591 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c6082-55f3-4a85-9d7f-0f8860808306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:53.397875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c6082-55f3-4a85-9d7f-0f8860808306 admin admin] PATH_INFO: `/v3/projects/735d06b1404c4a1282f2fc409e844f2f/users/2a6063ec03d94a21911e6239b0a9b0b7/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:53.400724 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:53.421517 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c6082-55f3-4a85-9d7f-0f8860808306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735d06b1404c4a1282f2fc409e844f2f, user_id=2a6063ec03d94a21911e6239b0a9b0b7, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:53.425143 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c6082-55f3-4a85-9d7f-0f8860808306 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:53.439753 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1097/2172] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:53 2022] PUT /identity/v3/projects/735d06b1404c4a1282f2fc409e844f2f/users/2a6063ec03d94a21911e6239b0a9b0b7/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:53.444837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66120ec-5800-4f52-a617-bb452fe8d242 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:53.455297 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66120ec-5800-4f52-a617-bb452fe8d242 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:53.521094 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff0a36-8de0-420d-998b-2482882a2d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:53.521707 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff0a36-8de0-420d-998b-2482882a2d94 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:53.521988 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff0a36-8de0-420d-998b-2482882a2d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:53.522260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff0a36-8de0-420d-998b-2482882a2d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:53.522928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff0a36-8de0-420d-998b-2482882a2d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:53.524574 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff0a36-8de0-420d-998b-2482882a2d94 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:53.534913 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1076/2173] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:53.539393 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c6082-55f3-4a85-9d7f-0f8860808306 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:53.552784 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c6082-55f3-4a85-9d7f-0f8860808306 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:53.557812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b662629-858a-4b74-b45d-14fa0dd4c044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:53.558490 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b662629-858a-4b74-b45d-14fa0dd4c044 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:53.558821 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b662629-858a-4b74-b45d-14fa0dd4c044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:53.559056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b662629-858a-4b74-b45d-14fa0dd4c044 admin admin] PATH_INFO: `/v3/projects/735d06b1404c4a1282f2fc409e844f2f/users/2a6063ec03d94a21911e6239b0a9b0b7/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:53.561239 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b662629-858a-4b74-b45d-14fa0dd4c044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735d06b1404c4a1282f2fc409e844f2f, user_id=2a6063ec03d94a21911e6239b0a9b0b7, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:53.563751 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b662629-858a-4b74-b45d-14fa0dd4c044 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:53.578957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1098/2174] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:53 2022] PUT /identity/v3/projects/735d06b1404c4a1282f2fc409e844f2f/users/2a6063ec03d94a21911e6239b0a9b0b7/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:53.590057 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f5a05-0ea4-4e24-8424-099ff4e5fd9e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:53.590347 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f5a05-0ea4-4e24-8424-099ff4e5fd9e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:53.590612 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f5a05-0ea4-4e24-8424-099ff4e5fd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:53.628390 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-de8f5a05-0ea4-4e24-8424-099ff4e5fd9e None None] MFA Rules not processed for user `2a6063ec03d94a21911e6239b0a9b0b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:53.629843 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-de8f5a05-0ea4-4e24-8424-099ff4e5fd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:53.711326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1077/2175] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:53.729247 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b662629-858a-4b74-b45d-14fa0dd4c044 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:53.731794 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2b662629-858a-4b74-b45d-14fa0dd4c044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:53.857438 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b662629-858a-4b74-b45d-14fa0dd4c044 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:53.866190 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575f6d0-8827-4092-b586-4d7ad35e1143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:53.867307 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575f6d0-8827-4092-b586-4d7ad35e1143 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:53.868168 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575f6d0-8827-4092-b586-4d7ad35e1143 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:53.868722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575f6d0-8827-4092-b586-4d7ad35e1143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:53.884548 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575f6d0-8827-4092-b586-4d7ad35e1143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:53.886124 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575f6d0-8827-4092-b586-4d7ad35e1143 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:53.898170 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1099/2176] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:54.449350 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f5a05-0ea4-4e24-8424-099ff4e5fd9e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:54.515668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f5a05-0ea4-4e24-8424-099ff4e5fd9e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:54.521808 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce3632-63eb-4193-83f0-275c4036f78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:54.522454 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce3632-63eb-4193-83f0-275c4036f78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:54.522732 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce3632-63eb-4193-83f0-275c4036f78e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:54.523005 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce3632-63eb-4193-83f0-275c4036f78e admin admin] PATH_INFO: `/v3/users/b2aec32a7b5848278ab0eed25083ff27` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:54.524175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce3632-63eb-4193-83f0-275c4036f78e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2aec32a7b5848278ab0eed25083ff27)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:54.526184 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce3632-63eb-4193-83f0-275c4036f78e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:54.542776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:54.576872 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-60ce3632-63eb-4193-83f0-275c4036f78e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2aec32a7b5848278ab0eed25083ff27'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:54.585971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-60ce3632-63eb-4193-83f0-275c4036f78e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2aec32a7b5848278ab0eed25083ff27'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:54.586692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-60ce3632-63eb-4193-83f0-275c4036f78e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2aec32a7b5848278ab0eed25083ff27'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:54.587315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-60ce3632-63eb-4193-83f0-275c4036f78e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2aec32a7b5848278ab0eed25083ff27'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:54.595221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-60ce3632-63eb-4193-83f0-275c4036f78e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2aec32a7b5848278ab0eed25083ff27'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:54.617754 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1078/2177] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:57:54 2022] DELETE /identity/v3/users/b2aec32a7b5848278ab0eed25083ff27 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:54.622348 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29a779-1fe7-44bb-815d-746a3e4ccdde None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:54.622651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29a779-1fe7-44bb-815d-746a3e4ccdde None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:54.622908 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29a779-1fe7-44bb-815d-746a3e4ccdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:54.643019 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-bd29a779-1fe7-44bb-815d-746a3e4ccdde None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:54.644299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bd29a779-1fe7-44bb-815d-746a3e4ccdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:54.744922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1100/2178] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:54.785242 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce3632-63eb-4193-83f0-275c4036f78e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:54.786708 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-60ce3632-63eb-4193-83f0-275c4036f78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:54.850651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce3632-63eb-4193-83f0-275c4036f78e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:54.854365 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b6f20-39e7-4660-88c6-c96269c8826c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:54.854983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b6f20-39e7-4660-88c6-c96269c8826c service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:54.855263 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b6f20-39e7-4660-88c6-c96269c8826c service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:54.855537 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b6f20-39e7-4660-88c6-c96269c8826c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:54.865653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b6f20-39e7-4660-88c6-c96269c8826c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:54.867149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b6f20-39e7-4660-88c6-c96269c8826c service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:54.879433 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1079/2179] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:55.225511 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29a779-1fe7-44bb-815d-746a3e4ccdde None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:55.228193 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bd29a779-1fe7-44bb-815d-746a3e4ccdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:55.242939 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29a779-1fe7-44bb-815d-746a3e4ccdde None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:55.262567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea56399-0b78-48e4-bcda-d090b5003067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:55.263816 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea56399-0b78-48e4-bcda-d090b5003067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:55.264394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea56399-0b78-48e4-bcda-d090b5003067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:55.264828 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea56399-0b78-48e4-bcda-d090b5003067 admin admin] PATH_INFO: `/v3/projects/7e0b5ec3fa8a40228cc059101514711c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:55.266484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea56399-0b78-48e4-bcda-d090b5003067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e0b5ec3fa8a40228cc059101514711c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:55.270618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea56399-0b78-48e4-bcda-d090b5003067 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:55.378639 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6ea56399-0b78-48e4-bcda-d090b5003067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e0b5ec3fa8a40228cc059101514711c', 'request_id': 'req-6ea56399-0b78-48e4-bcda-d090b5003067'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:55.394153 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6ea56399-0b78-48e4-bcda-d090b5003067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e0b5ec3fa8a40228cc059101514711c', 'request_id': 'req-6ea56399-0b78-48e4-bcda-d090b5003067'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:55.404762 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6ea56399-0b78-48e4-bcda-d090b5003067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e0b5ec3fa8a40228cc059101514711c', 'request_id': 'req-6ea56399-0b78-48e4-bcda-d090b5003067'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:55.407641 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:55.421216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6ea56399-0b78-48e4-bcda-d090b5003067 admin admin] The token cache is being invalidate because project 7e0b5ec3fa8a40228cc059101514711c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:57:55.421856 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6ea56399-0b78-48e4-bcda-d090b5003067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:55.423729 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6ea56399-0b78-48e4-bcda-d090b5003067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:55.429139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1101/2180] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:57:55 2022] DELETE /identity/v3/projects/7e0b5ec3fa8a40228cc059101514711c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:55.430561 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b6f20-39e7-4660-88c6-c96269c8826c service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:55.447794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b6f20-39e7-4660-88c6-c96269c8826c service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:55.501638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090d799-189b-4881-a7d1-b3345ced8886 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:55.501936 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090d799-189b-4881-a7d1-b3345ced8886 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:55.502236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090d799-189b-4881-a7d1-b3345ced8886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:55.508941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5908d5c9-c47c-4096-9101-4bc2dd6a286f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:55.509668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908d5c9-c47c-4096-9101-4bc2dd6a286f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:55.510025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908d5c9-c47c-4096-9101-4bc2dd6a286f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:55.510374 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908d5c9-c47c-4096-9101-4bc2dd6a286f admin admin] PATH_INFO: `/v3/users/2a6063ec03d94a21911e6239b0a9b0b7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:55.511584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908d5c9-c47c-4096-9101-4bc2dd6a286f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a6063ec03d94a21911e6239b0a9b0b7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:55.513691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5908d5c9-c47c-4096-9101-4bc2dd6a286f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:55.527489 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a090d799-189b-4881-a7d1-b3345ced8886 None None] MFA Rules not processed for user `9c758557426941babdaa68cbae43f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:55.529045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a090d799-189b-4881-a7d1-b3345ced8886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:55.562953 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:55.571325 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5908d5c9-c47c-4096-9101-4bc2dd6a286f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a6063ec03d94a21911e6239b0a9b0b7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:55.583165 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5908d5c9-c47c-4096-9101-4bc2dd6a286f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a6063ec03d94a21911e6239b0a9b0b7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:55.584491 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5908d5c9-c47c-4096-9101-4bc2dd6a286f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a6063ec03d94a21911e6239b0a9b0b7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:55.585541 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5908d5c9-c47c-4096-9101-4bc2dd6a286f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a6063ec03d94a21911e6239b0a9b0b7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:55.594445 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5908d5c9-c47c-4096-9101-4bc2dd6a286f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a6063ec03d94a21911e6239b0a9b0b7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:55.607715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1102/2181] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:57:55.621865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1080/2182] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:57:55 2022] DELETE /identity/v3/users/2a6063ec03d94a21911e6239b0a9b0b7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:56.175793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090d799-189b-4881-a7d1-b3345ced8886 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:56.177531 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a090d799-189b-4881-a7d1-b3345ced8886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:56.207803 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090d799-189b-4881-a7d1-b3345ced8886 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:56.375217 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb93be-fd7c-4fa8-b7da-62a273d9a2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:56.376135 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb93be-fd7c-4fa8-b7da-62a273d9a2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:56.376764 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb93be-fd7c-4fa8-b7da-62a273d9a2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:56.377516 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb93be-fd7c-4fa8-b7da-62a273d9a2c2 admin admin] PATH_INFO: `/v3/projects/735d06b1404c4a1282f2fc409e844f2f` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:56.379229 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb93be-fd7c-4fa8-b7da-62a273d9a2c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=735d06b1404c4a1282f2fc409e844f2f)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:56.382277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb93be-fd7c-4fa8-b7da-62a273d9a2c2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:56.508407 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-86fb93be-fd7c-4fa8-b7da-62a273d9a2c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735d06b1404c4a1282f2fc409e844f2f', 'request_id': 'req-86fb93be-fd7c-4fa8-b7da-62a273d9a2c2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:56.521136 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-86fb93be-fd7c-4fa8-b7da-62a273d9a2c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735d06b1404c4a1282f2fc409e844f2f', 'request_id': 'req-86fb93be-fd7c-4fa8-b7da-62a273d9a2c2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:56.542625 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-86fb93be-fd7c-4fa8-b7da-62a273d9a2c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735d06b1404c4a1282f2fc409e844f2f', 'request_id': 'req-86fb93be-fd7c-4fa8-b7da-62a273d9a2c2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:56.569649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-86fb93be-fd7c-4fa8-b7da-62a273d9a2c2 admin admin] The token cache is being invalidate because project 735d06b1404c4a1282f2fc409e844f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:57:56.570039 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-86fb93be-fd7c-4fa8-b7da-62a273d9a2c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:56.570785 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-86fb93be-fd7c-4fa8-b7da-62a273d9a2c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:56.579535 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1103/2183] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:57:56 2022] DELETE /identity/v3/projects/735d06b1404c4a1282f2fc409e844f2f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:56.582047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d6461-6467-4b46-824e-bc878b6e93a5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:56.582943 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d6461-6467-4b46-824e-bc878b6e93a5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:56.583425 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d6461-6467-4b46-824e-bc878b6e93a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:56.625633 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d10d6461-6467-4b46-824e-bc878b6e93a5 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:56.626962 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d10d6461-6467-4b46-824e-bc878b6e93a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:56.779923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1081/2184] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:57:56.788728 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1eb6b-0005-4459-b712-b275c5a8b330 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:56.789016 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1eb6b-0005-4459-b712-b275c5a8b330 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:56.789743 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1eb6b-0005-4459-b712-b275c5a8b330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:56.848955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f1c1eb6b-0005-4459-b712-b275c5a8b330 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:56.850320 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f1c1eb6b-0005-4459-b712-b275c5a8b330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:56.876597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1104/2185] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:56.878674 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d6461-6467-4b46-824e-bc878b6e93a5 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:56.895708 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d6461-6467-4b46-824e-bc878b6e93a5 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:56.905770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ea029-c25e-40b6-a3b9-030755e59b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:56.907148 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ea029-c25e-40b6-a3b9-030755e59b81 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:56.908280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ea029-c25e-40b6-a3b9-030755e59b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:56.910271 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ea029-c25e-40b6-a3b9-030755e59b81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:56.911129 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ea029-c25e-40b6-a3b9-030755e59b81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:57:56.911444 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ea029-c25e-40b6-a3b9-030755e59b81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:56.913100 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ea029-c25e-40b6-a3b9-030755e59b81 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:56.944039 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1082/2186] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:57:56.947809 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1eb6b-0005-4459-b712-b275c5a8b330 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:56.958489 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1eb6b-0005-4459-b712-b275c5a8b330 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:56.964648 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292be18-8a84-4ad8-b667-b4055b2b836f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:56.965404 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292be18-8a84-4ad8-b667-b4055b2b836f admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:56.965809 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292be18-8a84-4ad8-b667-b4055b2b836f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:56.966195 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292be18-8a84-4ad8-b667-b4055b2b836f admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:56.966999 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292be18-8a84-4ad8-b667-b4055b2b836f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:56.969352 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292be18-8a84-4ad8-b667-b4055b2b836f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:57.007081 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1105/2187] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:57:56 2022] POST /identity/v3/projects => generated 363 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:57.008925 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ea029-c25e-40b6-a3b9-030755e59b81 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:57.026809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ea029-c25e-40b6-a3b9-030755e59b81 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:57.097539 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a13c11-a170-4bec-897d-952835bfb81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:57.098339 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a13c11-a170-4bec-897d-952835bfb81a admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:57.098684 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a13c11-a170-4bec-897d-952835bfb81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:57.099061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a13c11-a170-4bec-897d-952835bfb81a admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:57.099848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a13c11-a170-4bec-897d-952835bfb81a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:57.102505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a13c11-a170-4bec-897d-952835bfb81a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:57.128919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1083/2188] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:57:57 2022] POST /identity/v3/users => generated 282 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:57.130366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292be18-8a84-4ad8-b667-b4055b2b836f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:57.136742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:57.142826 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292be18-8a84-4ad8-b667-b4055b2b836f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:57.149366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2f076-e16b-4395-b9f1-3fac7c6766e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:57.150552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2f076-e16b-4395-b9f1-3fac7c6766e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:57.151147 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2f076-e16b-4395-b9f1-3fac7c6766e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:57.151488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc2f076-e16b-4395-b9f1-3fac7c6766e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:57.152372 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2f076-e16b-4395-b9f1-3fac7c6766e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:57.154421 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc2f076-e16b-4395-b9f1-3fac7c6766e4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:57.167352 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1106/2189] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:57.171432 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a13c11-a170-4bec-897d-952835bfb81a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:57.183014 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a13c11-a170-4bec-897d-952835bfb81a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:57.188195 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62cdae-9a90-48e8-8adc-532f63ad1c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:57.188800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62cdae-9a90-48e8-8adc-532f63ad1c6d admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:57.189106 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62cdae-9a90-48e8-8adc-532f63ad1c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:57.189358 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62cdae-9a90-48e8-8adc-532f63ad1c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:57.190582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62cdae-9a90-48e8-8adc-532f63ad1c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:57.192664 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62cdae-9a90-48e8-8adc-532f63ad1c6d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:57.209449 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1084/2190] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:57.210630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2f076-e16b-4395-b9f1-3fac7c6766e4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:57.236761 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc2f076-e16b-4395-b9f1-3fac7c6766e4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:57.244134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752329b-fa40-4ae5-866d-11d5e45d03d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:57.244808 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752329b-fa40-4ae5-866d-11d5e45d03d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:57.245637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752329b-fa40-4ae5-866d-11d5e45d03d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:57.245898 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752329b-fa40-4ae5-866d-11d5e45d03d6 admin admin] PATH_INFO: `/v3/projects/714d1c784dd147a4ac9cc8a645cd3e5b/users/e1092082fe92429a96009dd73aa74287/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:57.262684 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752329b-fa40-4ae5-866d-11d5e45d03d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=714d1c784dd147a4ac9cc8a645cd3e5b, user_id=e1092082fe92429a96009dd73aa74287, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:57.265409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752329b-fa40-4ae5-866d-11d5e45d03d6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:57.279981 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1107/2191] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:57 2022] PUT /identity/v3/projects/714d1c784dd147a4ac9cc8a645cd3e5b/users/e1092082fe92429a96009dd73aa74287/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:57:57.291270 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90688e-cfd4-47a5-8697-baae7c258aed None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:57.291622 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90688e-cfd4-47a5-8697-baae7c258aed None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:57.291959 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90688e-cfd4-47a5-8697-baae7c258aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:57.324188 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-bc90688e-cfd4-47a5-8697-baae7c258aed None None] MFA Rules not processed for user `e1092082fe92429a96009dd73aa74287`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:57.325413 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bc90688e-cfd4-47a5-8697-baae7c258aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:57.336282 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:57.355743 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752329b-fa40-4ae5-866d-11d5e45d03d6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:57.357555 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0752329b-fa40-4ae5-866d-11d5e45d03d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:57.405373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1085/2192] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:57:57.410480 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90688e-cfd4-47a5-8697-baae7c258aed None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:57.434754 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752329b-fa40-4ae5-866d-11d5e45d03d6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:57.439737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f865025-1864-4975-b070-a78dfcc7b598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:57.440986 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f865025-1864-4975-b070-a78dfcc7b598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:57.441336 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f865025-1864-4975-b070-a78dfcc7b598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:57.441626 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f865025-1864-4975-b070-a78dfcc7b598 admin admin] PATH_INFO: `/v3/users/d98249ef64134e30a6b335dbb73322ae` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:57.442773 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f865025-1864-4975-b070-a78dfcc7b598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d98249ef64134e30a6b335dbb73322ae)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:57.444755 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f865025-1864-4975-b070-a78dfcc7b598 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:57.473816 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90688e-cfd4-47a5-8697-baae7c258aed None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:57.478698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c5575-4ce7-4c67-81eb-96a01d1a84f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:57.479328 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c5575-4ce7-4c67-81eb-96a01d1a84f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:57.479586 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c5575-4ce7-4c67-81eb-96a01d1a84f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:57.479857 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c5575-4ce7-4c67-81eb-96a01d1a84f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:57.480579 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c5575-4ce7-4c67-81eb-96a01d1a84f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:57.482627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c5575-4ce7-4c67-81eb-96a01d1a84f8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:57.494516 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9f865025-1864-4975-b070-a78dfcc7b598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd98249ef64134e30a6b335dbb73322ae'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:57.501890 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9f865025-1864-4975-b070-a78dfcc7b598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd98249ef64134e30a6b335dbb73322ae'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:57.514445 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1086/2193] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:57:57 2022] POST /identity/v3/projects => generated 363 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:57:57.515319 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9f865025-1864-4975-b070-a78dfcc7b598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd98249ef64134e30a6b335dbb73322ae'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:57.515509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c5575-4ce7-4c67-81eb-96a01d1a84f8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:57.516055 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9f865025-1864-4975-b070-a78dfcc7b598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd98249ef64134e30a6b335dbb73322ae'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:57.516681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9f865025-1864-4975-b070-a78dfcc7b598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd98249ef64134e30a6b335dbb73322ae'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:57.517155 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d93c5575-4ce7-4c67-81eb-96a01d1a84f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:57.529690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1108/2194] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:57:57 2022] DELETE /identity/v3/users/d98249ef64134e30a6b335dbb73322ae => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:57:57.534178 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b16953-784f-4e63-86c1-53e9ebfe6253 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:57.534666 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b16953-784f-4e63-86c1-53e9ebfe6253 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:57.535053 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b16953-784f-4e63-86c1-53e9ebfe6253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:57.554787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-96b16953-784f-4e63-86c1-53e9ebfe6253 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:57.556162 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-96b16953-784f-4e63-86c1-53e9ebfe6253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:57.589031 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c5575-4ce7-4c67-81eb-96a01d1a84f8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:57.603449 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:57.627361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1109/2195] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:57:57.639198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b16953-784f-4e63-86c1-53e9ebfe6253 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:57.639369 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:57.641532 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-96b16953-784f-4e63-86c1-53e9ebfe6253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:57.659054 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50feff-88e1-4732-9e41-3d69b3ddb43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:57.659613 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50feff-88e1-4732-9e41-3d69b3ddb43f admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:57.659892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50feff-88e1-4732-9e41-3d69b3ddb43f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:57.660201 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50feff-88e1-4732-9e41-3d69b3ddb43f admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:57.660837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50feff-88e1-4732-9e41-3d69b3ddb43f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:57.662791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50feff-88e1-4732-9e41-3d69b3ddb43f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:57.688346 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1087/2196] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:57:57 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:57:57.692555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50feff-88e1-4732-9e41-3d69b3ddb43f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:57.704504 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50feff-88e1-4732-9e41-3d69b3ddb43f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:57.710375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41237460-cd33-460f-a7cc-0313847fca7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:57.711075 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41237460-cd33-460f-a7cc-0313847fca7d admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:57.711484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41237460-cd33-460f-a7cc-0313847fca7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:57.712128 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41237460-cd33-460f-a7cc-0313847fca7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:57.712787 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41237460-cd33-460f-a7cc-0313847fca7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:57.714393 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41237460-cd33-460f-a7cc-0313847fca7d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:57.720701 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b16953-784f-4e63-86c1-53e9ebfe6253 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:57.725061 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3e904-bc64-4060-bb72-c0aca9e928b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:57.725675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3e904-bc64-4060-bb72-c0aca9e928b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:57.725949 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3e904-bc64-4060-bb72-c0aca9e928b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:57.726216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3e904-bc64-4060-bb72-c0aca9e928b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:57.733930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1088/2197] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:57:57.737927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41237460-cd33-460f-a7cc-0313847fca7d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:57.738406 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3e904-bc64-4060-bb72-c0aca9e928b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:57.739860 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3e904-bc64-4060-bb72-c0aca9e928b6 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:57.748011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41237460-cd33-460f-a7cc-0313847fca7d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:57.749477 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1110/2198] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:57.753278 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5cdb2-27f5-46ea-9b41-6eb40b1c459d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:57.753937 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5cdb2-27f5-46ea-9b41-6eb40b1c459d admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:57.754221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5cdb2-27f5-46ea-9b41-6eb40b1c459d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:57.754501 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5cdb2-27f5-46ea-9b41-6eb40b1c459d admin admin] PATH_INFO: `/v3/projects/e982a9a7feab43eea8fc359ff8dc3200/users/f7a3373aa4ef430299336fc1979b8b9a/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:57.770562 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5cdb2-27f5-46ea-9b41-6eb40b1c459d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e982a9a7feab43eea8fc359ff8dc3200, user_id=f7a3373aa4ef430299336fc1979b8b9a, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:57.773188 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5cdb2-27f5-46ea-9b41-6eb40b1c459d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:57.787936 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1089/2199] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:57 2022] PUT /identity/v3/projects/e982a9a7feab43eea8fc359ff8dc3200/users/f7a3373aa4ef430299336fc1979b8b9a/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:57:57.791976 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3e904-bc64-4060-bb72-c0aca9e928b6 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:57.803570 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3e904-bc64-4060-bb72-c0aca9e928b6 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:57.878490 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d730d17-09ab-46ff-8523-05b121d370f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:57.879321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d730d17-09ab-46ff-8523-05b121d370f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:57.879818 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d730d17-09ab-46ff-8523-05b121d370f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:57.880470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d730d17-09ab-46ff-8523-05b121d370f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:57.881281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d730d17-09ab-46ff-8523-05b121d370f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:57.883078 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d730d17-09ab-46ff-8523-05b121d370f3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:57.897683 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1111/2200] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:57.899101 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5cdb2-27f5-46ea-9b41-6eb40b1c459d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:57.910905 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5cdb2-27f5-46ea-9b41-6eb40b1c459d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:57.915562 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3951ca-4ca4-4038-8a43-e5b76b89b406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:57.916261 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3951ca-4ca4-4038-8a43-e5b76b89b406 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:57.919325 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3951ca-4ca4-4038-8a43-e5b76b89b406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:57.919651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3951ca-4ca4-4038-8a43-e5b76b89b406 admin admin] PATH_INFO: `/v3/projects/e982a9a7feab43eea8fc359ff8dc3200/users/f7a3373aa4ef430299336fc1979b8b9a/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:57.921719 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3951ca-4ca4-4038-8a43-e5b76b89b406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e982a9a7feab43eea8fc359ff8dc3200, user_id=f7a3373aa4ef430299336fc1979b8b9a, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:57.924470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3951ca-4ca4-4038-8a43-e5b76b89b406 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:57.938855 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1090/2201] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:57 2022] PUT /identity/v3/projects/e982a9a7feab43eea8fc359ff8dc3200/users/f7a3373aa4ef430299336fc1979b8b9a/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:57.949803 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fdec3-d232-4a5d-a851-65eaf12a2866 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:57.950087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fdec3-d232-4a5d-a851-65eaf12a2866 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:57.950359 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685fdec3-d232-4a5d-a851-65eaf12a2866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:58.027455 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-685fdec3-d232-4a5d-a851-65eaf12a2866 None None] MFA Rules not processed for user `f7a3373aa4ef430299336fc1979b8b9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:58.030456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-685fdec3-d232-4a5d-a851-65eaf12a2866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:58.144760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3951ca-4ca4-4038-8a43-e5b76b89b406 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:58.146489 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1d3951ca-4ca4-4038-8a43-e5b76b89b406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:58.181126 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1112/2202] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:58.206793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fdec3-d232-4a5d-a851-65eaf12a2866 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:58.223056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-685fdec3-d232-4a5d-a851-65eaf12a2866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:58.266047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:58.307176 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3951ca-4ca4-4038-8a43-e5b76b89b406 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:58.312867 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4655e-0ff6-4e06-a48e-c7ead8712687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:58.313534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4655e-0ff6-4e06-a48e-c7ead8712687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:58.313737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4655e-0ff6-4e06-a48e-c7ead8712687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:58.314013 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4655e-0ff6-4e06-a48e-c7ead8712687 admin admin] PATH_INFO: `/v3/projects/bd3de4b64fb54f69849290ef6f46f66e` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:58.315843 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4655e-0ff6-4e06-a48e-c7ead8712687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd3de4b64fb54f69849290ef6f46f66e)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:58.317938 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4655e-0ff6-4e06-a48e-c7ead8712687 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:58.383769 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cbb4655e-0ff6-4e06-a48e-c7ead8712687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd3de4b64fb54f69849290ef6f46f66e', 'request_id': 'req-cbb4655e-0ff6-4e06-a48e-c7ead8712687'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:58.392452 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685fdec3-d232-4a5d-a851-65eaf12a2866 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:58.395058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cbb4655e-0ff6-4e06-a48e-c7ead8712687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd3de4b64fb54f69849290ef6f46f66e', 'request_id': 'req-cbb4655e-0ff6-4e06-a48e-c7ead8712687'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:58.413380 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cbb4655e-0ff6-4e06-a48e-c7ead8712687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd3de4b64fb54f69849290ef6f46f66e', 'request_id': 'req-cbb4655e-0ff6-4e06-a48e-c7ead8712687'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:58.442885 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cbb4655e-0ff6-4e06-a48e-c7ead8712687 admin admin] The token cache is being invalidate because project bd3de4b64fb54f69849290ef6f46f66e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:57:58.443544 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cbb4655e-0ff6-4e06-a48e-c7ead8712687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:58.444611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cbb4655e-0ff6-4e06-a48e-c7ead8712687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:57:58.446449 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1091/2203] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:57:58 2022] DELETE /identity/v3/projects/bd3de4b64fb54f69849290ef6f46f66e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:58.455338 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545fb12-72e8-4b8b-8bf3-9a4f521da7e4 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:58.455925 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545fb12-72e8-4b8b-8bf3-9a4f521da7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:58.456693 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545fb12-72e8-4b8b-8bf3-9a4f521da7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:58.483795 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7545fb12-72e8-4b8b-8bf3-9a4f521da7e4 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:58.486568 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b6600-dc8c-4120-bb1b-3ddb47f59ad3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:58.488096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b6600-dc8c-4120-bb1b-3ddb47f59ad3 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:58.488377 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b6600-dc8c-4120-bb1b-3ddb47f59ad3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:58.488741 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b6600-dc8c-4120-bb1b-3ddb47f59ad3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:58.488948 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7545fb12-72e8-4b8b-8bf3-9a4f521da7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:58.490568 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3b0b6600-dc8c-4120-bb1b-3ddb47f59ad3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:58.512618 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:58.606069 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b6600-dc8c-4120-bb1b-3ddb47f59ad3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:58.607698 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b6600-dc8c-4120-bb1b-3ddb47f59ad3 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:58.608518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1092/2204] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:58.619030 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619d940-ee52-47c0-bfd0-2cb0e710910d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:58.619183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619d940-ee52-47c0-bfd0-2cb0e710910d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:58.619347 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619d940-ee52-47c0-bfd0-2cb0e710910d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:58.621424 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1113/2205] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:57:58.644122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6619d940-ee52-47c0-bfd0-2cb0e710910d None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:58.645484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6619d940-ee52-47c0-bfd0-2cb0e710910d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:58.656390 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1093/2206] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:58.661439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b6600-dc8c-4120-bb1b-3ddb47f59ad3 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:58.672461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b6600-dc8c-4120-bb1b-3ddb47f59ad3 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:58.678173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c0c89-dc56-4d1f-8204-47f0f86eaf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:58.678779 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c0c89-dc56-4d1f-8204-47f0f86eaf71 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:58.679052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c0c89-dc56-4d1f-8204-47f0f86eaf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:58.679329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c0c89-dc56-4d1f-8204-47f0f86eaf71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:58.679974 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c0c89-dc56-4d1f-8204-47f0f86eaf71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:57:58.680285 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c0c89-dc56-4d1f-8204-47f0f86eaf71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:58.681885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c0c89-dc56-4d1f-8204-47f0f86eaf71 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:58.697239 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1114/2207] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 20:57:58.698244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619d940-ee52-47c0-bfd0-2cb0e710910d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:58.704541 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c0c89-dc56-4d1f-8204-47f0f86eaf71 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:58.706933 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8f3c0c89-dc56-4d1f-8204-47f0f86eaf71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:58.707629 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619d940-ee52-47c0-bfd0-2cb0e710910d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:58.712304 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281f7fe-8e9c-45e5-9f74-f7edf8a546c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:58.712907 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281f7fe-8e9c-45e5-9f74-f7edf8a546c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:58.713183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281f7fe-8e9c-45e5-9f74-f7edf8a546c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:58.713453 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281f7fe-8e9c-45e5-9f74-f7edf8a546c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:58.714112 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281f7fe-8e9c-45e5-9f74-f7edf8a546c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:58.716161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281f7fe-8e9c-45e5-9f74-f7edf8a546c9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:58.719336 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c0c89-dc56-4d1f-8204-47f0f86eaf71 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:58.723623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd914340-3e49-419a-b58c-2ad7a185b9ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:58.724260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd914340-3e49-419a-b58c-2ad7a185b9ac service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:58.724545 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd914340-3e49-419a-b58c-2ad7a185b9ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:58.724871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd914340-3e49-419a-b58c-2ad7a185b9ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:58.726616 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bd914340-3e49-419a-b58c-2ad7a185b9ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:58.747187 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1094/2208] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:57:58 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:57:58.751638 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281f7fe-8e9c-45e5-9f74-f7edf8a546c9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:58.798779 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd914340-3e49-419a-b58c-2ad7a185b9ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:58.800379 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd914340-3e49-419a-b58c-2ad7a185b9ac service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:58.810700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1115/2209] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 20:57:58.834239 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281f7fe-8e9c-45e5-9f74-f7edf8a546c9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:58.840967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b019dae-2250-4551-8f80-48f96120c2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:58.841451 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b019dae-2250-4551-8f80-48f96120c2dd admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:58.841733 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b019dae-2250-4551-8f80-48f96120c2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:58.842009 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b019dae-2250-4551-8f80-48f96120c2dd admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:58.842650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b019dae-2250-4551-8f80-48f96120c2dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:58.844879 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b019dae-2250-4551-8f80-48f96120c2dd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:58.871214 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1095/2210] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:57:58 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:57:58.876707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd914340-3e49-419a-b58c-2ad7a185b9ac service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:58.883267 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:57:58.890083 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd914340-3e49-419a-b58c-2ad7a185b9ac service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:58.897163 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708d78d-83f6-495d-a060-b5087dd09e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:58.897920 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708d78d-83f6-495d-a060-b5087dd09e66 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:58.898295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708d78d-83f6-495d-a060-b5087dd09e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:58.899073 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708d78d-83f6-495d-a060-b5087dd09e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:58.900633 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708d78d-83f6-495d-a060-b5087dd09e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:58.903438 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708d78d-83f6-495d-a060-b5087dd09e66 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:58.918806 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1116/2211] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:58.920247 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b019dae-2250-4551-8f80-48f96120c2dd admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:58.936300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b019dae-2250-4551-8f80-48f96120c2dd admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:58.942861 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68060e-57fe-4f56-a095-85a45bdba0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:58.943639 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68060e-57fe-4f56-a095-85a45bdba0ca admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:58.943966 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68060e-57fe-4f56-a095-85a45bdba0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:58.944429 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68060e-57fe-4f56-a095-85a45bdba0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:58.945152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68060e-57fe-4f56-a095-85a45bdba0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:58.946708 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68060e-57fe-4f56-a095-85a45bdba0ca admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:58.958706 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1096/2212] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:57:58.962976 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708d78d-83f6-495d-a060-b5087dd09e66 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:58.975107 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708d78d-83f6-495d-a060-b5087dd09e66 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:58.980154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe5044-a5fd-44ca-aae5-9b92e1a6178d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:58.980874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe5044-a5fd-44ca-aae5-9b92e1a6178d admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:58.981188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe5044-a5fd-44ca-aae5-9b92e1a6178d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:58.981522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe5044-a5fd-44ca-aae5-9b92e1a6178d admin admin] PATH_INFO: `/v3/projects/7d9f9f72588c4d52ba9559ff8588e9d9/users/1912f7d1406043ba9993019e39297388/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:58.997761 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe5044-a5fd-44ca-aae5-9b92e1a6178d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9f9f72588c4d52ba9559ff8588e9d9, user_id=1912f7d1406043ba9993019e39297388, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:59.000577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe5044-a5fd-44ca-aae5-9b92e1a6178d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:59.014658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1117/2213] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:57:58 2022] PUT /identity/v3/projects/7d9f9f72588c4d52ba9559ff8588e9d9/users/1912f7d1406043ba9993019e39297388/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:57:59.020618 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44444e8-4dcd-48e0-8cc3-4f3897339387 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:59.020907 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44444e8-4dcd-48e0-8cc3-4f3897339387 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:59.021181 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44444e8-4dcd-48e0-8cc3-4f3897339387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:59.042240 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c44444e8-4dcd-48e0-8cc3-4f3897339387 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:57:59.043465 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c44444e8-4dcd-48e0-8cc3-4f3897339387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:59.135072 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1097/2214] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:57:59.164268 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe5044-a5fd-44ca-aae5-9b92e1a6178d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:57:59.166100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bbfe5044-a5fd-44ca-aae5-9b92e1a6178d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:57:59.246216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe5044-a5fd-44ca-aae5-9b92e1a6178d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:57:59.251188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b813f7-7634-486e-917a-6f79d250577a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:57:59.253339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b813f7-7634-486e-917a-6f79d250577a service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:57:59.254048 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b813f7-7634-486e-917a-6f79d250577a service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:57:59.254600 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b813f7-7634-486e-917a-6f79d250577a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:57:59.266046 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b813f7-7634-486e-917a-6f79d250577a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:57:59.267609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b813f7-7634-486e-917a-6f79d250577a service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:57:59.279933 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1118/2215] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:57:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:58:00.517302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8ef35-f29e-46c9-aedf-8c55d8368606 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:00.517737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8ef35-f29e-46c9-aedf-8c55d8368606 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:00.519161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8ef35-f29e-46c9-aedf-8c55d8368606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:00.543742 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:00.586816 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fef8ef35-f29e-46c9-aedf-8c55d8368606 None None] MFA Rules not processed for user `1912f7d1406043ba9993019e39297388`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:00.589246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fef8ef35-f29e-46c9-aedf-8c55d8368606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:00.760616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1098/2216] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:00.774816 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b813f7-7634-486e-917a-6f79d250577a service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:00.777960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-10b813f7-7634-486e-917a-6f79d250577a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:00.893788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b813f7-7634-486e-917a-6f79d250577a service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:00.898047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4828bd3-7d1f-4741-8b8d-be9a723245ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:00.898717 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4828bd3-7d1f-4741-8b8d-be9a723245ba service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:00.899117 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4828bd3-7d1f-4741-8b8d-be9a723245ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:00.899397 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4828bd3-7d1f-4741-8b8d-be9a723245ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:00.909673 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4828bd3-7d1f-4741-8b8d-be9a723245ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:00.917173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4828bd3-7d1f-4741-8b8d-be9a723245ba service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:00.928450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1119/2217] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:58:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:58:02.410977 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8133e-1b22-4de4-92ca-37cded149406 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:02.411541 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8133e-1b22-4de4-92ca-37cded149406 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:02.411630 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8133e-1b22-4de4-92ca-37cded149406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:02.466242 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a7e8133e-1b22-4de4-92ca-37cded149406 None None] MFA Rules not processed for user `1912f7d1406043ba9993019e39297388`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:02.467643 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a7e8133e-1b22-4de4-92ca-37cded149406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:02.480950 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1099/2218] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:05.565671 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4828bd3-7d1f-4741-8b8d-be9a723245ba service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:05.567751 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d4828bd3-7d1f-4741-8b8d-be9a723245ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:05.635044 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4828bd3-7d1f-4741-8b8d-be9a723245ba service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:05.650024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd89ac6-8804-49c8-a9f3-b84970b84daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:05.650676 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd89ac6-8804-49c8-a9f3-b84970b84daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:05.650956 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd89ac6-8804-49c8-a9f3-b84970b84daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:05.651227 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd89ac6-8804-49c8-a9f3-b84970b84daf admin admin] PATH_INFO: `/v3/users/e1092082fe92429a96009dd73aa74287` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:05.654064 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd89ac6-8804-49c8-a9f3-b84970b84daf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1092082fe92429a96009dd73aa74287)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:05.656037 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd89ac6-8804-49c8-a9f3-b84970b84daf admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:05.740321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dfd89ac6-8804-49c8-a9f3-b84970b84daf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1092082fe92429a96009dd73aa74287'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:05.740587 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dfd89ac6-8804-49c8-a9f3-b84970b84daf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1092082fe92429a96009dd73aa74287'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:05.751305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:05.754136 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dfd89ac6-8804-49c8-a9f3-b84970b84daf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1092082fe92429a96009dd73aa74287'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:05.755074 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dfd89ac6-8804-49c8-a9f3-b84970b84daf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1092082fe92429a96009dd73aa74287'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:05.756333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dfd89ac6-8804-49c8-a9f3-b84970b84daf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1092082fe92429a96009dd73aa74287'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:05.780787 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1120/2219] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:58:05 2022] DELETE /identity/v3/users/e1092082fe92429a96009dd73aa74287 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:05.785606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8ec75-a491-4d7a-9ad2-cf068b5280df None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:05.786603 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8ec75-a491-4d7a-9ad2-cf068b5280df None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:05.787008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8ec75-a491-4d7a-9ad2-cf068b5280df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:05.825482 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5fd8ec75-a491-4d7a-9ad2-cf068b5280df None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:05.827452 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5fd8ec75-a491-4d7a-9ad2-cf068b5280df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:05.945896 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1100/2220] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:05.956449 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd89ac6-8804-49c8-a9f3-b84970b84daf admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:05.958158 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dfd89ac6-8804-49c8-a9f3-b84970b84daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:06.036266 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd89ac6-8804-49c8-a9f3-b84970b84daf admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:06.041641 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2a372-be49-4a8a-8199-927396b32763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:06.042674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2a372-be49-4a8a-8199-927396b32763 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:06.043191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2a372-be49-4a8a-8199-927396b32763 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:06.043808 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2a372-be49-4a8a-8199-927396b32763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:06.057913 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2a372-be49-4a8a-8199-927396b32763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:06.059765 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2a372-be49-4a8a-8199-927396b32763 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:06.073030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1121/2221] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:58:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:58:06.472787 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8ec75-a491-4d7a-9ad2-cf068b5280df None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:06.474270 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5fd8ec75-a491-4d7a-9ad2-cf068b5280df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:06.486454 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8ec75-a491-4d7a-9ad2-cf068b5280df None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:06.491354 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927221a-9474-475d-a1a0-064595e20b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:06.492016 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927221a-9474-475d-a1a0-064595e20b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:06.492306 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927221a-9474-475d-a1a0-064595e20b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:06.492579 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927221a-9474-475d-a1a0-064595e20b88 admin admin] PATH_INFO: `/v3/projects/714d1c784dd147a4ac9cc8a645cd3e5b` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:06.493762 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927221a-9474-475d-a1a0-064595e20b88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=714d1c784dd147a4ac9cc8a645cd3e5b)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:06.495760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927221a-9474-475d-a1a0-064595e20b88 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:06.544119 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3927221a-9474-475d-a1a0-064595e20b88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '714d1c784dd147a4ac9cc8a645cd3e5b', 'request_id': 'req-3927221a-9474-475d-a1a0-064595e20b88'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:06.551889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3927221a-9474-475d-a1a0-064595e20b88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '714d1c784dd147a4ac9cc8a645cd3e5b', 'request_id': 'req-3927221a-9474-475d-a1a0-064595e20b88'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:06.557615 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3927221a-9474-475d-a1a0-064595e20b88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '714d1c784dd147a4ac9cc8a645cd3e5b', 'request_id': 'req-3927221a-9474-475d-a1a0-064595e20b88'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:06.569173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3927221a-9474-475d-a1a0-064595e20b88 admin admin] The token cache is being invalidate because project 714d1c784dd147a4ac9cc8a645cd3e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:58:06.569466 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3927221a-9474-475d-a1a0-064595e20b88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:06.570101 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-3927221a-9474-475d-a1a0-064595e20b88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:06.571613 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1101/2222] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:58:06 2022] DELETE /identity/v3/projects/714d1c784dd147a4ac9cc8a645cd3e5b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:06.575527 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2a372-be49-4a8a-8199-927396b32763 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:06.585251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2a372-be49-4a8a-8199-927396b32763 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:06.642001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd47ef-09d8-47b6-bb23-c1e8c034e39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:06.642637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd47ef-09d8-47b6-bb23-c1e8c034e39c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:06.642958 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd47ef-09d8-47b6-bb23-c1e8c034e39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:06.643235 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd47ef-09d8-47b6-bb23-c1e8c034e39c admin admin] PATH_INFO: `/v3/users/f7a3373aa4ef430299336fc1979b8b9a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:06.644391 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd47ef-09d8-47b6-bb23-c1e8c034e39c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7a3373aa4ef430299336fc1979b8b9a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:06.646366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd47ef-09d8-47b6-bb23-c1e8c034e39c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:06.694267 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-57dd47ef-09d8-47b6-bb23-c1e8c034e39c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7a3373aa4ef430299336fc1979b8b9a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:06.701836 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-57dd47ef-09d8-47b6-bb23-c1e8c034e39c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7a3373aa4ef430299336fc1979b8b9a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:06.716472 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-57dd47ef-09d8-47b6-bb23-c1e8c034e39c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7a3373aa4ef430299336fc1979b8b9a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:06.717207 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-57dd47ef-09d8-47b6-bb23-c1e8c034e39c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7a3373aa4ef430299336fc1979b8b9a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:06.717805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-57dd47ef-09d8-47b6-bb23-c1e8c034e39c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7a3373aa4ef430299336fc1979b8b9a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:06.730316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1122/2223] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:58:06 2022] DELETE /identity/v3/users/f7a3373aa4ef430299336fc1979b8b9a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:07.041218 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927221a-9474-475d-a1a0-064595e20b88 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:07.042708 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3927221a-9474-475d-a1a0-064595e20b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:07.058523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927221a-9474-475d-a1a0-064595e20b88 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:07.070948 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:07.127723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020cc2a-31f6-4520-b45d-219b016cfaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:07.128550 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020cc2a-31f6-4520-b45d-219b016cfaad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:07.128829 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020cc2a-31f6-4520-b45d-219b016cfaad admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:07.129105 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020cc2a-31f6-4520-b45d-219b016cfaad admin admin] PATH_INFO: `/v3/projects/e982a9a7feab43eea8fc359ff8dc3200` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:07.130252 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020cc2a-31f6-4520-b45d-219b016cfaad admin admin] RBAC: Authorizing `identity:delete_project(project_id=e982a9a7feab43eea8fc359ff8dc3200)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:07.132205 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020cc2a-31f6-4520-b45d-219b016cfaad admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:07.190579 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8020cc2a-31f6-4520-b45d-219b016cfaad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e982a9a7feab43eea8fc359ff8dc3200', 'request_id': 'req-8020cc2a-31f6-4520-b45d-219b016cfaad'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:07.200649 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8020cc2a-31f6-4520-b45d-219b016cfaad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e982a9a7feab43eea8fc359ff8dc3200', 'request_id': 'req-8020cc2a-31f6-4520-b45d-219b016cfaad'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:07.215160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8020cc2a-31f6-4520-b45d-219b016cfaad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e982a9a7feab43eea8fc359ff8dc3200', 'request_id': 'req-8020cc2a-31f6-4520-b45d-219b016cfaad'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:07.229263 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8020cc2a-31f6-4520-b45d-219b016cfaad admin admin] The token cache is being invalidate because project e982a9a7feab43eea8fc359ff8dc3200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:58:07.229555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8020cc2a-31f6-4520-b45d-219b016cfaad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:07.230243 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-8020cc2a-31f6-4520-b45d-219b016cfaad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:07.231730 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1102/2224] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:58:07 2022] DELETE /identity/v3/projects/e982a9a7feab43eea8fc359ff8dc3200 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:07.238593 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e814efb-422f-4a45-a2b9-5e82e45a312f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:07.238878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e814efb-422f-4a45-a2b9-5e82e45a312f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:07.239161 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e814efb-422f-4a45-a2b9-5e82e45a312f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:07.253705 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:07.260281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0e814efb-422f-4a45-a2b9-5e82e45a312f None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:07.263111 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0e814efb-422f-4a45-a2b9-5e82e45a312f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:07.344863 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1123/2225] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:07.345059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f4e94-48e9-4cf9-9a26-01f809a669ab None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:07.345345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f4e94-48e9-4cf9-9a26-01f809a669ab None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:07.345613 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f4e94-48e9-4cf9-9a26-01f809a669ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:07.367929 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6b6f4e94-48e9-4cf9-9a26-01f809a669ab None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:07.369349 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6b6f4e94-48e9-4cf9-9a26-01f809a669ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:07.378908 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1103/2226] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:58:07.387692 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e814efb-422f-4a45-a2b9-5e82e45a312f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:07.394599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e814efb-422f-4a45-a2b9-5e82e45a312f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:07.399559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a050cd3-4019-45d8-9b55-a1160737fb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:07.400206 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a050cd3-4019-45d8-9b55-a1160737fb32 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:07.400507 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a050cd3-4019-45d8-9b55-a1160737fb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:07.400781 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a050cd3-4019-45d8-9b55-a1160737fb32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:07.401432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a050cd3-4019-45d8-9b55-a1160737fb32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:58:07.401774 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a050cd3-4019-45d8-9b55-a1160737fb32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:07.403380 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a050cd3-4019-45d8-9b55-a1160737fb32 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:07.417002 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1124/2227] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:58:07.421257 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f4e94-48e9-4cf9-9a26-01f809a669ab None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:07.431582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f4e94-48e9-4cf9-9a26-01f809a669ab None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:07.436317 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2152dc0-3936-46fe-be2f-e3d90c4b82f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:07.436928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2152dc0-3936-46fe-be2f-e3d90c4b82f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:07.437206 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2152dc0-3936-46fe-be2f-e3d90c4b82f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:07.437478 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2152dc0-3936-46fe-be2f-e3d90c4b82f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:07.438123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2152dc0-3936-46fe-be2f-e3d90c4b82f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:07.440827 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2152dc0-3936-46fe-be2f-e3d90c4b82f9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:07.473622 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1104/2228] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:58:07 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:58:07.477568 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a050cd3-4019-45d8-9b55-a1160737fb32 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:07.488597 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a050cd3-4019-45d8-9b55-a1160737fb32 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:07.544030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf0783-df64-4758-aaf9-6e254065fd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:07.544642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf0783-df64-4758-aaf9-6e254065fd1c admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:07.544923 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf0783-df64-4758-aaf9-6e254065fd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:07.545196 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf0783-df64-4758-aaf9-6e254065fd1c admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:07.545839 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf0783-df64-4758-aaf9-6e254065fd1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:07.547763 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf0783-df64-4758-aaf9-6e254065fd1c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:07.570379 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1125/2229] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:58:07 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:58:07.574518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2152dc0-3936-46fe-be2f-e3d90c4b82f9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:07.584787 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2152dc0-3936-46fe-be2f-e3d90c4b82f9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:07.590235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0071f-6c51-4788-ae4d-d4fdde31317b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:07.590863 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0071f-6c51-4788-ae4d-d4fdde31317b admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:07.591199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0071f-6c51-4788-ae4d-d4fdde31317b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:07.591833 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0071f-6c51-4788-ae4d-d4fdde31317b admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:07.592718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0071f-6c51-4788-ae4d-d4fdde31317b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:07.594252 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0071f-6c51-4788-ae4d-d4fdde31317b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:07.618708 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1105/2230] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:58:07.620046 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf0783-df64-4758-aaf9-6e254065fd1c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:07.632312 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf0783-df64-4758-aaf9-6e254065fd1c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:07.638910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400381f9-a0f3-40bd-8065-bcaaf97ff9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:07.639549 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400381f9-a0f3-40bd-8065-bcaaf97ff9a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:07.639824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400381f9-a0f3-40bd-8065-bcaaf97ff9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:07.640126 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400381f9-a0f3-40bd-8065-bcaaf97ff9a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:07.640765 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400381f9-a0f3-40bd-8065-bcaaf97ff9a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:07.642360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400381f9-a0f3-40bd-8065-bcaaf97ff9a5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:07.653613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1126/2231] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:58:07.657756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0071f-6c51-4788-ae4d-d4fdde31317b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:07.668639 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0071f-6c51-4788-ae4d-d4fdde31317b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:07.673352 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b5bb5-5d8e-4449-96e8-cea4798af294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:07.673990 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b5bb5-5d8e-4449-96e8-cea4798af294 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:07.674865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b5bb5-5d8e-4449-96e8-cea4798af294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:07.675138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b5bb5-5d8e-4449-96e8-cea4798af294 admin admin] PATH_INFO: `/v3/projects/39e5bca59869429697d063e94af04e64/users/8f101caed9f74714bc9cf612a6dcc7ee/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:07.689728 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b5bb5-5d8e-4449-96e8-cea4798af294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e5bca59869429697d063e94af04e64, user_id=8f101caed9f74714bc9cf612a6dcc7ee, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:07.692559 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b5bb5-5d8e-4449-96e8-cea4798af294 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:07.709762 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1106/2232] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:58:07 2022] PUT /identity/v3/projects/39e5bca59869429697d063e94af04e64/users/8f101caed9f74714bc9cf612a6dcc7ee/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:07.719950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d07a97-b833-4b4d-81e9-a9ca0e14df3a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:07.720264 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d07a97-b833-4b4d-81e9-a9ca0e14df3a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:07.720534 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d07a97-b833-4b4d-81e9-a9ca0e14df3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:07.750972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f6d07a97-b833-4b4d-81e9-a9ca0e14df3a None None] MFA Rules not processed for user `8f101caed9f74714bc9cf612a6dcc7ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:07.752468 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f6d07a97-b833-4b4d-81e9-a9ca0e14df3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:07.818719 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1127/2233] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:07.823227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b5bb5-5d8e-4449-96e8-cea4798af294 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:07.868781 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:07.908144 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b5bb5-5d8e-4449-96e8-cea4798af294 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:07.914428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af321708-8981-4219-859d-d342e91a2113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:07.915122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af321708-8981-4219-859d-d342e91a2113 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:07.915472 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af321708-8981-4219-859d-d342e91a2113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:07.916356 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af321708-8981-4219-859d-d342e91a2113 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:07.916584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af321708-8981-4219-859d-d342e91a2113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:07.918979 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af321708-8981-4219-859d-d342e91a2113 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:07.952165 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1107/2234] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:58:07 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:58:07.955839 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d07a97-b833-4b4d-81e9-a9ca0e14df3a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:07.970690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:07.976127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d07a97-b833-4b4d-81e9-a9ca0e14df3a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:08.035256 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2a1ac-7af3-4e12-82a4-22a5049b0047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:08.035877 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2a1ac-7af3-4e12-82a4-22a5049b0047 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:08.036185 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2a1ac-7af3-4e12-82a4-22a5049b0047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:08.036459 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2a1ac-7af3-4e12-82a4-22a5049b0047 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:08.037095 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2a1ac-7af3-4e12-82a4-22a5049b0047 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:08.039031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2a1ac-7af3-4e12-82a4-22a5049b0047 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:08.063395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1128/2235] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:58:07 2022] POST /identity/v3/users => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:58:08.064892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af321708-8981-4219-859d-d342e91a2113 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:08.075156 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af321708-8981-4219-859d-d342e91a2113 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:08.079961 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8741479-6416-4ffd-ab7a-c41a21c09184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:08.081146 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8741479-6416-4ffd-ab7a-c41a21c09184 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:08.081424 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8741479-6416-4ffd-ab7a-c41a21c09184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:08.081698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8741479-6416-4ffd-ab7a-c41a21c09184 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:08.082342 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8741479-6416-4ffd-ab7a-c41a21c09184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:08.083951 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8741479-6416-4ffd-ab7a-c41a21c09184 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:08.095482 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1108/2236] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:58:08.100981 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2a1ac-7af3-4e12-82a4-22a5049b0047 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:08.111385 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2a1ac-7af3-4e12-82a4-22a5049b0047 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:08.116417 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb1422-ee3e-4be9-9496-cc04a6982caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:08.117086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb1422-ee3e-4be9-9496-cc04a6982caf admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:08.117369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb1422-ee3e-4be9-9496-cc04a6982caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:08.117645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb1422-ee3e-4be9-9496-cc04a6982caf admin admin] PATH_INFO: `/v3/projects/a5ce736ff9fc4fe3afcdffb38796c293/users/301d1f94e9364ad1a5e6a12e44b2306a/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:08.135135 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb1422-ee3e-4be9-9496-cc04a6982caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ce736ff9fc4fe3afcdffb38796c293, user_id=301d1f94e9364ad1a5e6a12e44b2306a, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:08.137870 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb1422-ee3e-4be9-9496-cc04a6982caf admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:08.156444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1129/2237] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:58:08 2022] PUT /identity/v3/projects/a5ce736ff9fc4fe3afcdffb38796c293/users/301d1f94e9364ad1a5e6a12e44b2306a/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:08.157833 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8741479-6416-4ffd-ab7a-c41a21c09184 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:08.170382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8741479-6416-4ffd-ab7a-c41a21c09184 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:08.291900 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e81f0-1586-405d-8e86-c5fe1a892ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:08.292773 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e81f0-1586-405d-8e86-c5fe1a892ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:08.293241 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e81f0-1586-405d-8e86-c5fe1a892ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:08.293664 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e81f0-1586-405d-8e86-c5fe1a892ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:08.294467 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e81f0-1586-405d-8e86-c5fe1a892ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:08.296262 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e81f0-1586-405d-8e86-c5fe1a892ae1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:08.322854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1109/2238] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:58:08.323753 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb1422-ee3e-4be9-9496-cc04a6982caf admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:08.335757 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb1422-ee3e-4be9-9496-cc04a6982caf admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:08.341898 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1441b-7750-41b6-a03e-b99e7247e461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:08.342067 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1441b-7750-41b6-a03e-b99e7247e461 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:08.342535 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1441b-7750-41b6-a03e-b99e7247e461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:08.342645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1441b-7750-41b6-a03e-b99e7247e461 admin admin] PATH_INFO: `/v3/projects/a5ce736ff9fc4fe3afcdffb38796c293/users/301d1f94e9364ad1a5e6a12e44b2306a/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:08.345300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1441b-7750-41b6-a03e-b99e7247e461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ce736ff9fc4fe3afcdffb38796c293, user_id=301d1f94e9364ad1a5e6a12e44b2306a, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:08.349277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1441b-7750-41b6-a03e-b99e7247e461 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:08.360958 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1130/2239] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:58:08 2022] PUT /identity/v3/projects/a5ce736ff9fc4fe3afcdffb38796c293/users/301d1f94e9364ad1a5e6a12e44b2306a/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:08.372744 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa03f5-36af-4c8e-a0fd-0da5ebf78453 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:08.373030 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa03f5-36af-4c8e-a0fd-0da5ebf78453 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:08.373308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efa03f5-36af-4c8e-a0fd-0da5ebf78453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:08.411068 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-8efa03f5-36af-4c8e-a0fd-0da5ebf78453 None None] MFA Rules not processed for user `301d1f94e9364ad1a5e6a12e44b2306a`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:08.412144 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8efa03f5-36af-4c8e-a0fd-0da5ebf78453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:08.608508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1110/2240] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:08.622613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1441b-7750-41b6-a03e-b99e7247e461 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:08.625306 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-98a1441b-7750-41b6-a03e-b99e7247e461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:08.716502 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1441b-7750-41b6-a03e-b99e7247e461 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:08.725823 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af4922-509f-4fd0-87e6-71508897468e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:08.726462 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af4922-509f-4fd0-87e6-71508897468e service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:08.726742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af4922-509f-4fd0-87e6-71508897468e service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:08.727014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af4922-509f-4fd0-87e6-71508897468e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:08.744600 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af4922-509f-4fd0-87e6-71508897468e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:08.746114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af4922-509f-4fd0-87e6-71508897468e service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:08.770581 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1131/2241] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:58:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:58:08.862610 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa03f5-36af-4c8e-a0fd-0da5ebf78453 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:08.875388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efa03f5-36af-4c8e-a0fd-0da5ebf78453 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:08.882312 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011616e-5c00-4c4c-8369-4cf18fb35fa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:08.882743 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011616e-5c00-4c4c-8369-4cf18fb35fa2 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:08.883068 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011616e-5c00-4c4c-8369-4cf18fb35fa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:08.883326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011616e-5c00-4c4c-8369-4cf18fb35fa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:08.924525 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:08.955148 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011616e-5c00-4c4c-8369-4cf18fb35fa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:08.957508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011616e-5c00-4c4c-8369-4cf18fb35fa2 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:08.967434 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1111/2242] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:58:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:58:09.308852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af4922-509f-4fd0-87e6-71508897468e service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:09.376258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:09.382690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af4922-509f-4fd0-87e6-71508897468e service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:09.388193 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7124c-8143-46e4-84d8-08e810692dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:09.389024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7124c-8143-46e4-84d8-08e810692dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:09.389313 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7124c-8143-46e4-84d8-08e810692dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:09.389591 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7124c-8143-46e4-84d8-08e810692dc0 admin admin] PATH_INFO: `/v3/users/8f101caed9f74714bc9cf612a6dcc7ee` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:09.391454 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7124c-8143-46e4-84d8-08e810692dc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f101caed9f74714bc9cf612a6dcc7ee)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:09.394436 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7124c-8143-46e4-84d8-08e810692dc0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:09.459929 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-14a7124c-8143-46e4-84d8-08e810692dc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f101caed9f74714bc9cf612a6dcc7ee'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:09.469898 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-14a7124c-8143-46e4-84d8-08e810692dc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f101caed9f74714bc9cf612a6dcc7ee'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:09.486289 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-14a7124c-8143-46e4-84d8-08e810692dc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f101caed9f74714bc9cf612a6dcc7ee'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:09.489488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-14a7124c-8143-46e4-84d8-08e810692dc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f101caed9f74714bc9cf612a6dcc7ee'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:09.490757 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-14a7124c-8143-46e4-84d8-08e810692dc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f101caed9f74714bc9cf612a6dcc7ee'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:09.510058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1132/2243] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:58:09 2022] DELETE /identity/v3/users/8f101caed9f74714bc9cf612a6dcc7ee => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:09.522607 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157de88-73ca-479b-b971-35f1369186e0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:09.523934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157de88-73ca-479b-b971-35f1369186e0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:09.524534 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157de88-73ca-479b-b971-35f1369186e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:09.547359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d157de88-73ca-479b-b971-35f1369186e0 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:09.548607 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d157de88-73ca-479b-b971-35f1369186e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:09.622064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1112/2244] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:09.641261 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7124c-8143-46e4-84d8-08e810692dc0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:09.643385 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-14a7124c-8143-46e4-84d8-08e810692dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:09.718100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7124c-8143-46e4-84d8-08e810692dc0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:09.722781 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c3ba4-2ba5-42af-bb6a-a5557a369ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:09.723469 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c3ba4-2ba5-42af-bb6a-a5557a369ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:09.723828 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c3ba4-2ba5-42af-bb6a-a5557a369ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:09.724025 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c3ba4-2ba5-42af-bb6a-a5557a369ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:09.733393 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c3ba4-2ba5-42af-bb6a-a5557a369ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:09.734844 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c3ba4-2ba5-42af-bb6a-a5557a369ff2 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:09.745349 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1133/2245] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:58:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 20:58:09.758313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157de88-73ca-479b-b971-35f1369186e0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:09.759725 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d157de88-73ca-479b-b971-35f1369186e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:09.782815 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157de88-73ca-479b-b971-35f1369186e0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:09.787701 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ec7ed-8722-4642-9091-2e62779afb5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:09.788607 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ec7ed-8722-4642-9091-2e62779afb5a service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:09.789020 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ec7ed-8722-4642-9091-2e62779afb5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:09.789382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ec7ed-8722-4642-9091-2e62779afb5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:09.791727 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ed3ec7ed-8722-4642-9091-2e62779afb5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:09.902851 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ec7ed-8722-4642-9091-2e62779afb5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:09.904614 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ec7ed-8722-4642-9091-2e62779afb5a service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:09.917791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1113/2246] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:58:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:58:10.634729 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9381109-47bd-414f-bf16-68c79a5e0202 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:10.635008 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9381109-47bd-414f-bf16-68c79a5e0202 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:10.635450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9381109-47bd-414f-bf16-68c79a5e0202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:10.676747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b9381109-47bd-414f-bf16-68c79a5e0202 None None] MFA Rules not processed for user `e51ae6959aac49898e75c6786c5dbdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:10.679300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b9381109-47bd-414f-bf16-68c79a5e0202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:10.804588 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ec7ed-8722-4642-9091-2e62779afb5a service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:10.806039 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ed3ec7ed-8722-4642-9091-2e62779afb5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:10.826851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1134/2247] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Sep 9 20:58:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:10.838517 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ec7ed-8722-4642-9091-2e62779afb5a service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:10.851219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9381109-47bd-414f-bf16-68c79a5e0202 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:10.853755 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b9381109-47bd-414f-bf16-68c79a5e0202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:10.857053 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf480f-0b97-43e9-8e27-7d89c84063db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:10.857795 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf480f-0b97-43e9-8e27-7d89c84063db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:10.858145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf480f-0b97-43e9-8e27-7d89c84063db admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:10.858647 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf480f-0b97-43e9-8e27-7d89c84063db admin admin] PATH_INFO: `/v3/projects/39e5bca59869429697d063e94af04e64` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:10.861686 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf480f-0b97-43e9-8e27-7d89c84063db admin admin] RBAC: Authorizing `identity:delete_project(project_id=39e5bca59869429697d063e94af04e64)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:10.863721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf480f-0b97-43e9-8e27-7d89c84063db admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:10.912350 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:10.999576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e9bf480f-0b97-43e9-8e27-7d89c84063db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39e5bca59869429697d063e94af04e64', 'request_id': 'req-e9bf480f-0b97-43e9-8e27-7d89c84063db'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:11.013714 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e9bf480f-0b97-43e9-8e27-7d89c84063db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39e5bca59869429697d063e94af04e64', 'request_id': 'req-e9bf480f-0b97-43e9-8e27-7d89c84063db'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:11.015474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9381109-47bd-414f-bf16-68c79a5e0202 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:11.024845 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:11.026315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e9bf480f-0b97-43e9-8e27-7d89c84063db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39e5bca59869429697d063e94af04e64', 'request_id': 'req-e9bf480f-0b97-43e9-8e27-7d89c84063db'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:11.053862 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e9bf480f-0b97-43e9-8e27-7d89c84063db admin admin] The token cache is being invalidate because project 39e5bca59869429697d063e94af04e64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:58:11.054209 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e9bf480f-0b97-43e9-8e27-7d89c84063db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:11.054852 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e9bf480f-0b97-43e9-8e27-7d89c84063db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:11.059057 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1114/2248] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:58:10 2022] DELETE /identity/v3/projects/39e5bca59869429697d063e94af04e64 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:58:11.064519 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf480f-0b97-43e9-8e27-7d89c84063db admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:11.067883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e9bf480f-0b97-43e9-8e27-7d89c84063db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:11.120604 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726622c-249e-4b37-ac15-5127de33eb96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9570eaa112de460cb9e371278bfb300b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:11.121236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726622c-249e-4b37-ac15-5127de33eb96 service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:11.121514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726622c-249e-4b37-ac15-5127de33eb96 service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:11.121937 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726622c-249e-4b37-ac15-5127de33eb96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:11.123877 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c726622c-249e-4b37-ac15-5127de33eb96 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:11.161240 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf480f-0b97-43e9-8e27-7d89c84063db admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:11.166835 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4735cb4-2041-4a2c-a390-d23e2106e583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:11.167491 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4735cb4-2041-4a2c-a390-d23e2106e583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:11.167770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4735cb4-2041-4a2c-a390-d23e2106e583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:11.168144 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4735cb4-2041-4a2c-a390-d23e2106e583 admin admin] PATH_INFO: `/v3/users/301d1f94e9364ad1a5e6a12e44b2306a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:11.169582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4735cb4-2041-4a2c-a390-d23e2106e583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=301d1f94e9364ad1a5e6a12e44b2306a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:11.171697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4735cb4-2041-4a2c-a390-d23e2106e583 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:11.211170 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726622c-249e-4b37-ac15-5127de33eb96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:11.213652 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726622c-249e-4b37-ac15-5127de33eb96 service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:11.244431 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f4735cb4-2041-4a2c-a390-d23e2106e583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '301d1f94e9364ad1a5e6a12e44b2306a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:11.253740 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1135/2249] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Sep 9 20:58:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 20:58:11.254928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f4735cb4-2041-4a2c-a390-d23e2106e583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '301d1f94e9364ad1a5e6a12e44b2306a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:11.255652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f4735cb4-2041-4a2c-a390-d23e2106e583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '301d1f94e9364ad1a5e6a12e44b2306a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:11.256370 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f4735cb4-2041-4a2c-a390-d23e2106e583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '301d1f94e9364ad1a5e6a12e44b2306a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:11.265945 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f4735cb4-2041-4a2c-a390-d23e2106e583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '301d1f94e9364ad1a5e6a12e44b2306a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:11.324077 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1115/2250] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:58:11 2022] DELETE /identity/v3/users/301d1f94e9364ad1a5e6a12e44b2306a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:58:12.771141 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726622c-249e-4b37-ac15-5127de33eb96 service swift] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:12.800563 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726622c-249e-4b37-ac15-5127de33eb96 service swift] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:12.906603 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295df1d6-05a1-4f43-85fe-6ade31f7d5c5 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:12.907137 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295df1d6-05a1-4f43-85fe-6ade31f7d5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:12.907137 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295df1d6-05a1-4f43-85fe-6ade31f7d5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:12.950518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-295df1d6-05a1-4f43-85fe-6ade31f7d5c5 None None] MFA Rules not processed for user `e5a63070e7f342dd911b45bf348c9da3`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:12.953155 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-295df1d6-05a1-4f43-85fe-6ade31f7d5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:12.996315 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236f6d8-01ee-42df-be00-6128d7cc5f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:12.999940 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236f6d8-01ee-42df-be00-6128d7cc5f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:13.000123 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236f6d8-01ee-42df-be00-6128d7cc5f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:13.000381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236f6d8-01ee-42df-be00-6128d7cc5f64 admin admin] PATH_INFO: `/v3/projects/a5ce736ff9fc4fe3afcdffb38796c293` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:13.004996 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236f6d8-01ee-42df-be00-6128d7cc5f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ce736ff9fc4fe3afcdffb38796c293)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:13.006939 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236f6d8-01ee-42df-be00-6128d7cc5f64 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:13.042403 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:13.146995 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1116/2251] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:13.150601 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d236f6d8-01ee-42df-be00-6128d7cc5f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ce736ff9fc4fe3afcdffb38796c293', 'request_id': 'req-d236f6d8-01ee-42df-be00-6128d7cc5f64'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:13.167042 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d236f6d8-01ee-42df-be00-6128d7cc5f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ce736ff9fc4fe3afcdffb38796c293', 'request_id': 'req-d236f6d8-01ee-42df-be00-6128d7cc5f64'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:13.182213 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d236f6d8-01ee-42df-be00-6128d7cc5f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ce736ff9fc4fe3afcdffb38796c293', 'request_id': 'req-d236f6d8-01ee-42df-be00-6128d7cc5f64'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:13.199625 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d236f6d8-01ee-42df-be00-6128d7cc5f64 admin admin] The token cache is being invalidate because project a5ce736ff9fc4fe3afcdffb38796c293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:58:13.200205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d236f6d8-01ee-42df-be00-6128d7cc5f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:13.201732 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d236f6d8-01ee-42df-be00-6128d7cc5f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:13.208454 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1136/2252] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:58:12 2022] DELETE /identity/v3/projects/a5ce736ff9fc4fe3afcdffb38796c293 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:13.211023 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe76e9-1987-4ee1-943e-140f7cb24c45 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:13.211382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe76e9-1987-4ee1-943e-140f7cb24c45 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:13.211765 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe76e9-1987-4ee1-943e-140f7cb24c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:13.274691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7cbe76e9-1987-4ee1-943e-140f7cb24c45 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:13.280541 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7cbe76e9-1987-4ee1-943e-140f7cb24c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:13.315691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:13.458062 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1117/2253] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:13.466494 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f81dbe-dc18-4de1-ad43-b3d7803ece9a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:13.467622 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f81dbe-dc18-4de1-ad43-b3d7803ece9a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:13.468038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f81dbe-dc18-4de1-ad43-b3d7803ece9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:13.509523 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-67f81dbe-dc18-4de1-ad43-b3d7803ece9a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:13.512190 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-67f81dbe-dc18-4de1-ad43-b3d7803ece9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:13.545438 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1137/2254] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:13.546624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe76e9-1987-4ee1-943e-140f7cb24c45 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:13.563412 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe76e9-1987-4ee1-943e-140f7cb24c45 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:13.570288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2408fc0-7226-467e-a342-98c9b46db43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:13.571049 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2408fc0-7226-467e-a342-98c9b46db43b admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:13.571336 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2408fc0-7226-467e-a342-98c9b46db43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:13.571613 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2408fc0-7226-467e-a342-98c9b46db43b admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:13.572380 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2408fc0-7226-467e-a342-98c9b46db43b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:58:13.572687 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2408fc0-7226-467e-a342-98c9b46db43b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:13.574379 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2408fc0-7226-467e-a342-98c9b46db43b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:13.592636 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1118/2255] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:58:13.594428 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f81dbe-dc18-4de1-ad43-b3d7803ece9a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:13.608480 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f81dbe-dc18-4de1-ad43-b3d7803ece9a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:13.626890 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62cd26-0bc8-407a-8cc1-40764eaeb331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:13.628859 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62cd26-0bc8-407a-8cc1-40764eaeb331 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:13.629373 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62cd26-0bc8-407a-8cc1-40764eaeb331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:13.631116 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62cd26-0bc8-407a-8cc1-40764eaeb331 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:13.632049 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62cd26-0bc8-407a-8cc1-40764eaeb331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:13.636918 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc62cd26-0bc8-407a-8cc1-40764eaeb331 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:13.692913 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1138/2256] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:58:13 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:58:13.693065 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2408fc0-7226-467e-a342-98c9b46db43b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:13.721610 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2408fc0-7226-467e-a342-98c9b46db43b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:13.863699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e88387-4ea8-4f5b-b362-293ae7c11c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:13.864530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e88387-4ea8-4f5b-b362-293ae7c11c3d admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:13.864913 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e88387-4ea8-4f5b-b362-293ae7c11c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:13.865289 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e88387-4ea8-4f5b-b362-293ae7c11c3d admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:13.866050 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e88387-4ea8-4f5b-b362-293ae7c11c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:13.869234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e88387-4ea8-4f5b-b362-293ae7c11c3d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:13.934192 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1119/2257] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:58:13 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:58:13.938531 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62cd26-0bc8-407a-8cc1-40764eaeb331 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:13.952728 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62cd26-0bc8-407a-8cc1-40764eaeb331 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:13.968990 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7839cc-c78b-45e6-997a-c5dcd607cccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:13.976415 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7839cc-c78b-45e6-997a-c5dcd607cccc admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:13.977655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7839cc-c78b-45e6-997a-c5dcd607cccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:13.978144 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7839cc-c78b-45e6-997a-c5dcd607cccc admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:13.979146 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7839cc-c78b-45e6-997a-c5dcd607cccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:13.981253 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7839cc-c78b-45e6-997a-c5dcd607cccc admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:13.999636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1139/2258] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:58:14.003978 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e88387-4ea8-4f5b-b362-293ae7c11c3d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:14.016144 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e88387-4ea8-4f5b-b362-293ae7c11c3d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:14.022642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e54e2a-0352-4cf5-9d1f-f1b6f45ad2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:14.023856 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e54e2a-0352-4cf5-9d1f-f1b6f45ad2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:14.023856 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e54e2a-0352-4cf5-9d1f-f1b6f45ad2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:14.024174 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e54e2a-0352-4cf5-9d1f-f1b6f45ad2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:14.024779 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e54e2a-0352-4cf5-9d1f-f1b6f45ad2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:14.026721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e54e2a-0352-4cf5-9d1f-f1b6f45ad2f6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:14.044551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7839cc-c78b-45e6-997a-c5dcd607cccc admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:14.045103 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1120/2259] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:58:14.056997 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7839cc-c78b-45e6-997a-c5dcd607cccc admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:14.062459 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db8cdd-73c7-4a06-9403-fe8707f51244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:14.063221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db8cdd-73c7-4a06-9403-fe8707f51244 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:14.063580 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db8cdd-73c7-4a06-9403-fe8707f51244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:14.064585 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db8cdd-73c7-4a06-9403-fe8707f51244 admin admin] PATH_INFO: `/v3/projects/d2bf9b9db9dd477589a7de19c7598ea5/users/10055266ddda498ca69d9de8988f78e5/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:14.085544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db8cdd-73c7-4a06-9403-fe8707f51244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2bf9b9db9dd477589a7de19c7598ea5, user_id=10055266ddda498ca69d9de8988f78e5, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:14.086407 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db8cdd-73c7-4a06-9403-fe8707f51244 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:14.121675 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc325d-3f49-4621-8fab-884e671e37d2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:14.122001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc325d-3f49-4621-8fab-884e671e37d2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:14.122397 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc325d-3f49-4621-8fab-884e671e37d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:14.125349 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1140/2260] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:58:14 2022] PUT /identity/v3/projects/d2bf9b9db9dd477589a7de19c7598ea5/users/10055266ddda498ca69d9de8988f78e5/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:14.193498 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c2dc325d-3f49-4621-8fab-884e671e37d2 None None] MFA Rules not processed for user `10055266ddda498ca69d9de8988f78e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:14.194835 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c2dc325d-3f49-4621-8fab-884e671e37d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:14.347530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1121/2261] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:14.354555 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db8cdd-73c7-4a06-9403-fe8707f51244 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:14.356553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-38db8cdd-73c7-4a06-9403-fe8707f51244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:14.457280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db8cdd-73c7-4a06-9403-fe8707f51244 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:14.461548 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a238ee0-3972-4182-ba21-4aff89eb0ab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:14.462368 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a238ee0-3972-4182-ba21-4aff89eb0ab4 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:14.462949 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a238ee0-3972-4182-ba21-4aff89eb0ab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:14.463390 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a238ee0-3972-4182-ba21-4aff89eb0ab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:14.480403 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a238ee0-3972-4182-ba21-4aff89eb0ab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:14.481915 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a238ee0-3972-4182-ba21-4aff89eb0ab4 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:14.515345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1141/2262] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:58:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:58:14.528126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc325d-3f49-4621-8fab-884e671e37d2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:14.548559 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:14.727031 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc325d-3f49-4621-8fab-884e671e37d2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:14.742664 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72909d-62b7-4dc1-8aab-0e462733e7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:14.743631 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72909d-62b7-4dc1-8aab-0e462733e7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:14.743767 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72909d-62b7-4dc1-8aab-0e462733e7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:14.744160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72909d-62b7-4dc1-8aab-0e462733e7d3 admin admin] PATH_INFO: `/v3/users/10055266ddda498ca69d9de8988f78e5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:14.746117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72909d-62b7-4dc1-8aab-0e462733e7d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10055266ddda498ca69d9de8988f78e5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:14.751333 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72909d-62b7-4dc1-8aab-0e462733e7d3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:14.887207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9a72909d-62b7-4dc1-8aab-0e462733e7d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10055266ddda498ca69d9de8988f78e5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:14.903585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9a72909d-62b7-4dc1-8aab-0e462733e7d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10055266ddda498ca69d9de8988f78e5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:14.905483 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9a72909d-62b7-4dc1-8aab-0e462733e7d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10055266ddda498ca69d9de8988f78e5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:14.912714 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9a72909d-62b7-4dc1-8aab-0e462733e7d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10055266ddda498ca69d9de8988f78e5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:14.926945 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9a72909d-62b7-4dc1-8aab-0e462733e7d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10055266ddda498ca69d9de8988f78e5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:14.982328 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aec0c1-f043-4fff-86cb-c02e1566ca66 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:14.983266 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aec0c1-f043-4fff-86cb-c02e1566ca66 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:14.983812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aec0c1-f043-4fff-86cb-c02e1566ca66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:14.987217 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1122/2263] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:58:14 2022] DELETE /identity/v3/users/10055266ddda498ca69d9de8988f78e5 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:15.019902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f8aec0c1-f043-4fff-86cb-c02e1566ca66 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:15.022552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f8aec0c1-f043-4fff-86cb-c02e1566ca66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:15.101767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:15.168777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1142/2264] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:15.254824 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72909d-62b7-4dc1-8aab-0e462733e7d3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:15.256621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9a72909d-62b7-4dc1-8aab-0e462733e7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:15.436032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72909d-62b7-4dc1-8aab-0e462733e7d3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:15.441622 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f3198-d4a0-4f13-a1d3-6fea97d54e07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:15.442691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f3198-d4a0-4f13-a1d3-6fea97d54e07 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:15.443274 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f3198-d4a0-4f13-a1d3-6fea97d54e07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:15.444528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f3198-d4a0-4f13-a1d3-6fea97d54e07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:15.458458 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f3198-d4a0-4f13-a1d3-6fea97d54e07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:15.460414 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f3198-d4a0-4f13-a1d3-6fea97d54e07 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:15.476149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1123/2265] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:58:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:58:16.362660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aec0c1-f043-4fff-86cb-c02e1566ca66 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:16.364195 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f8aec0c1-f043-4fff-86cb-c02e1566ca66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:16.404034 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aec0c1-f043-4fff-86cb-c02e1566ca66 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:16.427226 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76afb14d-a25d-4d50-9d0f-feb753a70f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:16.429462 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afb14d-a25d-4d50-9d0f-feb753a70f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:16.430949 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afb14d-a25d-4d50-9d0f-feb753a70f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:16.431579 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76afb14d-a25d-4d50-9d0f-feb753a70f56 admin admin] PATH_INFO: `/v3/projects/d2bf9b9db9dd477589a7de19c7598ea5` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:16.437562 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afb14d-a25d-4d50-9d0f-feb753a70f56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2bf9b9db9dd477589a7de19c7598ea5)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:16.443075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76afb14d-a25d-4d50-9d0f-feb753a70f56 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:16.601866 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76afb14d-a25d-4d50-9d0f-feb753a70f56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2bf9b9db9dd477589a7de19c7598ea5', 'request_id': 'req-76afb14d-a25d-4d50-9d0f-feb753a70f56'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:16.615318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76afb14d-a25d-4d50-9d0f-feb753a70f56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2bf9b9db9dd477589a7de19c7598ea5', 'request_id': 'req-76afb14d-a25d-4d50-9d0f-feb753a70f56'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:16.626389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76afb14d-a25d-4d50-9d0f-feb753a70f56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2bf9b9db9dd477589a7de19c7598ea5', 'request_id': 'req-76afb14d-a25d-4d50-9d0f-feb753a70f56'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:16.650492 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76afb14d-a25d-4d50-9d0f-feb753a70f56 admin admin] The token cache is being invalidate because project d2bf9b9db9dd477589a7de19c7598ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:58:16.651173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76afb14d-a25d-4d50-9d0f-feb753a70f56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:16.653576 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-76afb14d-a25d-4d50-9d0f-feb753a70f56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:16.657767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1143/2266] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:58:16 2022] DELETE /identity/v3/projects/d2bf9b9db9dd477589a7de19c7598ea5 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:16.664813 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4562e3c-1d10-47f1-8318-9d1282394e16 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:16.665378 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4562e3c-1d10-47f1-8318-9d1282394e16 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:16.665378 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4562e3c-1d10-47f1-8318-9d1282394e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:16.722605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e4562e3c-1d10-47f1-8318-9d1282394e16 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:16.723818 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e4562e3c-1d10-47f1-8318-9d1282394e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:16.790500 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:16.878337 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1124/2267] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:16.880895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68411c90-ddb2-4004-92c1-71981c81ce5d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:16.881409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68411c90-ddb2-4004-92c1-71981c81ce5d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:16.881525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68411c90-ddb2-4004-92c1-71981c81ce5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:16.913628 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-68411c90-ddb2-4004-92c1-71981c81ce5d None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:16.915383 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-68411c90-ddb2-4004-92c1-71981c81ce5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:16.939177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1144/2268] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:16.945373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4562e3c-1d10-47f1-8318-9d1282394e16 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:16.965404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4562e3c-1d10-47f1-8318-9d1282394e16 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:16.978117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c71b2-743e-42c8-bd65-0d0c02937dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:16.978983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c71b2-743e-42c8-bd65-0d0c02937dae admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:16.979470 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c71b2-743e-42c8-bd65-0d0c02937dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:16.979949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c71b2-743e-42c8-bd65-0d0c02937dae admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:16.980835 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c71b2-743e-42c8-bd65-0d0c02937dae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:58:16.981423 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c71b2-743e-42c8-bd65-0d0c02937dae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:16.983802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c71b2-743e-42c8-bd65-0d0c02937dae admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:17.012546 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1125/2269] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:58:17.013220 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68411c90-ddb2-4004-92c1-71981c81ce5d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:17.030202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68411c90-ddb2-4004-92c1-71981c81ce5d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:17.041259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae59dbc-dacc-42d9-8624-3c466ef0c174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:17.041892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae59dbc-dacc-42d9-8624-3c466ef0c174 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:17.042291 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae59dbc-dacc-42d9-8624-3c466ef0c174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:17.042484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae59dbc-dacc-42d9-8624-3c466ef0c174 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:17.043068 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae59dbc-dacc-42d9-8624-3c466ef0c174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:17.045026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae59dbc-dacc-42d9-8624-3c466ef0c174 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:17.144900 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1145/2270] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:58:17 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:58:17.146436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c71b2-743e-42c8-bd65-0d0c02937dae admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:17.158464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c71b2-743e-42c8-bd65-0d0c02937dae admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:17.387863 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4865101-3191-474e-91fb-aa9d15a61057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:17.390229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4865101-3191-474e-91fb-aa9d15a61057 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:17.390903 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4865101-3191-474e-91fb-aa9d15a61057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:17.392026 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4865101-3191-474e-91fb-aa9d15a61057 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:17.393696 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4865101-3191-474e-91fb-aa9d15a61057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:17.410936 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4865101-3191-474e-91fb-aa9d15a61057 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:17.485798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1126/2271] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:58:17 2022] POST /identity/v3/users => generated 289 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:58:17.487760 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae59dbc-dacc-42d9-8624-3c466ef0c174 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:17.503753 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae59dbc-dacc-42d9-8624-3c466ef0c174 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:17.527907 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4fcdc-c001-4c66-a9a5-8eb42417eace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:17.528635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4fcdc-c001-4c66-a9a5-8eb42417eace admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:17.528907 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4fcdc-c001-4c66-a9a5-8eb42417eace admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:17.529438 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4fcdc-c001-4c66-a9a5-8eb42417eace admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:17.530259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4fcdc-c001-4c66-a9a5-8eb42417eace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:17.533783 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4fcdc-c001-4c66-a9a5-8eb42417eace admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:17.571132 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1146/2272] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:58:17.575114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4865101-3191-474e-91fb-aa9d15a61057 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:17.591786 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4865101-3191-474e-91fb-aa9d15a61057 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:17.603397 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b7a88-6750-41f9-84a9-d6bf44e98699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:17.604069 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b7a88-6750-41f9-84a9-d6bf44e98699 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:17.604355 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b7a88-6750-41f9-84a9-d6bf44e98699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:17.604624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b7a88-6750-41f9-84a9-d6bf44e98699 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:17.605268 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b7a88-6750-41f9-84a9-d6bf44e98699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:17.627967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b7a88-6750-41f9-84a9-d6bf44e98699 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:17.662133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1127/2273] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:58:17.664808 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4fcdc-c001-4c66-a9a5-8eb42417eace admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:17.698861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4fcdc-c001-4c66-a9a5-8eb42417eace admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:17.728265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b85df7-6f3c-4f0b-b0c9-135a5ab2ce1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:17.729397 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b85df7-6f3c-4f0b-b0c9-135a5ab2ce1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:17.729943 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b85df7-6f3c-4f0b-b0c9-135a5ab2ce1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:17.730445 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b85df7-6f3c-4f0b-b0c9-135a5ab2ce1b admin admin] PATH_INFO: `/v3/projects/3d44d61354944546a289b10ad65368b1/users/d4cd19dccadc4ffdb294277e2045d297/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:17.765685 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b85df7-6f3c-4f0b-b0c9-135a5ab2ce1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d44d61354944546a289b10ad65368b1, user_id=d4cd19dccadc4ffdb294277e2045d297, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:17.770585 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b85df7-6f3c-4f0b-b0c9-135a5ab2ce1b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:17.798409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1147/2274] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:58:17 2022] PUT /identity/v3/projects/3d44d61354944546a289b10ad65368b1/users/d4cd19dccadc4ffdb294277e2045d297/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:17.809640 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232eb01b-e11a-4136-a593-6b0deba8dae3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:17.810648 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232eb01b-e11a-4136-a593-6b0deba8dae3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:17.811129 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232eb01b-e11a-4136-a593-6b0deba8dae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:17.847868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-232eb01b-e11a-4136-a593-6b0deba8dae3 None None] MFA Rules not processed for user `d4cd19dccadc4ffdb294277e2045d297`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:17.849303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-232eb01b-e11a-4136-a593-6b0deba8dae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:17.936063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1128/2275] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:17.939029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b85df7-6f3c-4f0b-b0c9-135a5ab2ce1b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:18.040808 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:18.046022 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b85df7-6f3c-4f0b-b0c9-135a5ab2ce1b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:18.056049 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a733f-652c-426f-a6c5-594752607ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:18.057183 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a733f-652c-426f-a6c5-594752607ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:18.057809 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a733f-652c-426f-a6c5-594752607ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:18.058451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a733f-652c-426f-a6c5-594752607ce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:18.059494 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a733f-652c-426f-a6c5-594752607ce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:18.061578 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a733f-652c-426f-a6c5-594752607ce7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:18.100358 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1148/2276] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:58:17 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:58:18.104185 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232eb01b-e11a-4136-a593-6b0deba8dae3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:18.132260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232eb01b-e11a-4136-a593-6b0deba8dae3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:18.186224 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:18.261035 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de42486-d655-46ee-a8b1-cb6fb19ffc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:18.261701 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de42486-d655-46ee-a8b1-cb6fb19ffc44 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:18.262312 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de42486-d655-46ee-a8b1-cb6fb19ffc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:18.262312 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de42486-d655-46ee-a8b1-cb6fb19ffc44 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:18.262871 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de42486-d655-46ee-a8b1-cb6fb19ffc44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:18.264900 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de42486-d655-46ee-a8b1-cb6fb19ffc44 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:18.315923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1129/2277] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:58:18 2022] POST /identity/v3/users => generated 288 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:58:18.319535 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a733f-652c-426f-a6c5-594752607ce7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:18.337365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a733f-652c-426f-a6c5-594752607ce7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:18.343464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88dbca-3544-4232-951a-31fdf78c0654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:18.345537 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88dbca-3544-4232-951a-31fdf78c0654 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:18.346014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88dbca-3544-4232-951a-31fdf78c0654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:18.346304 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88dbca-3544-4232-951a-31fdf78c0654 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:18.347004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88dbca-3544-4232-951a-31fdf78c0654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:18.348662 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88dbca-3544-4232-951a-31fdf78c0654 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:18.367667 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1149/2278] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:58:18.370791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de42486-d655-46ee-a8b1-cb6fb19ffc44 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:18.394533 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de42486-d655-46ee-a8b1-cb6fb19ffc44 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:18.406780 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ba046-61a2-463d-a2bb-4ea13c64a04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:18.407425 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ba046-61a2-463d-a2bb-4ea13c64a04a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:18.407711 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ba046-61a2-463d-a2bb-4ea13c64a04a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:18.408119 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ba046-61a2-463d-a2bb-4ea13c64a04a admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:18.411822 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ba046-61a2-463d-a2bb-4ea13c64a04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:18.415642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ba046-61a2-463d-a2bb-4ea13c64a04a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:18.442350 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1130/2279] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:58:18.446980 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88dbca-3544-4232-951a-31fdf78c0654 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:18.463964 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88dbca-3544-4232-951a-31fdf78c0654 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:18.476986 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e1dc2-57fb-4220-8dca-6b11235e19d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:18.477677 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e1dc2-57fb-4220-8dca-6b11235e19d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:18.477959 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e1dc2-57fb-4220-8dca-6b11235e19d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:18.478241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e1dc2-57fb-4220-8dca-6b11235e19d9 admin admin] PATH_INFO: `/v3/projects/d31c13aec7cf4faba3f3b640a06986ea/users/092be2e659eb4d669684a4a972477fc2/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:18.504574 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e1dc2-57fb-4220-8dca-6b11235e19d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d31c13aec7cf4faba3f3b640a06986ea, user_id=092be2e659eb4d669684a4a972477fc2, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:18.507712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e1dc2-57fb-4220-8dca-6b11235e19d9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:18.534334 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1150/2280] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:58:18 2022] PUT /identity/v3/projects/d31c13aec7cf4faba3f3b640a06986ea/users/092be2e659eb4d669684a4a972477fc2/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:18.536691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cafe4-0d0f-41d5-91d8-8dacb81f5087 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:18.537001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cafe4-0d0f-41d5-91d8-8dacb81f5087 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:18.541026 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cafe4-0d0f-41d5-91d8-8dacb81f5087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:18.638749 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e51cafe4-0d0f-41d5-91d8-8dacb81f5087 None None] MFA Rules not processed for user `092be2e659eb4d669684a4a972477fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:18.640027 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e51cafe4-0d0f-41d5-91d8-8dacb81f5087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:18.808799 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1131/2281] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:18.813143 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e1dc2-57fb-4220-8dca-6b11235e19d9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:18.979747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e1dc2-57fb-4220-8dca-6b11235e19d9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:18.985798 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62911fb7-f038-49b1-94a0-38b6226b49a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:18.986990 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62911fb7-f038-49b1-94a0-38b6226b49a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:18.987432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62911fb7-f038-49b1-94a0-38b6226b49a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:18.988255 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62911fb7-f038-49b1-94a0-38b6226b49a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:18.988923 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62911fb7-f038-49b1-94a0-38b6226b49a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:18.990834 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62911fb7-f038-49b1-94a0-38b6226b49a6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:19.078289 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1151/2282] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:58:18 2022] POST /identity/v3/projects => generated 377 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:58:19.079080 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cafe4-0d0f-41d5-91d8-8dacb81f5087 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:19.098575 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cafe4-0d0f-41d5-91d8-8dacb81f5087 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:19.189822 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663811a-e928-424e-8f43-fa54195ed0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:19.190972 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663811a-e928-424e-8f43-fa54195ed0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:19.191266 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663811a-e928-424e-8f43-fa54195ed0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:19.191547 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663811a-e928-424e-8f43-fa54195ed0b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:19.192233 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663811a-e928-424e-8f43-fa54195ed0b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:19.194694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8663811a-e928-424e-8f43-fa54195ed0b9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:19.254677 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1132/2283] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:58:19 2022] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:58:19.258250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62911fb7-f038-49b1-94a0-38b6226b49a6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:19.272048 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62911fb7-f038-49b1-94a0-38b6226b49a6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:19.277749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f31eb0-effc-4fee-a18a-679406675a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:19.278462 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f31eb0-effc-4fee-a18a-679406675a7a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:19.278815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f31eb0-effc-4fee-a18a-679406675a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:19.279421 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f31eb0-effc-4fee-a18a-679406675a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:19.279873 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f31eb0-effc-4fee-a18a-679406675a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:19.282540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f31eb0-effc-4fee-a18a-679406675a7a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:19.296660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1152/2284] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 20:58:19.301015 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663811a-e928-424e-8f43-fa54195ed0b9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:19.319265 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663811a-e928-424e-8f43-fa54195ed0b9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:19.336021 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acb185-63be-41d9-aaac-72786ca8e93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:19.336021 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acb185-63be-41d9-aaac-72786ca8e93b admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:19.336021 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acb185-63be-41d9-aaac-72786ca8e93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:19.336021 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95acb185-63be-41d9-aaac-72786ca8e93b admin admin] PATH_INFO: `/v3/projects/4750fe7318614ca092887a9cb18596af/users/e2173c170bd24aaf8c3c87786c349344/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:19.376912 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acb185-63be-41d9-aaac-72786ca8e93b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4750fe7318614ca092887a9cb18596af, user_id=e2173c170bd24aaf8c3c87786c349344, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:19.380327 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95acb185-63be-41d9-aaac-72786ca8e93b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:19.414540 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1133/2285] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:58:19 2022] PUT /identity/v3/projects/4750fe7318614ca092887a9cb18596af/users/e2173c170bd24aaf8c3c87786c349344/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:19.418776 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f31eb0-effc-4fee-a18a-679406675a7a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:19.437095 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f31eb0-effc-4fee-a18a-679406675a7a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:19.542774 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c523e7-8010-4f2f-9103-6d420f4785b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:19.544191 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c523e7-8010-4f2f-9103-6d420f4785b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:19.544658 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c523e7-8010-4f2f-9103-6d420f4785b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:19.545119 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c523e7-8010-4f2f-9103-6d420f4785b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:19.545970 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c523e7-8010-4f2f-9103-6d420f4785b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:19.549385 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c523e7-8010-4f2f-9103-6d420f4785b2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:19.568270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1153/2286] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:58:19.570211 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acb185-63be-41d9-aaac-72786ca8e93b admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:19.576414 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:19.590968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95acb185-63be-41d9-aaac-72786ca8e93b admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:19.605685 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ab9af-915d-4d69-95a8-7429de85bdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:19.606462 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ab9af-915d-4d69-95a8-7429de85bdee admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:19.607370 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ab9af-915d-4d69-95a8-7429de85bdee admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:19.607370 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ab9af-915d-4d69-95a8-7429de85bdee admin admin] PATH_INFO: `/v3/projects/4750fe7318614ca092887a9cb18596af/users/e2173c170bd24aaf8c3c87786c349344/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:19.609759 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ab9af-915d-4d69-95a8-7429de85bdee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4750fe7318614ca092887a9cb18596af, user_id=e2173c170bd24aaf8c3c87786c349344, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:19.615532 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ab9af-915d-4d69-95a8-7429de85bdee admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:19.633116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1134/2287] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:58:19 2022] PUT /identity/v3/projects/4750fe7318614ca092887a9cb18596af/users/e2173c170bd24aaf8c3c87786c349344/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:19.644938 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd4271-cfdc-480f-acac-780cd248e5cd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:19.645226 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd4271-cfdc-480f-acac-780cd248e5cd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:19.645549 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd4271-cfdc-480f-acac-780cd248e5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:19.681306 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b1bd4271-cfdc-480f-acac-780cd248e5cd None None] MFA Rules not processed for user `e2173c170bd24aaf8c3c87786c349344`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:19.682550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b1bd4271-cfdc-480f-acac-780cd248e5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:19.689984 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:19.955691 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1154/2288] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:19.959815 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ab9af-915d-4d69-95a8-7429de85bdee admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:19.961748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0c6ab9af-915d-4d69-95a8-7429de85bdee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:20.153371 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ab9af-915d-4d69-95a8-7429de85bdee admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:20.173540 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9c3ca-6031-493a-bda1-877b9fb53a22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:20.177445 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9c3ca-6031-493a-bda1-877b9fb53a22 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:20.177765 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9c3ca-6031-493a-bda1-877b9fb53a22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:20.178051 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f9c3ca-6031-493a-bda1-877b9fb53a22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:20.328175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9c3ca-6031-493a-bda1-877b9fb53a22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:20.329760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f9c3ca-6031-493a-bda1-877b9fb53a22 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:20.356417 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1135/2289] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:58:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:58:22.661638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd4271-cfdc-480f-acac-780cd248e5cd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:22.665837 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b1bd4271-cfdc-480f-acac-780cd248e5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:22.686353 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd4271-cfdc-480f-acac-780cd248e5cd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:22.692009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68154290-dab9-4614-a1ac-6315af18b0bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:22.693479 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68154290-dab9-4614-a1ac-6315af18b0bb service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:22.693927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68154290-dab9-4614-a1ac-6315af18b0bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:22.694386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68154290-dab9-4614-a1ac-6315af18b0bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:22.797610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68154290-dab9-4614-a1ac-6315af18b0bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:22.799567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68154290-dab9-4614-a1ac-6315af18b0bb service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:22.810709 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1155/2290] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:58:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:58:23.647202 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9c3ca-6031-493a-bda1-877b9fb53a22 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:23.657376 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f9c3ca-6031-493a-bda1-877b9fb53a22 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:23.661725 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b1876-207f-416f-8f17-950b40c8db4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:23.662410 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b1876-207f-416f-8f17-950b40c8db4b service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:23.662697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b1876-207f-416f-8f17-950b40c8db4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:23.662978 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b1876-207f-416f-8f17-950b40c8db4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:23.676327 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b1876-207f-416f-8f17-950b40c8db4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:23.678572 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b1876-207f-416f-8f17-950b40c8db4b service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:23.703528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1136/2291] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:58:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:58:26.021423 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450f00e-559e-4c78-b991-eed1fbcc28d7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:26.022343 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450f00e-559e-4c78-b991-eed1fbcc28d7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:26.022824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450f00e-559e-4c78-b991-eed1fbcc28d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:26.052043 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5450f00e-559e-4c78-b991-eed1fbcc28d7 None None] MFA Rules not processed for user `af23fcaecde74f71a3e7bc7231194a06`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:26.053769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5450f00e-559e-4c78-b991-eed1fbcc28d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:26.182668 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1156/2292] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:58:28.338279 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b1876-207f-416f-8f17-950b40c8db4b service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:28.519686 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b1876-207f-416f-8f17-950b40c8db4b service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:28.529781 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60129c6-8ba1-4b3e-9617-06674fede79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:28.530907 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60129c6-8ba1-4b3e-9617-06674fede79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:28.531454 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60129c6-8ba1-4b3e-9617-06674fede79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:28.531941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60129c6-8ba1-4b3e-9617-06674fede79f admin admin] PATH_INFO: `/v3/users/d4cd19dccadc4ffdb294277e2045d297` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:28.534603 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60129c6-8ba1-4b3e-9617-06674fede79f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4cd19dccadc4ffdb294277e2045d297)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:28.536979 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60129c6-8ba1-4b3e-9617-06674fede79f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:28.599869 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:28.649174 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a60129c6-8ba1-4b3e-9617-06674fede79f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4cd19dccadc4ffdb294277e2045d297'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:28.661488 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a60129c6-8ba1-4b3e-9617-06674fede79f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4cd19dccadc4ffdb294277e2045d297'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:28.662226 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a60129c6-8ba1-4b3e-9617-06674fede79f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4cd19dccadc4ffdb294277e2045d297'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:28.662851 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a60129c6-8ba1-4b3e-9617-06674fede79f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4cd19dccadc4ffdb294277e2045d297'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:28.672962 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a60129c6-8ba1-4b3e-9617-06674fede79f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4cd19dccadc4ffdb294277e2045d297'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:28.697861 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1137/2293] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:58:28 2022] DELETE /identity/v3/users/d4cd19dccadc4ffdb294277e2045d297 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:28.702331 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779aba2-01eb-4e19-9bbf-0118c7ac4205 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:28.703315 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779aba2-01eb-4e19-9bbf-0118c7ac4205 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:28.703804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779aba2-01eb-4e19-9bbf-0118c7ac4205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:28.754197 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f779aba2-01eb-4e19-9bbf-0118c7ac4205 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:28.755920 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f779aba2-01eb-4e19-9bbf-0118c7ac4205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:28.818036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:28.841491 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1157/2294] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:28.853525 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60129c6-8ba1-4b3e-9617-06674fede79f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:28.855030 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a60129c6-8ba1-4b3e-9617-06674fede79f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:28.949476 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60129c6-8ba1-4b3e-9617-06674fede79f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:28.954016 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a1049-03b3-4bb0-8ca2-dc9bdb2907d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:28.955967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a1049-03b3-4bb0-8ca2-dc9bdb2907d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:28.955967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a1049-03b3-4bb0-8ca2-dc9bdb2907d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:28.955967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a1049-03b3-4bb0-8ca2-dc9bdb2907d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:28.968692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a1049-03b3-4bb0-8ca2-dc9bdb2907d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:28.974102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a1049-03b3-4bb0-8ca2-dc9bdb2907d0 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:28.989345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1138/2295] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:58:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:58:29.334407 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779aba2-01eb-4e19-9bbf-0118c7ac4205 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:29.334407 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f779aba2-01eb-4e19-9bbf-0118c7ac4205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:29.350181 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779aba2-01eb-4e19-9bbf-0118c7ac4205 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:29.366136 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9a4bb-b12c-4207-b840-5fb3cba67ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:29.366876 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9a4bb-b12c-4207-b840-5fb3cba67ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:29.367046 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9a4bb-b12c-4207-b840-5fb3cba67ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:29.367316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9a4bb-b12c-4207-b840-5fb3cba67ae3 admin admin] PATH_INFO: `/v3/projects/3d44d61354944546a289b10ad65368b1` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:29.374298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9a4bb-b12c-4207-b840-5fb3cba67ae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d44d61354944546a289b10ad65368b1)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:29.376292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9a4bb-b12c-4207-b840-5fb3cba67ae3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:29.489592 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f3c9a4bb-b12c-4207-b840-5fb3cba67ae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d44d61354944546a289b10ad65368b1', 'request_id': 'req-f3c9a4bb-b12c-4207-b840-5fb3cba67ae3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:29.504222 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f3c9a4bb-b12c-4207-b840-5fb3cba67ae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d44d61354944546a289b10ad65368b1', 'request_id': 'req-f3c9a4bb-b12c-4207-b840-5fb3cba67ae3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:29.511158 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f3c9a4bb-b12c-4207-b840-5fb3cba67ae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d44d61354944546a289b10ad65368b1', 'request_id': 'req-f3c9a4bb-b12c-4207-b840-5fb3cba67ae3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:29.523186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f3c9a4bb-b12c-4207-b840-5fb3cba67ae3 admin admin] The token cache is being invalidate because project 3d44d61354944546a289b10ad65368b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:58:29.523534 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f3c9a4bb-b12c-4207-b840-5fb3cba67ae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:29.524254 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f3c9a4bb-b12c-4207-b840-5fb3cba67ae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:29.525743 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1158/2296] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:58:29 2022] DELETE /identity/v3/projects/3d44d61354944546a289b10ad65368b1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:29.529841 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a1049-03b3-4bb0-8ca2-dc9bdb2907d0 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:29.542157 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a1049-03b3-4bb0-8ca2-dc9bdb2907d0 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:29.620913 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9b52c-d780-41ee-9dae-1d8ebd8ec9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:29.621555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9b52c-d780-41ee-9dae-1d8ebd8ec9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:29.621835 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9b52c-d780-41ee-9dae-1d8ebd8ec9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:29.622108 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a9b52c-d780-41ee-9dae-1d8ebd8ec9a6 admin admin] PATH_INFO: `/v3/users/092be2e659eb4d669684a4a972477fc2` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:29.623404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9b52c-d780-41ee-9dae-1d8ebd8ec9a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=092be2e659eb4d669684a4a972477fc2)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:29.625396 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a9b52c-d780-41ee-9dae-1d8ebd8ec9a6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:29.681281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-74a9b52c-d780-41ee-9dae-1d8ebd8ec9a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '092be2e659eb4d669684a4a972477fc2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:29.689131 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-74a9b52c-d780-41ee-9dae-1d8ebd8ec9a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '092be2e659eb4d669684a4a972477fc2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:29.689941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-74a9b52c-d780-41ee-9dae-1d8ebd8ec9a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '092be2e659eb4d669684a4a972477fc2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:29.690555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-74a9b52c-d780-41ee-9dae-1d8ebd8ec9a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '092be2e659eb4d669684a4a972477fc2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:29.692023 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:29.699885 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-74a9b52c-d780-41ee-9dae-1d8ebd8ec9a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '092be2e659eb4d669684a4a972477fc2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:29.718368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1139/2297] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:58:29 2022] DELETE /identity/v3/users/092be2e659eb4d669684a4a972477fc2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:30.029874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9a4bb-b12c-4207-b840-5fb3cba67ae3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:30.031898 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f3c9a4bb-b12c-4207-b840-5fb3cba67ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:30.053899 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9a4bb-b12c-4207-b840-5fb3cba67ae3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:30.143431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02866fd8-b253-4728-aa80-9101828d2759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:30.144111 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02866fd8-b253-4728-aa80-9101828d2759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:30.144596 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02866fd8-b253-4728-aa80-9101828d2759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:30.145006 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02866fd8-b253-4728-aa80-9101828d2759 admin admin] PATH_INFO: `/v3/projects/d31c13aec7cf4faba3f3b640a06986ea` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:30.146212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02866fd8-b253-4728-aa80-9101828d2759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d31c13aec7cf4faba3f3b640a06986ea)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:30.148174 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02866fd8-b253-4728-aa80-9101828d2759 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:30.248891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-02866fd8-b253-4728-aa80-9101828d2759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd31c13aec7cf4faba3f3b640a06986ea', 'request_id': 'req-02866fd8-b253-4728-aa80-9101828d2759'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:30.269199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-02866fd8-b253-4728-aa80-9101828d2759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd31c13aec7cf4faba3f3b640a06986ea', 'request_id': 'req-02866fd8-b253-4728-aa80-9101828d2759'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:30.275974 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-02866fd8-b253-4728-aa80-9101828d2759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd31c13aec7cf4faba3f3b640a06986ea', 'request_id': 'req-02866fd8-b253-4728-aa80-9101828d2759'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:30.296810 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:30.301168 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-02866fd8-b253-4728-aa80-9101828d2759 admin admin] The token cache is being invalidate because project d31c13aec7cf4faba3f3b640a06986ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:58:30.301850 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-02866fd8-b253-4728-aa80-9101828d2759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:30.302740 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-02866fd8-b253-4728-aa80-9101828d2759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:30.308680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9b52c-d780-41ee-9dae-1d8ebd8ec9a6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:30.309366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1159/2298] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:58:30 2022] DELETE /identity/v3/projects/d31c13aec7cf4faba3f3b640a06986ea => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:30.310397 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-74a9b52c-d780-41ee-9dae-1d8ebd8ec9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:30.325407 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a9b52c-d780-41ee-9dae-1d8ebd8ec9a6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:30.397854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c474f-740a-4e5f-89ba-229c6e9190ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:30.398817 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c474f-740a-4e5f-89ba-229c6e9190ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:30.399147 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c474f-740a-4e5f-89ba-229c6e9190ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:30.399623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c474f-740a-4e5f-89ba-229c6e9190ba admin admin] PATH_INFO: `/v3/users/e2173c170bd24aaf8c3c87786c349344` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:30.401515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c474f-740a-4e5f-89ba-229c6e9190ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2173c170bd24aaf8c3c87786c349344)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:30.405019 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c474f-740a-4e5f-89ba-229c6e9190ba admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:30.514255 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-105c474f-740a-4e5f-89ba-229c6e9190ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2173c170bd24aaf8c3c87786c349344'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:30.541814 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-105c474f-740a-4e5f-89ba-229c6e9190ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2173c170bd24aaf8c3c87786c349344'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:30.544984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-105c474f-740a-4e5f-89ba-229c6e9190ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2173c170bd24aaf8c3c87786c349344'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:30.545722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-105c474f-740a-4e5f-89ba-229c6e9190ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2173c170bd24aaf8c3c87786c349344'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:30.557023 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-105c474f-740a-4e5f-89ba-229c6e9190ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2173c170bd24aaf8c3c87786c349344'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:30.593074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1140/2299] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:58:30 2022] DELETE /identity/v3/users/e2173c170bd24aaf8c3c87786c349344 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:31.074593 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02866fd8-b253-4728-aa80-9101828d2759 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:31.076224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-02866fd8-b253-4728-aa80-9101828d2759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:31.092217 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02866fd8-b253-4728-aa80-9101828d2759 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:31.161538 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38953675-047e-4c95-9895-40b45f55cbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:31.162318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38953675-047e-4c95-9895-40b45f55cbb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:31.162719 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38953675-047e-4c95-9895-40b45f55cbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:31.163174 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38953675-047e-4c95-9895-40b45f55cbb1 admin admin] PATH_INFO: `/v3/projects/4750fe7318614ca092887a9cb18596af` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:31.164428 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38953675-047e-4c95-9895-40b45f55cbb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4750fe7318614ca092887a9cb18596af)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:31.166817 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38953675-047e-4c95-9895-40b45f55cbb1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:31.223243 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-38953675-047e-4c95-9895-40b45f55cbb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4750fe7318614ca092887a9cb18596af', 'request_id': 'req-38953675-047e-4c95-9895-40b45f55cbb1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:31.231980 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-38953675-047e-4c95-9895-40b45f55cbb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4750fe7318614ca092887a9cb18596af', 'request_id': 'req-38953675-047e-4c95-9895-40b45f55cbb1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:31.239837 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-38953675-047e-4c95-9895-40b45f55cbb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4750fe7318614ca092887a9cb18596af', 'request_id': 'req-38953675-047e-4c95-9895-40b45f55cbb1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:31.251643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-38953675-047e-4c95-9895-40b45f55cbb1 admin admin] The token cache is being invalidate because project 4750fe7318614ca092887a9cb18596af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:58:31.252018 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-38953675-047e-4c95-9895-40b45f55cbb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:31.252698 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-38953675-047e-4c95-9895-40b45f55cbb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:58:31.254204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1160/2300] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:58:31 2022] DELETE /identity/v3/projects/4750fe7318614ca092887a9cb18596af => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:31.259231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73141e44-e704-4c50-bf32-34835a5d7753 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:31.259524 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73141e44-e704-4c50-bf32-34835a5d7753 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:31.259807 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73141e44-e704-4c50-bf32-34835a5d7753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:31.284944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-73141e44-e704-4c50-bf32-34835a5d7753 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:31.286535 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-73141e44-e704-4c50-bf32-34835a5d7753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:31.349348 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:31.367445 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1141/2301] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:31.375517 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c14f-5a8d-48e9-a954-2fc5baf305c5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:31.375800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c14f-5a8d-48e9-a954-2fc5baf305c5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:31.376112 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c14f-5a8d-48e9-a954-2fc5baf305c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:31.405164 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5bb3c14f-5a8d-48e9-a954-2fc5baf305c5 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:31.407376 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5bb3c14f-5a8d-48e9-a954-2fc5baf305c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:31.416882 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1161/2302] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:31.420986 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73141e44-e704-4c50-bf32-34835a5d7753 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:31.432520 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73141e44-e704-4c50-bf32-34835a5d7753 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:31.437202 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef4921-5a3c-43ab-ba51-92eaf561aaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:31.437818 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef4921-5a3c-43ab-ba51-92eaf561aaeb admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:31.438099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef4921-5a3c-43ab-ba51-92eaf561aaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:31.438370 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef4921-5a3c-43ab-ba51-92eaf561aaeb admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:31.439068 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef4921-5a3c-43ab-ba51-92eaf561aaeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:58:31.439883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef4921-5a3c-43ab-ba51-92eaf561aaeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:31.441537 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef4921-5a3c-43ab-ba51-92eaf561aaeb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:31.455333 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1142/2303] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:58:31.459801 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3c14f-5a8d-48e9-a954-2fc5baf305c5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:31.471944 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3c14f-5a8d-48e9-a954-2fc5baf305c5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:31.484470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e583888-7f04-4770-a824-784d652038a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:31.485108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e583888-7f04-4770-a824-784d652038a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:31.485448 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e583888-7f04-4770-a824-784d652038a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:31.485747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e583888-7f04-4770-a824-784d652038a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:31.487121 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e583888-7f04-4770-a824-784d652038a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:31.489522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e583888-7f04-4770-a824-784d652038a3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:31.526433 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1162/2304] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:58:31 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:58:31.532473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef4921-5a3c-43ab-ba51-92eaf561aaeb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:31.543762 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef4921-5a3c-43ab-ba51-92eaf561aaeb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:31.633207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bb4b0-b5c1-492c-8cbf-176a3ab3a7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:31.633826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bb4b0-b5c1-492c-8cbf-176a3ab3a7bc admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:31.634133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bb4b0-b5c1-492c-8cbf-176a3ab3a7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:31.634424 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bb4b0-b5c1-492c-8cbf-176a3ab3a7bc admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:31.635053 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bb4b0-b5c1-492c-8cbf-176a3ab3a7bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:31.637056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bb4b0-b5c1-492c-8cbf-176a3ab3a7bc admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:31.661867 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1143/2305] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:58:31 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:58:31.665180 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e583888-7f04-4770-a824-784d652038a3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:31.677205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e583888-7f04-4770-a824-784d652038a3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:31.681867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094c7ed-5835-49a2-a84f-75c6d4626844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:31.682476 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094c7ed-5835-49a2-a84f-75c6d4626844 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:31.682753 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094c7ed-5835-49a2-a84f-75c6d4626844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:31.683025 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094c7ed-5835-49a2-a84f-75c6d4626844 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:31.683669 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094c7ed-5835-49a2-a84f-75c6d4626844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:31.685291 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094c7ed-5835-49a2-a84f-75c6d4626844 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:31.695644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1163/2306] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:58:31.699790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bb4b0-b5c1-492c-8cbf-176a3ab3a7bc admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:31.711179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bb4b0-b5c1-492c-8cbf-176a3ab3a7bc admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:31.715873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf1864-41fe-4f8f-9c17-954d4d4c3438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:31.716516 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf1864-41fe-4f8f-9c17-954d4d4c3438 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:31.716797 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf1864-41fe-4f8f-9c17-954d4d4c3438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:31.717071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf1864-41fe-4f8f-9c17-954d4d4c3438 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:31.717742 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf1864-41fe-4f8f-9c17-954d4d4c3438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:31.719347 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf1864-41fe-4f8f-9c17-954d4d4c3438 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:31.731020 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1144/2307] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:58:31.735137 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094c7ed-5835-49a2-a84f-75c6d4626844 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:31.745808 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094c7ed-5835-49a2-a84f-75c6d4626844 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:31.751184 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b241e1c-778b-4ba7-8659-cd203e678fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:31.752567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b241e1c-778b-4ba7-8659-cd203e678fcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:31.753081 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b241e1c-778b-4ba7-8659-cd203e678fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:31.753444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b241e1c-778b-4ba7-8659-cd203e678fcc admin admin] PATH_INFO: `/v3/projects/365307cd3447424cab0cca63a99352f9/users/033e245b4e214964826dd16034b610b6/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:31.775135 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b241e1c-778b-4ba7-8659-cd203e678fcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=365307cd3447424cab0cca63a99352f9, user_id=033e245b4e214964826dd16034b610b6, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:31.778088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b241e1c-778b-4ba7-8659-cd203e678fcc admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:31.792530 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1164/2308] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:58:31 2022] PUT /identity/v3/projects/365307cd3447424cab0cca63a99352f9/users/033e245b4e214964826dd16034b610b6/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:58:31.804005 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790128b5-5885-4d3f-a51c-8968a29d3de0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:31.804252 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790128b5-5885-4d3f-a51c-8968a29d3de0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:31.804531 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790128b5-5885-4d3f-a51c-8968a29d3de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:31.835681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-790128b5-5885-4d3f-a51c-8968a29d3de0 None None] MFA Rules not processed for user `033e245b4e214964826dd16034b610b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:31.836957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-790128b5-5885-4d3f-a51c-8968a29d3de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:31.922722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1145/2309] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:31.933324 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b241e1c-778b-4ba7-8659-cd203e678fcc admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:31.935172 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3b241e1c-778b-4ba7-8659-cd203e678fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:31.984717 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:32.022551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b241e1c-778b-4ba7-8659-cd203e678fcc admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:32.027287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de2e47-eca5-43d1-a0be-e3e9c69c8043 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:32.027898 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de2e47-eca5-43d1-a0be-e3e9c69c8043 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:32.028216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de2e47-eca5-43d1-a0be-e3e9c69c8043 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:32.028488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de2e47-eca5-43d1-a0be-e3e9c69c8043 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:32.038178 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de2e47-eca5-43d1-a0be-e3e9c69c8043 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:32.039604 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de2e47-eca5-43d1-a0be-e3e9c69c8043 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:32.049678 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1165/2310] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:58:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:58:33.505176 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5ceaf-5cb5-413f-9ea3-73ef555bccda None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:33.505723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5ceaf-5cb5-413f-9ea3-73ef555bccda None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:33.505723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5ceaf-5cb5-413f-9ea3-73ef555bccda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:33.527197 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c9b5ceaf-5cb5-413f-9ea3-73ef555bccda None None] MFA Rules not processed for user `033e245b4e214964826dd16034b610b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:33.528440 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c9b5ceaf-5cb5-413f-9ea3-73ef555bccda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:33.535579 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1146/2311] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:58:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:36.048068 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9170346-dcb1-402c-bd62-12693579a633 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:36.048840 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9170346-dcb1-402c-bd62-12693579a633 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:36.048840 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9170346-dcb1-402c-bd62-12693579a633 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:36.049982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1166/2312] 10.222.0.15 () {54 vars in 921 bytes} [Fri Sep 9 20:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 09 20:58:36.055919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1fb04-8ddc-4893-9408-bf45db3682f8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:36.056486 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1fb04-8ddc-4893-9408-bf45db3682f8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:36.056698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1fb04-8ddc-4893-9408-bf45db3682f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:36.089351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3ae1fb04-8ddc-4893-9408-bf45db3682f8 None None] MFA Rules not processed for user `dc210376e57a41e6b3812110db249099`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:36.091239 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3ae1fb04-8ddc-4893-9408-bf45db3682f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:36.137210 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:36.177111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1147/2313] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Sep 9 20:58:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:36.189803 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9170346-dcb1-402c-bd62-12693579a633 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:36.201850 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d9170346-dcb1-402c-bd62-12693579a633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:36.281598 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9170346-dcb1-402c-bd62-12693579a633 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:36.292074 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1084fe5-3a55-4e62-9aae-25e6228deb93 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d298efe48464956b7a03cba1001060b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:36.292700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1084fe5-3a55-4e62-9aae-25e6228deb93 service glance] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:36.292975 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1084fe5-3a55-4e62-9aae-25e6228deb93 service glance] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:36.293245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1084fe5-3a55-4e62-9aae-25e6228deb93 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:36.309479 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1084fe5-3a55-4e62-9aae-25e6228deb93 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:36.313338 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1084fe5-3a55-4e62-9aae-25e6228deb93 service glance] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:36.329264 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1167/2314] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:58:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:58:36.411340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00505fbc-44ce-4586-a953-c1f2650472f4 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:36.412313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00505fbc-44ce-4586-a953-c1f2650472f4 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:36.412615 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00505fbc-44ce-4586-a953-c1f2650472f4 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:36.414011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1148/2315] 10.222.0.15 () {54 vars in 921 bytes} [Fri Sep 9 20:58:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:58:36.419316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af251e-1c7b-4a64-a471-6c72dceca96d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:36.419589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af251e-1c7b-4a64-a471-6c72dceca96d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:36.419853 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af251e-1c7b-4a64-a471-6c72dceca96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:36.442200 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-58af251e-1c7b-4a64-a471-6c72dceca96d None None] MFA Rules not processed for user `27e2be33ebdc4c5a97befcbd4d09ee4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:36.443425 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-58af251e-1c7b-4a64-a471-6c72dceca96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:36.522507 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1168/2316] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Sep 9 20:58:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:58:36.537486 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00505fbc-44ce-4586-a953-c1f2650472f4 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:36.539217 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-00505fbc-44ce-4586-a953-c1f2650472f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:36.556146 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00505fbc-44ce-4586-a953-c1f2650472f4 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:36.566639 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39368a-2d6b-45ff-9417-ad85e9e4650d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:36.567792 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39368a-2d6b-45ff-9417-ad85e9e4650d service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:36.567792 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39368a-2d6b-45ff-9417-ad85e9e4650d service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:36.568083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39368a-2d6b-45ff-9417-ad85e9e4650d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:36.577538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39368a-2d6b-45ff-9417-ad85e9e4650d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:36.578981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f39368a-2d6b-45ff-9417-ad85e9e4650d service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:36.588160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1149/2317] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:58:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:58:36.687816 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052aedf-3d36-4d73-b6d1-c8c21da4064d None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:36.688137 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052aedf-3d36-4d73-b6d1-c8c21da4064d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:36.688418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052aedf-3d36-4d73-b6d1-c8c21da4064d None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:36.690451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1169/2318] 10.222.0.15 () {54 vars in 921 bytes} [Fri Sep 9 20:58:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 20:58:36.695787 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699405df-b763-4ca0-aec2-4403a8e78903 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:36.696103 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699405df-b763-4ca0-aec2-4403a8e78903 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:36.696383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699405df-b763-4ca0-aec2-4403a8e78903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:36.716658 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-699405df-b763-4ca0-aec2-4403a8e78903 None None] MFA Rules not processed for user `dc210376e57a41e6b3812110db249099`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:36.718340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-699405df-b763-4ca0-aec2-4403a8e78903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:36.731181 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1150/2319] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Sep 9 20:58:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:36.742279 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052aedf-3d36-4d73-b6d1-c8c21da4064d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:36.754240 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052aedf-3d36-4d73-b6d1-c8c21da4064d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:36.757760 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce83ce-9e3c-4265-bf1f-08ddbe74ef6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:36.758352 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce83ce-9e3c-4265-bf1f-08ddbe74ef6a service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:36.758633 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce83ce-9e3c-4265-bf1f-08ddbe74ef6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:36.758907 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce83ce-9e3c-4265-bf1f-08ddbe74ef6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:36.769154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce83ce-9e3c-4265-bf1f-08ddbe74ef6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:36.770593 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce83ce-9e3c-4265-bf1f-08ddbe74ef6a service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:36.781198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1170/2320] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:58:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:58:42.817059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e0414-430e-498b-b33d-1e9d3ade495c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:42.817584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e0414-430e-498b-b33d-1e9d3ade495c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:42.817764 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e0414-430e-498b-b33d-1e9d3ade495c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:42.841590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4a4e0414-430e-498b-b33d-1e9d3ade495c None None] MFA Rules not processed for user `e51ae6959aac49898e75c6786c5dbdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:42.842793 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4a4e0414-430e-498b-b33d-1e9d3ade495c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:42.946956 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1151/2321] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Sep 9 20:58:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:58:42.962793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce83ce-9e3c-4265-bf1f-08ddbe74ef6a service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:42.965006 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c3ce83ce-9e3c-4265-bf1f-08ddbe74ef6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:43.016894 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cc944-8852-47b3-9c31-e744df0d7dec None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:43.017857 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cc944-8852-47b3-9c31-e744df0d7dec None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:43.018251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793cc944-8852-47b3-9c31-e744df0d7dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:43.043595 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-793cc944-8852-47b3-9c31-e744df0d7dec None None] MFA Rules not processed for user `e51ae6959aac49898e75c6786c5dbdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:58:43.046620 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-793cc944-8852-47b3-9c31-e744df0d7dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:58:43.073371 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1152/2322] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Sep 9 20:58:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:58:43.098412 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cc944-8852-47b3-9c31-e744df0d7dec None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:58:43.114877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793cc944-8852-47b3-9c31-e744df0d7dec None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:43.120337 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3aa56-59eb-4955-81d1-489f2ae618c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9570eaa112de460cb9e371278bfb300b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:43.120973 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3aa56-59eb-4955-81d1-489f2ae618c1 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:43.121294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3aa56-59eb-4955-81d1-489f2ae618c1 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:43.121753 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3aa56-59eb-4955-81d1-489f2ae618c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:43.123215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce83ce-9e3c-4265-bf1f-08ddbe74ef6a service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:58:43.129454 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967fc5a-9e5f-4a35-ab2e-2276247b2035 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9570eaa112de460cb9e371278bfb300b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:58:43.130080 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967fc5a-9e5f-4a35-ab2e-2276247b2035 service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:58:43.130391 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967fc5a-9e5f-4a35-ab2e-2276247b2035 service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:58:43.130657 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967fc5a-9e5f-4a35-ab2e-2276247b2035 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:58:43.130893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3aa56-59eb-4955-81d1-489f2ae618c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:43.132500 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3aa56-59eb-4955-81d1-489f2ae618c1 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:43.139851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967fc5a-9e5f-4a35-ab2e-2276247b2035 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:58:43.141257 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1153/2323] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Sep 9 20:58:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 09 20:58:43.141557 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967fc5a-9e5f-4a35-ab2e-2276247b2035 service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:58:43.145802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:43.151964 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1171/2324] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Sep 9 20:58:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 20:58:53.137484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=56 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:58:53.152366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:59:00.771554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9feb4-4131-414c-9647-3ec0b31fd585 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:00.772150 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9feb4-4131-414c-9647-3ec0b31fd585 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:00.772938 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9feb4-4131-414c-9647-3ec0b31fd585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:00.798846 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-afc9feb4-4131-414c-9647-3ec0b31fd585 None None] MFA Rules not processed for user `e51ae6959aac49898e75c6786c5dbdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:00.800134 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-afc9feb4-4131-414c-9647-3ec0b31fd585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:00.811094 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1154/2325] 10.222.0.15 () {58 vars in 967 bytes} [Fri Sep 9 20:59:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:00.825788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967fc5a-9e5f-4a35-ab2e-2276247b2035 service swift] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:00.837747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967fc5a-9e5f-4a35-ab2e-2276247b2035 service swift] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:00.843194 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e451b-feac-49f8-b4a1-9414a1c8b8b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9570eaa112de460cb9e371278bfb300b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:00.843968 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e451b-feac-49f8-b4a1-9414a1c8b8b7 service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:00.844115 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e451b-feac-49f8-b4a1-9414a1c8b8b7 service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:00.844523 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e451b-feac-49f8-b4a1-9414a1c8b8b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:00.857082 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e451b-feac-49f8-b4a1-9414a1c8b8b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:00.859839 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e451b-feac-49f8-b4a1-9414a1c8b8b7 service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:00.874923 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1172/2326] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Sep 9 20:59:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 20:59:01.581048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac78fc3-545f-4ad8-be12-abf9a8f2ca46 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:01.581380 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac78fc3-545f-4ad8-be12-abf9a8f2ca46 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:01.581693 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac78fc3-545f-4ad8-be12-abf9a8f2ca46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:01.601669 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-eac78fc3-545f-4ad8-be12-abf9a8f2ca46 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:01.602960 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-eac78fc3-545f-4ad8-be12-abf9a8f2ca46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:01.666734 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1155/2327] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Sep 9 20:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:01.680764 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e451b-feac-49f8-b4a1-9414a1c8b8b7 service swift] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:01.682184 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-029e451b-feac-49f8-b4a1-9414a1c8b8b7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:01.698046 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e451b-feac-49f8-b4a1-9414a1c8b8b7 service swift] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:01.703601 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0bab5-3a4f-4fee-80f8-c32e28f74b81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:01.704290 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0bab5-3a4f-4fee-80f8-c32e28f74b81 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:01.704689 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0bab5-3a4f-4fee-80f8-c32e28f74b81 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:01.704967 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0bab5-3a4f-4fee-80f8-c32e28f74b81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:01.714801 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0bab5-3a4f-4fee-80f8-c32e28f74b81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:01.716542 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0bab5-3a4f-4fee-80f8-c32e28f74b81 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:01.726988 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1173/2328] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:59:02.941730 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac78fc3-545f-4ad8-be12-abf9a8f2ca46 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:02.943356 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-eac78fc3-545f-4ad8-be12-abf9a8f2ca46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:02.955884 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac78fc3-545f-4ad8-be12-abf9a8f2ca46 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:02.960685 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cb858-89b1-483f-84d2-ba3bb95cab09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:02.961350 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cb858-89b1-483f-84d2-ba3bb95cab09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:02.961673 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cb858-89b1-483f-84d2-ba3bb95cab09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:02.961972 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cb858-89b1-483f-84d2-ba3bb95cab09 admin admin] PATH_INFO: `/v3/users/e5a63070e7f342dd911b45bf348c9da3` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:02.963136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cb858-89b1-483f-84d2-ba3bb95cab09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5a63070e7f342dd911b45bf348c9da3)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:02.965147 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cb858-89b1-483f-84d2-ba3bb95cab09 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:03.012159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-374cb858-89b1-483f-84d2-ba3bb95cab09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5a63070e7f342dd911b45bf348c9da3'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:03.021142 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-374cb858-89b1-483f-84d2-ba3bb95cab09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5a63070e7f342dd911b45bf348c9da3'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:03.021775 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-374cb858-89b1-483f-84d2-ba3bb95cab09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5a63070e7f342dd911b45bf348c9da3'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:03.022401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-374cb858-89b1-483f-84d2-ba3bb95cab09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5a63070e7f342dd911b45bf348c9da3'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:03.029846 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-374cb858-89b1-483f-84d2-ba3bb95cab09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5a63070e7f342dd911b45bf348c9da3'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:03.049832 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1156/2329] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:59:02 2022] DELETE /identity/v3/users/e5a63070e7f342dd911b45bf348c9da3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:59:03.228281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0bab5-3a4f-4fee-80f8-c32e28f74b81 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:03.239142 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0bab5-3a4f-4fee-80f8-c32e28f74b81 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:03.319761 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f8051-eabb-4573-8b71-8d38342abdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:03.320460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f8051-eabb-4573-8b71-8d38342abdaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:03.320898 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f8051-eabb-4573-8b71-8d38342abdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:03.321298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f8051-eabb-4573-8b71-8d38342abdaa admin admin] PATH_INFO: `/v3/projects/5c714fb96d104e308f4595eef83b3c73` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:03.322519 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f8051-eabb-4573-8b71-8d38342abdaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c714fb96d104e308f4595eef83b3c73)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:03.324507 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f8051-eabb-4573-8b71-8d38342abdaa admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:03.374520 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a49f8051-eabb-4573-8b71-8d38342abdaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c714fb96d104e308f4595eef83b3c73', 'request_id': 'req-a49f8051-eabb-4573-8b71-8d38342abdaa'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:03.383007 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a49f8051-eabb-4573-8b71-8d38342abdaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c714fb96d104e308f4595eef83b3c73', 'request_id': 'req-a49f8051-eabb-4573-8b71-8d38342abdaa'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:03.388738 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a49f8051-eabb-4573-8b71-8d38342abdaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c714fb96d104e308f4595eef83b3c73', 'request_id': 'req-a49f8051-eabb-4573-8b71-8d38342abdaa'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:03.400358 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a49f8051-eabb-4573-8b71-8d38342abdaa admin admin] The token cache is being invalidate because project 5c714fb96d104e308f4595eef83b3c73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:59:03.400662 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a49f8051-eabb-4573-8b71-8d38342abdaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:03.401290 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a49f8051-eabb-4573-8b71-8d38342abdaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:03.402770 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1174/2330] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:59:03 2022] DELETE /identity/v3/projects/5c714fb96d104e308f4595eef83b3c73 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:59:03.408442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555219c-0ad7-41f5-90ae-6fed8f8418df None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:03.408788 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555219c-0ad7-41f5-90ae-6fed8f8418df None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:03.409096 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6555219c-0ad7-41f5-90ae-6fed8f8418df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:03.430147 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6555219c-0ad7-41f5-90ae-6fed8f8418df None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:03.431648 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6555219c-0ad7-41f5-90ae-6fed8f8418df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:03.519217 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1157/2331] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:03.526465 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea534e-a4b4-4898-9ac5-83398bf0358a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:03.526818 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea534e-a4b4-4898-9ac5-83398bf0358a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:03.527158 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea534e-a4b4-4898-9ac5-83398bf0358a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:03.550675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-20ea534e-a4b4-4898-9ac5-83398bf0358a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:03.552046 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-20ea534e-a4b4-4898-9ac5-83398bf0358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:03.561077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1175/2332] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:03.565754 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555219c-0ad7-41f5-90ae-6fed8f8418df None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:03.576288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6555219c-0ad7-41f5-90ae-6fed8f8418df None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:03.583155 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616363a-5419-4611-818c-7a59eb7354cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:03.583842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616363a-5419-4611-818c-7a59eb7354cd admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:03.584342 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616363a-5419-4611-818c-7a59eb7354cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:03.584657 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616363a-5419-4611-818c-7a59eb7354cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:03.585346 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616363a-5419-4611-818c-7a59eb7354cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:59:03.585672 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616363a-5419-4611-818c-7a59eb7354cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:03.587334 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616363a-5419-4611-818c-7a59eb7354cd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:03.589098 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:59:03.620071 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea534e-a4b4-4898-9ac5-83398bf0358a None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:03.620198 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1158/2333] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:59:03.626904 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea534e-a4b4-4898-9ac5-83398bf0358a None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:03.631325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71351131-c155-480c-9bb4-543e058a6263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:03.631919 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71351131-c155-480c-9bb4-543e058a6263 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:03.632229 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71351131-c155-480c-9bb4-543e058a6263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:03.632499 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71351131-c155-480c-9bb4-543e058a6263 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:03.633125 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71351131-c155-480c-9bb4-543e058a6263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:03.635022 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71351131-c155-480c-9bb4-543e058a6263 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:03.661989 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1176/2334] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:59:03 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:59:03.666099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616363a-5419-4611-818c-7a59eb7354cd admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:03.676982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616363a-5419-4611-818c-7a59eb7354cd admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:03.733042 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fefdf-ac1e-4ed9-a8b4-44afb7bc09d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:03.733653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fefdf-ac1e-4ed9-a8b4-44afb7bc09d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:03.733993 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fefdf-ac1e-4ed9-a8b4-44afb7bc09d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:03.734296 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fefdf-ac1e-4ed9-a8b4-44afb7bc09d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:03.736113 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fefdf-ac1e-4ed9-a8b4-44afb7bc09d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:03.738079 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fefdf-ac1e-4ed9-a8b4-44afb7bc09d2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:03.759642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1159/2335] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:59:03 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:59:03.763734 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71351131-c155-480c-9bb4-543e058a6263 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:03.774015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71351131-c155-480c-9bb4-543e058a6263 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:03.778632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9bb6a-1b5b-478e-94da-73e06a37c996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:03.779208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9bb6a-1b5b-478e-94da-73e06a37c996 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:03.779487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9bb6a-1b5b-478e-94da-73e06a37c996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:03.779757 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9bb6a-1b5b-478e-94da-73e06a37c996 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:03.780432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9bb6a-1b5b-478e-94da-73e06a37c996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:03.782073 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9bb6a-1b5b-478e-94da-73e06a37c996 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:03.792236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1177/2336] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:59:03.795847 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fefdf-ac1e-4ed9-a8b4-44afb7bc09d2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:03.806414 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fefdf-ac1e-4ed9-a8b4-44afb7bc09d2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:03.811009 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdd63e-1bed-4266-a316-8e841a8ad01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:03.811643 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdd63e-1bed-4266-a316-8e841a8ad01a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:03.811873 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdd63e-1bed-4266-a316-8e841a8ad01a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:03.812187 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdd63e-1bed-4266-a316-8e841a8ad01a admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:03.812814 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cdd63e-1bed-4266-a316-8e841a8ad01a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:03.815055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cdd63e-1bed-4266-a316-8e841a8ad01a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:03.825637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1160/2337] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:59:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:59:03.829884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9bb6a-1b5b-478e-94da-73e06a37c996 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:03.839730 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9bb6a-1b5b-478e-94da-73e06a37c996 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:03.844720 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2725906-645d-49f7-98a0-a1c44d8d14c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:03.845525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2725906-645d-49f7-98a0-a1c44d8d14c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:03.845800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2725906-645d-49f7-98a0-a1c44d8d14c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:03.846099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2725906-645d-49f7-98a0-a1c44d8d14c3 admin admin] PATH_INFO: `/v3/projects/66be2d1f4ca54fcdb5e8231d80d17efb/users/4aa0da80caab4df98697b597bea20bea/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:03.861092 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2725906-645d-49f7-98a0-a1c44d8d14c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66be2d1f4ca54fcdb5e8231d80d17efb, user_id=4aa0da80caab4df98697b597bea20bea, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:03.863732 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2725906-645d-49f7-98a0-a1c44d8d14c3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:03.872238 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:59:03.877848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1178/2338] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:59:03 2022] PUT /identity/v3/projects/66be2d1f4ca54fcdb5e8231d80d17efb/users/4aa0da80caab4df98697b597bea20bea/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 20:59:03.889587 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f0383-a178-4467-95f7-bbf5474f429f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:03.889896 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f0383-a178-4467-95f7-bbf5474f429f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:03.890169 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f0383-a178-4467-95f7-bbf5474f429f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:03.918044 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-650f0383-a178-4467-95f7-bbf5474f429f None None] MFA Rules not processed for user `4aa0da80caab4df98697b597bea20bea`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:03.919260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-650f0383-a178-4467-95f7-bbf5474f429f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:03.984802 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1161/2339] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:59:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:03.997248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2725906-645d-49f7-98a0-a1c44d8d14c3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:03.998936 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c2725906-645d-49f7-98a0-a1c44d8d14c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:04.055027 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2725906-645d-49f7-98a0-a1c44d8d14c3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:04.058585 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cd3b4-caa6-466e-b906-fff857da8304 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d298efe48464956b7a03cba1001060b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:04.059184 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cd3b4-caa6-466e-b906-fff857da8304 service glance] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:04.059463 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cd3b4-caa6-466e-b906-fff857da8304 service glance] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:04.059737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237cd3b4-caa6-466e-b906-fff857da8304 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:04.068327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cd3b4-caa6-466e-b906-fff857da8304 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:04.069759 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237cd3b4-caa6-466e-b906-fff857da8304 service glance] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:04.078609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1179/2340] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:59:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 20:59:06.707002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9e8bf-b67d-402e-99d4-f71d51c4dfb9 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:06.707511 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9e8bf-b67d-402e-99d4-f71d51c4dfb9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:06.707593 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9e8bf-b67d-402e-99d4-f71d51c4dfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:06.731773 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2fe9e8bf-b67d-402e-99d4-f71d51c4dfb9 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:06.733310 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2fe9e8bf-b67d-402e-99d4-f71d51c4dfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:06.809607 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1162/2341] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Sep 9 20:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:06.824912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cd3b4-caa6-466e-b906-fff857da8304 service glance] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:06.826349 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-237cd3b4-caa6-466e-b906-fff857da8304 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:06.911793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237cd3b4-caa6-466e-b906-fff857da8304 service glance] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:06.918351 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cb722-b28a-477e-83ef-d32dc3926a40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:06.918957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cb722-b28a-477e-83ef-d32dc3926a40 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:06.919230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cb722-b28a-477e-83ef-d32dc3926a40 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:06.919498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cb722-b28a-477e-83ef-d32dc3926a40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:06.929562 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cb722-b28a-477e-83ef-d32dc3926a40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:06.931167 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cb722-b28a-477e-83ef-d32dc3926a40 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:06.941417 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1180/2342] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:59:07.387436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9e8bf-b67d-402e-99d4-f71d51c4dfb9 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:07.389487 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2fe9e8bf-b67d-402e-99d4-f71d51c4dfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:07.395941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:59:07.468220 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9e8bf-b67d-402e-99d4-f71d51c4dfb9 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:07.473835 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051dc5c-cd9b-486a-9c6f-eac827265109 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc28d9a1b3f4feca0deeb5f266f8b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:07.474435 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051dc5c-cd9b-486a-9c6f-eac827265109 service placement] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:07.474712 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051dc5c-cd9b-486a-9c6f-eac827265109 service placement] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:07.474980 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051dc5c-cd9b-486a-9c6f-eac827265109 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:07.476671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c051dc5c-cd9b-486a-9c6f-eac827265109 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:07.488535 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051dc5c-cd9b-486a-9c6f-eac827265109 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:07.490178 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051dc5c-cd9b-486a-9c6f-eac827265109 service placement] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:07.500141 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1163/2343] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:59:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:59:08.436064 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa4d9e-881a-4aed-90bf-1cdf845ca9cb None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:08.436527 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa4d9e-881a-4aed-90bf-1cdf845ca9cb None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:08.436641 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa4d9e-881a-4aed-90bf-1cdf845ca9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:08.457286 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d5fa4d9e-881a-4aed-90bf-1cdf845ca9cb None None] MFA Rules not processed for user `e51ae6959aac49898e75c6786c5dbdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:08.458488 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d5fa4d9e-881a-4aed-90bf-1cdf845ca9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:08.513186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1181/2344] 10.222.0.15 () {58 vars in 967 bytes} [Fri Sep 9 20:59:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:08.526373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051dc5c-cd9b-486a-9c6f-eac827265109 service placement] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:08.527764 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c051dc5c-cd9b-486a-9c6f-eac827265109 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:08.598228 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051dc5c-cd9b-486a-9c6f-eac827265109 service placement] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:08.603518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eadaae-f57f-4f4b-8cac-b7263d47bbdb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9570eaa112de460cb9e371278bfb300b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:08.604140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eadaae-f57f-4f4b-8cac-b7263d47bbdb service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:08.604418 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eadaae-f57f-4f4b-8cac-b7263d47bbdb service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:08.604687 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eadaae-f57f-4f4b-8cac-b7263d47bbdb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:08.613337 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eadaae-f57f-4f4b-8cac-b7263d47bbdb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:08.614934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eadaae-f57f-4f4b-8cac-b7263d47bbdb service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:08.622893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1164/2345] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Sep 9 20:59:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 20:59:11.715357 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9548a62-0eb5-416f-85bf-63db8135c9b6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:11.715834 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9548a62-0eb5-416f-85bf-63db8135c9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:11.715947 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9548a62-0eb5-416f-85bf-63db8135c9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:11.750995 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a9548a62-0eb5-416f-85bf-63db8135c9b6 None None] MFA Rules not processed for user `e51ae6959aac49898e75c6786c5dbdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:11.752309 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a9548a62-0eb5-416f-85bf-63db8135c9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:11.764160 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1182/2346] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Sep 9 20:59:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:11.775560 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eadaae-f57f-4f4b-8cac-b7263d47bbdb service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:11.787207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eadaae-f57f-4f4b-8cac-b7263d47bbdb service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:11.793198 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9328c-7286-4ca3-b703-78a6ae7b3fcc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9570eaa112de460cb9e371278bfb300b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:11.793753 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9328c-7286-4ca3-b703-78a6ae7b3fcc service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:11.794035 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9328c-7286-4ca3-b703-78a6ae7b3fcc service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:11.794309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9328c-7286-4ca3-b703-78a6ae7b3fcc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:11.805877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9328c-7286-4ca3-b703-78a6ae7b3fcc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:11.807503 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9328c-7286-4ca3-b703-78a6ae7b3fcc service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:11.820085 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1165/2347] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Sep 9 20:59:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 20:59:12.045020 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77348059-51bf-4ecc-86fe-be8c508e8bcf None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:12.045239 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77348059-51bf-4ecc-86fe-be8c508e8bcf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:12.045521 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77348059-51bf-4ecc-86fe-be8c508e8bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:12.074539 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-77348059-51bf-4ecc-86fe-be8c508e8bcf None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:12.076365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-77348059-51bf-4ecc-86fe-be8c508e8bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:12.085422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1183/2348] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Sep 9 20:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:12.102830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9328c-7286-4ca3-b703-78a6ae7b3fcc service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:12.104333 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b5f9328c-7286-4ca3-b703-78a6ae7b3fcc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:12.123599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9328c-7286-4ca3-b703-78a6ae7b3fcc service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:12.130503 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccbc29-245e-4463-873b-56397bb42f91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:12.131076 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccbc29-245e-4463-873b-56397bb42f91 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:12.131353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccbc29-245e-4463-873b-56397bb42f91 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:12.131650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccbc29-245e-4463-873b-56397bb42f91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:12.140781 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccbc29-245e-4463-873b-56397bb42f91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:12.143530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccbc29-245e-4463-873b-56397bb42f91 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:12.154160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1166/2349] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:59:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:59:12.400896 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477f7a3-be04-4039-89b6-05667e191193 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:12.401183 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477f7a3-be04-4039-89b6-05667e191193 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:12.401456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477f7a3-be04-4039-89b6-05667e191193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:12.420590 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8477f7a3-be04-4039-89b6-05667e191193 None None] MFA Rules not processed for user `e51ae6959aac49898e75c6786c5dbdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:12.421769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8477f7a3-be04-4039-89b6-05667e191193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:12.428795 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1184/2350] 10.222.0.15 () {58 vars in 967 bytes} [Fri Sep 9 20:59:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:12.441657 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccbc29-245e-4463-873b-56397bb42f91 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:12.452823 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccbc29-245e-4463-873b-56397bb42f91 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:12.458427 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff6a92-d2cd-4cb1-bb90-30f4c1d88fd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9570eaa112de460cb9e371278bfb300b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:12.459025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff6a92-d2cd-4cb1-bb90-30f4c1d88fd8 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:12.459307 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff6a92-d2cd-4cb1-bb90-30f4c1d88fd8 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:12.459582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff6a92-d2cd-4cb1-bb90-30f4c1d88fd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:12.467440 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff6a92-d2cd-4cb1-bb90-30f4c1d88fd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:12.469054 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff6a92-d2cd-4cb1-bb90-30f4c1d88fd8 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:12.476941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1167/2351] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Sep 9 20:59:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 20:59:12.714969 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ee261-9ede-49bf-a3e2-816614933782 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:12.715251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ee261-9ede-49bf-a3e2-816614933782 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:12.715524 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ee261-9ede-49bf-a3e2-816614933782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:12.734847 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e89ee261-9ede-49bf-a3e2-816614933782 None None] MFA Rules not processed for user `e51ae6959aac49898e75c6786c5dbdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:12.736588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e89ee261-9ede-49bf-a3e2-816614933782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:12.743638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1185/2352] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Sep 9 20:59:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:12.757136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff6a92-d2cd-4cb1-bb90-30f4c1d88fd8 service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:12.769261 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff6a92-d2cd-4cb1-bb90-30f4c1d88fd8 service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:12.775647 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf64abb-5e9d-4662-9f43-6264a56e109e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9570eaa112de460cb9e371278bfb300b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:12.776452 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf64abb-5e9d-4662-9f43-6264a56e109e service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:12.776742 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf64abb-5e9d-4662-9f43-6264a56e109e service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:12.778601 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf64abb-5e9d-4662-9f43-6264a56e109e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:12.788332 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf64abb-5e9d-4662-9f43-6264a56e109e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:12.789946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf64abb-5e9d-4662-9f43-6264a56e109e service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:12.798668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1168/2353] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Sep 9 20:59:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 20:59:13.142843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad73a41-cb9c-494e-b3d8-34a2c01b5e45 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:13.143171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad73a41-cb9c-494e-b3d8-34a2c01b5e45 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:13.143453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad73a41-cb9c-494e-b3d8-34a2c01b5e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:13.156756 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:59:13.163146 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-dad73a41-cb9c-494e-b3d8-34a2c01b5e45 None None] MFA Rules not processed for user `e51ae6959aac49898e75c6786c5dbdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:13.164389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dad73a41-cb9c-494e-b3d8-34a2c01b5e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:13.171383 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1186/2354] 10.222.0.15 () {58 vars in 967 bytes} [Fri Sep 9 20:59:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:13.183779 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf64abb-5e9d-4662-9f43-6264a56e109e service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:13.194650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf64abb-5e9d-4662-9f43-6264a56e109e service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:13.199931 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d22993-0d9b-48a0-a557-5294c4f9f5e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9570eaa112de460cb9e371278bfb300b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:13.200565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d22993-0d9b-48a0-a557-5294c4f9f5e3 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:13.200850 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d22993-0d9b-48a0-a557-5294c4f9f5e3 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:13.201128 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d22993-0d9b-48a0-a557-5294c4f9f5e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:13.209973 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d22993-0d9b-48a0-a557-5294c4f9f5e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:13.211585 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d22993-0d9b-48a0-a557-5294c4f9f5e3 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:13.219770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1169/2355] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Sep 9 20:59:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 20:59:15.143459 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115e251-ec38-437b-badb-0363a38a3818 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:15.143964 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115e251-ec38-437b-badb-0363a38a3818 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:15.143964 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115e251-ec38-437b-badb-0363a38a3818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:15.164052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7115e251-ec38-437b-badb-0363a38a3818 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:15.165260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7115e251-ec38-437b-badb-0363a38a3818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:15.173113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1187/2356] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Sep 9 20:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:15.197464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d22993-0d9b-48a0-a557-5294c4f9f5e3 service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:15.209843 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d22993-0d9b-48a0-a557-5294c4f9f5e3 service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:15.215427 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf484662-b5bb-4fc3-8632-3e69841f1164 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:15.216048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf484662-b5bb-4fc3-8632-3e69841f1164 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:15.216330 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf484662-b5bb-4fc3-8632-3e69841f1164 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:15.216599 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf484662-b5bb-4fc3-8632-3e69841f1164 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:15.225251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf484662-b5bb-4fc3-8632-3e69841f1164 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:15.226816 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf484662-b5bb-4fc3-8632-3e69841f1164 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:15.236322 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1170/2357] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:59:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:59:15.373270 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115e251-ec38-437b-badb-0363a38a3818 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:15.375177 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7115e251-ec38-437b-badb-0363a38a3818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:15.388237 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115e251-ec38-437b-badb-0363a38a3818 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:15.393880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b4285-8f47-488b-92e6-3f8e206bdca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:15.394437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b4285-8f47-488b-92e6-3f8e206bdca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:15.394737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b4285-8f47-488b-92e6-3f8e206bdca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:15.395008 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b4285-8f47-488b-92e6-3f8e206bdca3 admin admin] PATH_INFO: `/v3/users/033e245b4e214964826dd16034b610b6` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:15.396168 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b4285-8f47-488b-92e6-3f8e206bdca3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=033e245b4e214964826dd16034b610b6)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:15.398101 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b4285-8f47-488b-92e6-3f8e206bdca3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:15.448729 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-852b4285-8f47-488b-92e6-3f8e206bdca3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '033e245b4e214964826dd16034b610b6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:15.456940 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-852b4285-8f47-488b-92e6-3f8e206bdca3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '033e245b4e214964826dd16034b610b6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:15.469451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-852b4285-8f47-488b-92e6-3f8e206bdca3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '033e245b4e214964826dd16034b610b6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:15.470731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-852b4285-8f47-488b-92e6-3f8e206bdca3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '033e245b4e214964826dd16034b610b6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:15.471479 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-852b4285-8f47-488b-92e6-3f8e206bdca3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '033e245b4e214964826dd16034b610b6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:15.483472 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1188/2358] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:59:15 2022] DELETE /identity/v3/users/033e245b4e214964826dd16034b610b6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:59:15.488545 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59202827-c0bf-4dad-be10-e7d02abce6d9 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:15.488829 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59202827-c0bf-4dad-be10-e7d02abce6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:15.489101 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59202827-c0bf-4dad-be10-e7d02abce6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:15.496133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:59:15.509741 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-59202827-c0bf-4dad-be10-e7d02abce6d9 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:15.510938 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-59202827-c0bf-4dad-be10-e7d02abce6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:15.570139 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1171/2359] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:15.580300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b4285-8f47-488b-92e6-3f8e206bdca3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:15.581893 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-852b4285-8f47-488b-92e6-3f8e206bdca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:15.644613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b4285-8f47-488b-92e6-3f8e206bdca3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:15.648205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2efb1-ce20-4f9c-8591-3ad899f68b7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:15.648817 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2efb1-ce20-4f9c-8591-3ad899f68b7a service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:15.649100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2efb1-ce20-4f9c-8591-3ad899f68b7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:15.649373 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2efb1-ce20-4f9c-8591-3ad899f68b7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:15.659280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2efb1-ce20-4f9c-8591-3ad899f68b7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:15.661062 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2efb1-ce20-4f9c-8591-3ad899f68b7a service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:15.670399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1189/2360] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:59:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:59:15.837331 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59202827-c0bf-4dad-be10-e7d02abce6d9 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:15.838970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-59202827-c0bf-4dad-be10-e7d02abce6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:15.852526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59202827-c0bf-4dad-be10-e7d02abce6d9 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:15.857218 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e1506-b335-4eba-b6d2-8fcae427cf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:15.857924 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e1506-b335-4eba-b6d2-8fcae427cf76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:15.858208 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e1506-b335-4eba-b6d2-8fcae427cf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:15.858482 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e1506-b335-4eba-b6d2-8fcae427cf76 admin admin] PATH_INFO: `/v3/projects/365307cd3447424cab0cca63a99352f9` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:15.860312 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e1506-b335-4eba-b6d2-8fcae427cf76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=365307cd3447424cab0cca63a99352f9)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:15.862322 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e1506-b335-4eba-b6d2-8fcae427cf76 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:15.915557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-355e1506-b335-4eba-b6d2-8fcae427cf76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '365307cd3447424cab0cca63a99352f9', 'request_id': 'req-355e1506-b335-4eba-b6d2-8fcae427cf76'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:15.923768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-355e1506-b335-4eba-b6d2-8fcae427cf76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '365307cd3447424cab0cca63a99352f9', 'request_id': 'req-355e1506-b335-4eba-b6d2-8fcae427cf76'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:15.929593 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-355e1506-b335-4eba-b6d2-8fcae427cf76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '365307cd3447424cab0cca63a99352f9', 'request_id': 'req-355e1506-b335-4eba-b6d2-8fcae427cf76'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:15.941339 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-355e1506-b335-4eba-b6d2-8fcae427cf76 admin admin] The token cache is being invalidate because project 365307cd3447424cab0cca63a99352f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:59:15.941793 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-355e1506-b335-4eba-b6d2-8fcae427cf76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:15.942439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-355e1506-b335-4eba-b6d2-8fcae427cf76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:15.943892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1172/2361] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:59:15 2022] DELETE /identity/v3/projects/365307cd3447424cab0cca63a99352f9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:59:19.351458 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a5bbf-7b2f-4cb8-afbc-26919ae1cffe None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:19.352236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a5bbf-7b2f-4cb8-afbc-26919ae1cffe None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:19.352236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a5bbf-7b2f-4cb8-afbc-26919ae1cffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:19.379387 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ee8a5bbf-7b2f-4cb8-afbc-26919ae1cffe None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:19.380667 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ee8a5bbf-7b2f-4cb8-afbc-26919ae1cffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:19.448993 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1190/2362] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Sep 9 20:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:19.551589 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e1506-b335-4eba-b6d2-8fcae427cf76 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:19.553067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-355e1506-b335-4eba-b6d2-8fcae427cf76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:19.651741 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e1506-b335-4eba-b6d2-8fcae427cf76 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:19.658050 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb8413-f271-4139-9c96-38bc8661ac84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:19.658683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb8413-f271-4139-9c96-38bc8661ac84 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:19.658971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb8413-f271-4139-9c96-38bc8661ac84 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:19.659251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb8413-f271-4139-9c96-38bc8661ac84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:19.669284 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb8413-f271-4139-9c96-38bc8661ac84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:19.671063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb8413-f271-4139-9c96-38bc8661ac84 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:19.682177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1173/2363] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:59:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:59:22.498148 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6ac71-9b3e-497b-a575-40fc41c6c5a9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:22.498573 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6ac71-9b3e-497b-a575-40fc41c6c5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:22.498706 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6ac71-9b3e-497b-a575-40fc41c6c5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:22.518811 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-aed6ac71-9b3e-497b-a575-40fc41c6c5a9 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:22.520063 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aed6ac71-9b3e-497b-a575-40fc41c6c5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:22.528126 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1191/2364] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Sep 9 20:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:22.542710 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb8413-f271-4139-9c96-38bc8661ac84 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:22.546000 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-31cb8413-f271-4139-9c96-38bc8661ac84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:22.561690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb8413-f271-4139-9c96-38bc8661ac84 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:22.567944 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5ebf2-1324-4643-b06b-6d27d8fa9e39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:22.568581 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5ebf2-1324-4643-b06b-6d27d8fa9e39 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:22.568864 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5ebf2-1324-4643-b06b-6d27d8fa9e39 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:22.569140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5ebf2-1324-4643-b06b-6d27d8fa9e39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:22.577637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5ebf2-1324-4643-b06b-6d27d8fa9e39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:22.579803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5ebf2-1324-4643-b06b-6d27d8fa9e39 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:22.584015 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:59:22.591860 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1174/2365] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:59:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:59:32.478749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6ac71-9b3e-497b-a575-40fc41c6c5a9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:32.480220 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aed6ac71-9b3e-497b-a575-40fc41c6c5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:32.487215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:59:32.493628 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6ac71-9b3e-497b-a575-40fc41c6c5a9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:32.499095 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c36d43-3d37-4dad-a142-86f108de74db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:32.499717 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c36d43-3d37-4dad-a142-86f108de74db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:32.500014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c36d43-3d37-4dad-a142-86f108de74db admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:32.500290 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c36d43-3d37-4dad-a142-86f108de74db admin admin] PATH_INFO: `/v3/users/4aa0da80caab4df98697b597bea20bea` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:32.501392 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c36d43-3d37-4dad-a142-86f108de74db admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aa0da80caab4df98697b597bea20bea)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:32.503299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c36d43-3d37-4dad-a142-86f108de74db admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:32.549649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-06c36d43-3d37-4dad-a142-86f108de74db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aa0da80caab4df98697b597bea20bea'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:32.557362 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-06c36d43-3d37-4dad-a142-86f108de74db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aa0da80caab4df98697b597bea20bea'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:32.570608 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-06c36d43-3d37-4dad-a142-86f108de74db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aa0da80caab4df98697b597bea20bea'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:32.571340 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-06c36d43-3d37-4dad-a142-86f108de74db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aa0da80caab4df98697b597bea20bea'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:32.571997 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-06c36d43-3d37-4dad-a142-86f108de74db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aa0da80caab4df98697b597bea20bea'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:32.584665 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1192/2366] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:59:32 2022] DELETE /identity/v3/users/4aa0da80caab4df98697b597bea20bea => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:59:32.589962 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2a11e-1231-4020-804e-d50ed8814532 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:32.590444 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2a11e-1231-4020-804e-d50ed8814532 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:32.590552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2a11e-1231-4020-804e-d50ed8814532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:32.611006 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-49d2a11e-1231-4020-804e-d50ed8814532 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:32.612270 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-49d2a11e-1231-4020-804e-d50ed8814532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:32.675121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1175/2367] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:32.684942 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c36d43-3d37-4dad-a142-86f108de74db admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:32.686377 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-06c36d43-3d37-4dad-a142-86f108de74db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:32.742444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c36d43-3d37-4dad-a142-86f108de74db admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:32.746278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3734fb-42ee-4bfa-8ba2-868db6cc89b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:32.746898 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3734fb-42ee-4bfa-8ba2-868db6cc89b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:32.747182 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3734fb-42ee-4bfa-8ba2-868db6cc89b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:32.747458 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3734fb-42ee-4bfa-8ba2-868db6cc89b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:32.756617 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3734fb-42ee-4bfa-8ba2-868db6cc89b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:32.758090 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3734fb-42ee-4bfa-8ba2-868db6cc89b6 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:32.767563 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1193/2368] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:59:33.044163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2a11e-1231-4020-804e-d50ed8814532 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:33.045703 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-49d2a11e-1231-4020-804e-d50ed8814532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:33.060062 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2a11e-1231-4020-804e-d50ed8814532 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:33.065493 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7ae11-b257-46e5-bd1f-bae9ad9e9657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:33.066339 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7ae11-b257-46e5-bd1f-bae9ad9e9657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:33.066786 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7ae11-b257-46e5-bd1f-bae9ad9e9657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:33.067229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7ae11-b257-46e5-bd1f-bae9ad9e9657 admin admin] PATH_INFO: `/v3/projects/66be2d1f4ca54fcdb5e8231d80d17efb` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:33.069728 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7ae11-b257-46e5-bd1f-bae9ad9e9657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66be2d1f4ca54fcdb5e8231d80d17efb)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:33.073115 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7ae11-b257-46e5-bd1f-bae9ad9e9657 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:33.120719 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-37a7ae11-b257-46e5-bd1f-bae9ad9e9657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66be2d1f4ca54fcdb5e8231d80d17efb', 'request_id': 'req-37a7ae11-b257-46e5-bd1f-bae9ad9e9657'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:33.127906 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-37a7ae11-b257-46e5-bd1f-bae9ad9e9657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66be2d1f4ca54fcdb5e8231d80d17efb', 'request_id': 'req-37a7ae11-b257-46e5-bd1f-bae9ad9e9657'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:33.134521 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-37a7ae11-b257-46e5-bd1f-bae9ad9e9657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66be2d1f4ca54fcdb5e8231d80d17efb', 'request_id': 'req-37a7ae11-b257-46e5-bd1f-bae9ad9e9657'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:33.145641 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-37a7ae11-b257-46e5-bd1f-bae9ad9e9657 admin admin] The token cache is being invalidate because project 66be2d1f4ca54fcdb5e8231d80d17efb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:59:33.145928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-37a7ae11-b257-46e5-bd1f-bae9ad9e9657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:33.146550 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-37a7ae11-b257-46e5-bd1f-bae9ad9e9657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:33.148724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1176/2369] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:59:33 2022] DELETE /identity/v3/projects/66be2d1f4ca54fcdb5e8231d80d17efb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:59:33.153532 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644a958-62b3-4356-85da-37d870dd7871 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:33.153843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644a958-62b3-4356-85da-37d870dd7871 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:33.154149 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644a958-62b3-4356-85da-37d870dd7871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:33.174848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2644a958-62b3-4356-85da-37d870dd7871 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:33.176077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2644a958-62b3-4356-85da-37d870dd7871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:33.234112 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1194/2370] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:33.243058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79da51-e8be-4131-9bef-5462458cd38b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:33.243482 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79da51-e8be-4131-9bef-5462458cd38b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:33.243823 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79da51-e8be-4131-9bef-5462458cd38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:33.264147 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6b79da51-e8be-4131-9bef-5462458cd38b None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:33.265352 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6b79da51-e8be-4131-9bef-5462458cd38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:33.273264 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1177/2371] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 20:59:33.277445 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644a958-62b3-4356-85da-37d870dd7871 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:33.287411 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644a958-62b3-4356-85da-37d870dd7871 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:33.292608 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e660961-52d8-4e96-95f9-7c11cddea9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:33.293209 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e660961-52d8-4e96-95f9-7c11cddea9ed admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:33.293482 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e660961-52d8-4e96-95f9-7c11cddea9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:33.293753 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e660961-52d8-4e96-95f9-7c11cddea9ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:33.294389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e660961-52d8-4e96-95f9-7c11cddea9ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 20:59:33.294685 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e660961-52d8-4e96-95f9-7c11cddea9ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:33.296294 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e660961-52d8-4e96-95f9-7c11cddea9ed admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:33.308605 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1195/2372] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 20:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 20:59:33.313088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79da51-e8be-4131-9bef-5462458cd38b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:33.322653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79da51-e8be-4131-9bef-5462458cd38b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:33.327259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dadd62-afff-41e7-8b66-0229794a2ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:33.327857 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dadd62-afff-41e7-8b66-0229794a2ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:33.328185 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dadd62-afff-41e7-8b66-0229794a2ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:33.328493 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dadd62-afff-41e7-8b66-0229794a2ac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:33.329125 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dadd62-afff-41e7-8b66-0229794a2ac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:33.331038 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dadd62-afff-41e7-8b66-0229794a2ac7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:33.359571 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1178/2373] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 20:59:33 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 20:59:33.363456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e660961-52d8-4e96-95f9-7c11cddea9ed admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:33.371504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:59:33.375323 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e660961-52d8-4e96-95f9-7c11cddea9ed admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:33.434932 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6fc58-6345-4e7c-a9d5-dc62d6033c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:33.435545 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6fc58-6345-4e7c-a9d5-dc62d6033c31 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:33.435824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6fc58-6345-4e7c-a9d5-dc62d6033c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:33.436132 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6fc58-6345-4e7c-a9d5-dc62d6033c31 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:33.436770 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6fc58-6345-4e7c-a9d5-dc62d6033c31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:33.438688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c6fc58-6345-4e7c-a9d5-dc62d6033c31 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:33.459356 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1196/2374] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 20:59:33 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 20:59:33.463908 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dadd62-afff-41e7-8b66-0229794a2ac7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:33.473936 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dadd62-afff-41e7-8b66-0229794a2ac7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:33.479222 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b2aa7-c843-4551-adcd-142608fce3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:33.479811 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b2aa7-c843-4551-adcd-142608fce3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:33.480184 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b2aa7-c843-4551-adcd-142608fce3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:33.480457 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b2aa7-c843-4551-adcd-142608fce3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:33.481088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b2aa7-c843-4551-adcd-142608fce3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:33.482681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b2aa7-c843-4551-adcd-142608fce3e9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:33.492565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1179/2375] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:59:33.496240 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6fc58-6345-4e7c-a9d5-dc62d6033c31 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:33.506242 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6fc58-6345-4e7c-a9d5-dc62d6033c31 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:33.510871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e955d-60f9-414a-80b6-3d412a747e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:33.511461 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e955d-60f9-414a-80b6-3d412a747e47 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:33.511738 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e955d-60f9-414a-80b6-3d412a747e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:33.512028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e955d-60f9-414a-80b6-3d412a747e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:33.512661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e955d-60f9-414a-80b6-3d412a747e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:33.514262 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e955d-60f9-414a-80b6-3d412a747e47 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:33.525196 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1197/2376] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 20:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 20:59:33.529182 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b2aa7-c843-4551-adcd-142608fce3e9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:33.540012 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b2aa7-c843-4551-adcd-142608fce3e9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:33.544655 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd84ac-575b-4f75-8de7-efa4d2e5d028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:33.545308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd84ac-575b-4f75-8de7-efa4d2e5d028 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:33.545590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd84ac-575b-4f75-8de7-efa4d2e5d028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:33.545868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd84ac-575b-4f75-8de7-efa4d2e5d028 admin admin] PATH_INFO: `/v3/projects/84c8c99f6fff40269eae0aec038c3d21/users/8a99a0d60de64d2fb50df99eecae7bcc/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:33.560368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd84ac-575b-4f75-8de7-efa4d2e5d028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84c8c99f6fff40269eae0aec038c3d21, user_id=8a99a0d60de64d2fb50df99eecae7bcc, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:33.563037 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecd84ac-575b-4f75-8de7-efa4d2e5d028 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:33.575384 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1180/2377] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 20:59:33 2022] PUT /identity/v3/projects/84c8c99f6fff40269eae0aec038c3d21/users/8a99a0d60de64d2fb50df99eecae7bcc/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:59:33.587276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae7017-5555-4334-bfcc-3a55d0b6954d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:33.587563 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae7017-5555-4334-bfcc-3a55d0b6954d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:33.587837 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae7017-5555-4334-bfcc-3a55d0b6954d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:33.615115 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-76ae7017-5555-4334-bfcc-3a55d0b6954d None None] MFA Rules not processed for user `8a99a0d60de64d2fb50df99eecae7bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:33.616956 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-76ae7017-5555-4334-bfcc-3a55d0b6954d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:33.681441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1198/2378] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:59:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:33.692354 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd84ac-575b-4f75-8de7-efa4d2e5d028 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:33.694991 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cecd84ac-575b-4f75-8de7-efa4d2e5d028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:33.715610 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:59:33.755347 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd84ac-575b-4f75-8de7-efa4d2e5d028 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:33.759239 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5561319-9d50-409b-9b0e-5aa01f1bec66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:33.759875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5561319-9d50-409b-9b0e-5aa01f1bec66 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:33.760159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5561319-9d50-409b-9b0e-5aa01f1bec66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:33.760438 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5561319-9d50-409b-9b0e-5aa01f1bec66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:33.769214 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5561319-9d50-409b-9b0e-5aa01f1bec66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:33.770656 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5561319-9d50-409b-9b0e-5aa01f1bec66 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:33.779674 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1181/2379] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:59:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 20:59:38.013037 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d2ee5-c2ee-4fe4-a0af-41891a86deb7 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:38.013578 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d2ee5-c2ee-4fe4-a0af-41891a86deb7 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:38.013578 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d2ee5-c2ee-4fe4-a0af-41891a86deb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:38.032590 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-460d2ee5-c2ee-4fe4-a0af-41891a86deb7 None None] MFA Rules not processed for user `9c758557426941babdaa68cbae43f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:38.033802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-460d2ee5-c2ee-4fe4-a0af-41891a86deb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:38.089827 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1199/2380] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:59:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:40.280359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2d4dc-8f83-44b9-be69-a48055de8e2f None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:40.280882 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2d4dc-8f83-44b9-be69-a48055de8e2f None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:40.280973 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2d4dc-8f83-44b9-be69-a48055de8e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:40.303359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-94c2d4dc-8f83-44b9-be69-a48055de8e2f None None] MFA Rules not processed for user `1912f7d1406043ba9993019e39297388`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:40.305049 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-94c2d4dc-8f83-44b9-be69-a48055de8e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:40.364135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1182/2381] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:59:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:43.998779 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d2ee5-c2ee-4fe4-a0af-41891a86deb7 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:44.022904 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:59:44.078007 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d2ee5-c2ee-4fe4-a0af-41891a86deb7 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:44.083099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c485b-ef6b-4ea9-a825-b381807e80cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:44.083734 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c485b-ef6b-4ea9-a825-b381807e80cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:44.084039 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c485b-ef6b-4ea9-a825-b381807e80cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:44.084315 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c485b-ef6b-4ea9-a825-b381807e80cb admin admin] PATH_INFO: `/v3/users/8a99a0d60de64d2fb50df99eecae7bcc` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:44.086037 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c485b-ef6b-4ea9-a825-b381807e80cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a99a0d60de64d2fb50df99eecae7bcc)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:44.087968 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c485b-ef6b-4ea9-a825-b381807e80cb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:44.138710 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-932c485b-ef6b-4ea9-a825-b381807e80cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a99a0d60de64d2fb50df99eecae7bcc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:44.146608 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-932c485b-ef6b-4ea9-a825-b381807e80cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a99a0d60de64d2fb50df99eecae7bcc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:44.163782 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-932c485b-ef6b-4ea9-a825-b381807e80cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a99a0d60de64d2fb50df99eecae7bcc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:44.164561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-932c485b-ef6b-4ea9-a825-b381807e80cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a99a0d60de64d2fb50df99eecae7bcc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:44.165184 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-932c485b-ef6b-4ea9-a825-b381807e80cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a99a0d60de64d2fb50df99eecae7bcc'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:44.181691 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1200/2382] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 20:59:43 2022] DELETE /identity/v3/users/8a99a0d60de64d2fb50df99eecae7bcc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:59:44.183316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b71ae-0a2b-4e07-ac01-26673ef0a8d0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:44.183733 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b71ae-0a2b-4e07-ac01-26673ef0a8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:44.183973 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b71ae-0a2b-4e07-ac01-26673ef0a8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:44.202785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-122b71ae-0a2b-4e07-ac01-26673ef0a8d0 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:44.204019 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-122b71ae-0a2b-4e07-ac01-26673ef0a8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:44.268192 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1183/2383] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 20:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:44.278496 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c485b-ef6b-4ea9-a825-b381807e80cb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:44.279903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-932c485b-ef6b-4ea9-a825-b381807e80cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:44.339322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c485b-ef6b-4ea9-a825-b381807e80cb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:44.342998 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457b9b2-35ec-45ca-93ca-36e4841717a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:44.343606 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457b9b2-35ec-45ca-93ca-36e4841717a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:44.343884 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457b9b2-35ec-45ca-93ca-36e4841717a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:44.344190 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457b9b2-35ec-45ca-93ca-36e4841717a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:44.353865 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457b9b2-35ec-45ca-93ca-36e4841717a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:44.355329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457b9b2-35ec-45ca-93ca-36e4841717a0 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:44.364735 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1201/2384] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:59:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 20:59:44.975454 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b71ae-0a2b-4e07-ac01-26673ef0a8d0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:44.977892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-122b71ae-0a2b-4e07-ac01-26673ef0a8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:45.014035 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b71ae-0a2b-4e07-ac01-26673ef0a8d0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:45.020983 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b4ea5-91ce-44c8-8521-076b230b1fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:45.021681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b4ea5-91ce-44c8-8521-076b230b1fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:45.021924 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b4ea5-91ce-44c8-8521-076b230b1fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:45.022360 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b4ea5-91ce-44c8-8521-076b230b1fdd admin admin] PATH_INFO: `/v3/projects/84c8c99f6fff40269eae0aec038c3d21` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:45.023777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b4ea5-91ce-44c8-8521-076b230b1fdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=84c8c99f6fff40269eae0aec038c3d21)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:45.025980 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b4ea5-91ce-44c8-8521-076b230b1fdd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:45.088814 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cc4b4ea5-91ce-44c8-8521-076b230b1fdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84c8c99f6fff40269eae0aec038c3d21', 'request_id': 'req-cc4b4ea5-91ce-44c8-8521-076b230b1fdd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:45.098027 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cc4b4ea5-91ce-44c8-8521-076b230b1fdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84c8c99f6fff40269eae0aec038c3d21', 'request_id': 'req-cc4b4ea5-91ce-44c8-8521-076b230b1fdd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:45.102644 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:59:45.105212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cc4b4ea5-91ce-44c8-8521-076b230b1fdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84c8c99f6fff40269eae0aec038c3d21', 'request_id': 'req-cc4b4ea5-91ce-44c8-8521-076b230b1fdd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:45.122918 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cc4b4ea5-91ce-44c8-8521-076b230b1fdd admin admin] The token cache is being invalidate because project 84c8c99f6fff40269eae0aec038c3d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 20:59:45.123226 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cc4b4ea5-91ce-44c8-8521-076b230b1fdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:45.124016 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cc4b4ea5-91ce-44c8-8521-076b230b1fdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 20:59:45.126225 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1184/2385] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 20:59:44 2022] DELETE /identity/v3/projects/84c8c99f6fff40269eae0aec038c3d21 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 20:59:54.360697 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:59:55.119656 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=1,keystone:SELECT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 20:59:56.110775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e99b5-ff96-45ad-94d5-9977a49cb36d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:56.111329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e99b5-ff96-45ad-94d5-9977a49cb36d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:56.111329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e99b5-ff96-45ad-94d5-9977a49cb36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:56.130578 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e97e99b5-ff96-45ad-94d5-9977a49cb36d None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:56.131788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e97e99b5-ff96-45ad-94d5-9977a49cb36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:56.192602 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1202/2386] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Sep 9 20:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:56.210017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b4ea5-91ce-44c8-8521-076b230b1fdd admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:56.212171 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cc4b4ea5-91ce-44c8-8521-076b230b1fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:56.286388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b4ea5-91ce-44c8-8521-076b230b1fdd admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:56.292614 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a8072-da7c-44db-96d9-65243811652d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:56.293229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a8072-da7c-44db-96d9-65243811652d service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:56.293506 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a8072-da7c-44db-96d9-65243811652d service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:56.293776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a8072-da7c-44db-96d9-65243811652d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:56.302609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a8072-da7c-44db-96d9-65243811652d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:56.304917 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a8072-da7c-44db-96d9-65243811652d service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:56.314863 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1185/2387] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 20:59:59.391750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24dc88-7db8-48e5-945c-83f22c45dc8e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:59.392271 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24dc88-7db8-48e5-945c-83f22c45dc8e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:59.392373 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24dc88-7db8-48e5-945c-83f22c45dc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:59.413096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1e24dc88-7db8-48e5-945c-83f22c45dc8e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 20:59:59.415349 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1e24dc88-7db8-48e5-945c-83f22c45dc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:59.430625 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1203/2388] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Sep 9 20:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 20:59:59.445500 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a8072-da7c-44db-96d9-65243811652d service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 20:59:59.447675 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c26a8072-da7c-44db-96d9-65243811652d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 20:59:59.465830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a8072-da7c-44db-96d9-65243811652d service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 20:59:59.471884 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9959f07-8b16-4c27-b97b-72b3fc6d98c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 20:59:59.472586 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9959f07-8b16-4c27-b97b-72b3fc6d98c6 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 20:59:59.473141 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9959f07-8b16-4c27-b97b-72b3fc6d98c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 20:59:59.473666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9959f07-8b16-4c27-b97b-72b3fc6d98c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 20:59:59.485329 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9959f07-8b16-4c27-b97b-72b3fc6d98c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 20:59:59.487039 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9959f07-8b16-4c27-b97b-72b3fc6d98c6 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 20:59:59.497199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1186/2389] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 20:59:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:00:02.493719 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6f3ff-8aa1-4716-88f7-ee87810b1c34 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:00:02.494298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6f3ff-8aa1-4716-88f7-ee87810b1c34 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:00:02.494298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6f3ff-8aa1-4716-88f7-ee87810b1c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:00:02.515038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-10b6f3ff-8aa1-4716-88f7-ee87810b1c34 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:00:02.516586 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-10b6f3ff-8aa1-4716-88f7-ee87810b1c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:00:02.525587 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1204/2390] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Sep 9 21:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:00:02.541630 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9959f07-8b16-4c27-b97b-72b3fc6d98c6 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:00:02.553181 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9959f07-8b16-4c27-b97b-72b3fc6d98c6 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:00:02.558734 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19bbc8-557a-46d4-b671-e0a00bbd61c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:00:02.559370 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19bbc8-557a-46d4-b671-e0a00bbd61c0 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:00:02.559707 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19bbc8-557a-46d4-b671-e0a00bbd61c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:00:02.559927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19bbc8-557a-46d4-b671-e0a00bbd61c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:00:02.568512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19bbc8-557a-46d4-b671-e0a00bbd61c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:00:02.570605 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19bbc8-557a-46d4-b671-e0a00bbd61c0 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:00:02.580327 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1187/2391] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:00:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:00:06.691630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edae75f-80da-4506-8b26-b1b12339834a None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:00:06.692175 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edae75f-80da-4506-8b26-b1b12339834a None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:00:06.692175 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edae75f-80da-4506-8b26-b1b12339834a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:00:06.722091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1edae75f-80da-4506-8b26-b1b12339834a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:00:06.723402 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1edae75f-80da-4506-8b26-b1b12339834a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:00:06.733353 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1205/2392] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Sep 9 21:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:00:06.763344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19bbc8-557a-46d4-b671-e0a00bbd61c0 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:00:06.776191 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19bbc8-557a-46d4-b671-e0a00bbd61c0 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:00:06.782668 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c06d7-515d-4617-84c5-531a4af1e874 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:00:06.783432 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c06d7-515d-4617-84c5-531a4af1e874 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:00:06.783792 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c06d7-515d-4617-84c5-531a4af1e874 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:00:06.784181 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c06d7-515d-4617-84c5-531a4af1e874 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:00:06.795148 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c06d7-515d-4617-84c5-531a4af1e874 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:00:06.797872 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c06d7-515d-4617-84c5-531a4af1e874 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:00:06.816061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1188/2393] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:00:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:00:08.520856 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78bf12-521e-46c6-8d59-4596392ff2c9 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:00:08.521373 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78bf12-521e-46c6-8d59-4596392ff2c9 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:00:08.521478 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78bf12-521e-46c6-8d59-4596392ff2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:00:08.541106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0a78bf12-521e-46c6-8d59-4596392ff2c9 None None] MFA Rules not processed for user `ef5e046f57cc4389818835ba68ad8157`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:00:08.542315 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0a78bf12-521e-46c6-8d59-4596392ff2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:00:08.596633 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1206/2394] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:00:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:00:11.928474 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d225dd-d6e0-45fb-a4ed-939bc88bbd47 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:00:11.928992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d225dd-d6e0-45fb-a4ed-939bc88bbd47 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:00:11.929091 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d225dd-d6e0-45fb-a4ed-939bc88bbd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:00:11.950565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e9d225dd-d6e0-45fb-a4ed-939bc88bbd47 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:00:11.951694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e9d225dd-d6e0-45fb-a4ed-939bc88bbd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:00:11.959744 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1189/2395] 10.222.0.17 () {58 vars in 1016 bytes} [Fri Sep 9 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:00:11.973894 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78bf12-521e-46c6-8d59-4596392ff2c9 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:00:11.987268 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78bf12-521e-46c6-8d59-4596392ff2c9 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:00:11.993553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1d2f1-012a-435a-a80f-a407ac132694 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:00:11.994228 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1d2f1-012a-435a-a80f-a407ac132694 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:00:11.994433 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1d2f1-012a-435a-a80f-a407ac132694 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:00:11.994703 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1d2f1-012a-435a-a80f-a407ac132694 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:00:12.003069 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1d2f1-012a-435a-a80f-a407ac132694 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:00:12.004708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1d2f1-012a-435a-a80f-a407ac132694 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:00:12.014685 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1207/2396] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:00:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:00:14.078666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd686970-4d71-4cb3-9441-128de9f9a568 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:00:14.079185 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd686970-4d71-4cb3-9441-128de9f9a568 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:00:14.079185 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd686970-4d71-4cb3-9441-128de9f9a568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:00:14.097740 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-bd686970-4d71-4cb3-9441-128de9f9a568 None None] MFA Rules not processed for user `af23fcaecde74f71a3e7bc7231194a06`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:00:14.098946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bd686970-4d71-4cb3-9441-128de9f9a568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:00:14.153825 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1190/2397] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:00:16.021185 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a8e0e-4cdf-40ce-943d-422d3aae51f3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:00:16.021604 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a8e0e-4cdf-40ce-943d-422d3aae51f3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:00:16.021729 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a8e0e-4cdf-40ce-943d-422d3aae51f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:00:16.044352 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-212a8e0e-4cdf-40ce-943d-422d3aae51f3 None None] MFA Rules not processed for user `e51ae6959aac49898e75c6786c5dbdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:00:16.045790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-212a8e0e-4cdf-40ce-943d-422d3aae51f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:00:16.128627 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1208/2398] 10.222.0.15 () {58 vars in 967 bytes} [Fri Sep 9 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:00:16.190167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd686970-4d71-4cb3-9441-128de9f9a568 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:00:16.193595 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bd686970-4d71-4cb3-9441-128de9f9a568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:00:16.248696 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:00:16.291489 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd686970-4d71-4cb3-9441-128de9f9a568 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:00:16.297280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc96343-9bbc-4751-adee-36e42ff4c107 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9570eaa112de460cb9e371278bfb300b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:00:16.297913 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc96343-9bbc-4751-adee-36e42ff4c107 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:00:16.298367 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc96343-9bbc-4751-adee-36e42ff4c107 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:00:16.298644 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc96343-9bbc-4751-adee-36e42ff4c107 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:00:16.315209 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc96343-9bbc-4751-adee-36e42ff4c107 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:00:16.318052 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc96343-9bbc-4751-adee-36e42ff4c107 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:00:16.327045 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1191/2399] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Sep 9 21:00:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 21:00:25.320817 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a8e0e-4cdf-40ce-943d-422d3aae51f3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:00:25.322282 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-212a8e0e-4cdf-40ce-943d-422d3aae51f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:00:25.331252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:00:25.339193 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a8e0e-4cdf-40ce-943d-422d3aae51f3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:00:25.345040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b61aa-5f5f-49d8-9da4-220df4f5bfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:00:25.346053 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b61aa-5f5f-49d8-9da4-220df4f5bfb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:00:25.346475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b61aa-5f5f-49d8-9da4-220df4f5bfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:00:25.346763 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b61aa-5f5f-49d8-9da4-220df4f5bfb0 admin admin] PATH_INFO: `/v3/users/d4e5f1d369d94d00a56cbcfb69be01e9` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:00:25.348142 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b61aa-5f5f-49d8-9da4-220df4f5bfb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4e5f1d369d94d00a56cbcfb69be01e9)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:00:25.350325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b61aa-5f5f-49d8-9da4-220df4f5bfb0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:00:25.399706 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-605b61aa-5f5f-49d8-9da4-220df4f5bfb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4e5f1d369d94d00a56cbcfb69be01e9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:25.408318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-605b61aa-5f5f-49d8-9da4-220df4f5bfb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4e5f1d369d94d00a56cbcfb69be01e9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:25.422009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-605b61aa-5f5f-49d8-9da4-220df4f5bfb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4e5f1d369d94d00a56cbcfb69be01e9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:25.422699 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-605b61aa-5f5f-49d8-9da4-220df4f5bfb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4e5f1d369d94d00a56cbcfb69be01e9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:25.423299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-605b61aa-5f5f-49d8-9da4-220df4f5bfb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4e5f1d369d94d00a56cbcfb69be01e9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:25.435394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1209/2400] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:00:25 2022] DELETE /identity/v3/users/d4e5f1d369d94d00a56cbcfb69be01e9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:00:25.624713 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc96343-9bbc-4751-adee-36e42ff4c107 service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:00:25.640950 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc96343-9bbc-4751-adee-36e42ff4c107 service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:00:25.736240 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17237be4-01e1-4d98-b193-96e133622720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:00:25.737227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17237be4-01e1-4d98-b193-96e133622720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:00:25.737907 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17237be4-01e1-4d98-b193-96e133622720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:00:25.738465 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17237be4-01e1-4d98-b193-96e133622720 admin admin] PATH_INFO: `/v3/projects/93361291e79949e3a9062c7be5ae6ddf` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:00:25.740064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17237be4-01e1-4d98-b193-96e133622720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93361291e79949e3a9062c7be5ae6ddf)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:00:25.742252 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17237be4-01e1-4d98-b193-96e133622720 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:00:25.806785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-17237be4-01e1-4d98-b193-96e133622720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93361291e79949e3a9062c7be5ae6ddf', 'request_id': 'req-17237be4-01e1-4d98-b193-96e133622720'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:25.818468 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-17237be4-01e1-4d98-b193-96e133622720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93361291e79949e3a9062c7be5ae6ddf', 'request_id': 'req-17237be4-01e1-4d98-b193-96e133622720'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:25.827953 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-17237be4-01e1-4d98-b193-96e133622720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93361291e79949e3a9062c7be5ae6ddf', 'request_id': 'req-17237be4-01e1-4d98-b193-96e133622720'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:25.844910 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-17237be4-01e1-4d98-b193-96e133622720 admin admin] The token cache is being invalidate because project 93361291e79949e3a9062c7be5ae6ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:00:25.845444 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-17237be4-01e1-4d98-b193-96e133622720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:25.846353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-17237be4-01e1-4d98-b193-96e133622720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:25.848218 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1192/2401] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:00:25 2022] DELETE /identity/v3/projects/93361291e79949e3a9062c7be5ae6ddf => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:00:25.852745 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b61aa-5f5f-49d8-9da4-220df4f5bfb0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:00:25.854205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-605b61aa-5f5f-49d8-9da4-220df4f5bfb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:00:25.878883 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b61aa-5f5f-49d8-9da4-220df4f5bfb0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:00:25.958233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63592a09-942b-4d89-846e-e8f77ade4165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:00:25.959041 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63592a09-942b-4d89-846e-e8f77ade4165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:00:25.959327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63592a09-942b-4d89-846e-e8f77ade4165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:00:25.959600 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63592a09-942b-4d89-846e-e8f77ade4165 admin admin] PATH_INFO: `/v3/users/4608e9da3bff4e4cab7ab7f294e8281b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:00:25.964589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63592a09-942b-4d89-846e-e8f77ade4165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4608e9da3bff4e4cab7ab7f294e8281b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:00:25.966587 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63592a09-942b-4d89-846e-e8f77ade4165 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:00:26.028600 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-63592a09-942b-4d89-846e-e8f77ade4165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4608e9da3bff4e4cab7ab7f294e8281b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:26.040611 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-63592a09-942b-4d89-846e-e8f77ade4165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4608e9da3bff4e4cab7ab7f294e8281b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:26.054131 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-63592a09-942b-4d89-846e-e8f77ade4165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4608e9da3bff4e4cab7ab7f294e8281b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:26.055252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-63592a09-942b-4d89-846e-e8f77ade4165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4608e9da3bff4e4cab7ab7f294e8281b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:26.056334 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-63592a09-942b-4d89-846e-e8f77ade4165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4608e9da3bff4e4cab7ab7f294e8281b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:26.061808 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:00:26.078840 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1210/2402] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:00:25 2022] DELETE /identity/v3/users/4608e9da3bff4e4cab7ab7f294e8281b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:00:26.276264 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17237be4-01e1-4d98-b193-96e133622720 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:00:26.277742 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-17237be4-01e1-4d98-b193-96e133622720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:00:26.298362 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17237be4-01e1-4d98-b193-96e133622720 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:00:26.372335 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d888829-af88-4562-b761-177ab95f7e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:00:26.373045 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d888829-af88-4562-b761-177ab95f7e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:00:26.373656 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d888829-af88-4562-b761-177ab95f7e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:00:26.374057 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d888829-af88-4562-b761-177ab95f7e15 admin admin] PATH_INFO: `/v3/projects/d75d66006e5041cc8ed68c4d0a8df4f0` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:00:26.385852 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d888829-af88-4562-b761-177ab95f7e15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d75d66006e5041cc8ed68c4d0a8df4f0)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:00:26.388901 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d888829-af88-4562-b761-177ab95f7e15 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:00:26.396764 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:00:26.463568 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5d888829-af88-4562-b761-177ab95f7e15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd75d66006e5041cc8ed68c4d0a8df4f0', 'request_id': 'req-5d888829-af88-4562-b761-177ab95f7e15'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:26.471096 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5d888829-af88-4562-b761-177ab95f7e15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd75d66006e5041cc8ed68c4d0a8df4f0', 'request_id': 'req-5d888829-af88-4562-b761-177ab95f7e15'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:26.478084 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5d888829-af88-4562-b761-177ab95f7e15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd75d66006e5041cc8ed68c4d0a8df4f0', 'request_id': 'req-5d888829-af88-4562-b761-177ab95f7e15'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:26.490188 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5d888829-af88-4562-b761-177ab95f7e15 admin admin] The token cache is being invalidate because project d75d66006e5041cc8ed68c4d0a8df4f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:00:26.490477 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5d888829-af88-4562-b761-177ab95f7e15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:26.491177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-5d888829-af88-4562-b761-177ab95f7e15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:26.494234 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1193/2403] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:00:26 2022] DELETE /identity/v3/projects/d75d66006e5041cc8ed68c4d0a8df4f0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:00:36.074564 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:00:36.487270 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:00:45.199251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63592a09-942b-4d89-846e-e8f77ade4165 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:00:45.200795 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-63592a09-942b-4d89-846e-e8f77ade4165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:00:45.215128 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63592a09-942b-4d89-846e-e8f77ade4165 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:00:45.282520 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e07272-80dc-4deb-a8f8-2f670b30bf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:00:45.283606 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e07272-80dc-4deb-a8f8-2f670b30bf0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:00:45.284060 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e07272-80dc-4deb-a8f8-2f670b30bf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:00:45.284344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e07272-80dc-4deb-a8f8-2f670b30bf0d admin admin] PATH_INFO: `/v3/users/1912f7d1406043ba9993019e39297388` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:00:45.290025 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e07272-80dc-4deb-a8f8-2f670b30bf0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1912f7d1406043ba9993019e39297388)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:00:45.292170 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e07272-80dc-4deb-a8f8-2f670b30bf0d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:00:45.343616 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-64e07272-80dc-4deb-a8f8-2f670b30bf0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1912f7d1406043ba9993019e39297388'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:45.354083 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-64e07272-80dc-4deb-a8f8-2f670b30bf0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1912f7d1406043ba9993019e39297388'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:45.367740 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-64e07272-80dc-4deb-a8f8-2f670b30bf0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1912f7d1406043ba9993019e39297388'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:45.368465 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-64e07272-80dc-4deb-a8f8-2f670b30bf0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1912f7d1406043ba9993019e39297388'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:45.370341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-64e07272-80dc-4deb-a8f8-2f670b30bf0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1912f7d1406043ba9993019e39297388'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:45.382793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1211/2404] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:00:45 2022] DELETE /identity/v3/users/1912f7d1406043ba9993019e39297388 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:00:45.554062 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d888829-af88-4562-b761-177ab95f7e15 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:00:45.555879 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5d888829-af88-4562-b761-177ab95f7e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:00:45.569800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dcd1a-4e0c-4847-8c40-abd3a62c42d4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:00:45.570160 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dcd1a-4e0c-4847-8c40-abd3a62c42d4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:00:45.570427 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d888829-af88-4562-b761-177ab95f7e15 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:00:45.570539 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dcd1a-4e0c-4847-8c40-abd3a62c42d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:00:45.592677 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-ed4dcd1a-4e0c-4847-8c40-abd3a62c42d4 None None] MFA Rules not processed for user `9c758557426941babdaa68cbae43f881`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:00:45.593903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ed4dcd1a-4e0c-4847-8c40-abd3a62c42d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:00:45.632463 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd47075-3668-4c7a-b167-384df184d7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:00:45.633107 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd47075-3668-4c7a-b167-384df184d7d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:00:45.633396 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd47075-3668-4c7a-b167-384df184d7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:00:45.633672 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd47075-3668-4c7a-b167-384df184d7d6 admin admin] PATH_INFO: `/v3/projects/7d9f9f72588c4d52ba9559ff8588e9d9` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:00:45.634846 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd47075-3668-4c7a-b167-384df184d7d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d9f9f72588c4d52ba9559ff8588e9d9)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:00:45.636844 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd47075-3668-4c7a-b167-384df184d7d6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:00:45.650036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1212/2405] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:00:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:00:45.685016 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1bd47075-3668-4c7a-b167-384df184d7d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d9f9f72588c4d52ba9559ff8588e9d9', 'request_id': 'req-1bd47075-3668-4c7a-b167-384df184d7d6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:45.693688 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1bd47075-3668-4c7a-b167-384df184d7d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d9f9f72588c4d52ba9559ff8588e9d9', 'request_id': 'req-1bd47075-3668-4c7a-b167-384df184d7d6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:45.700566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1bd47075-3668-4c7a-b167-384df184d7d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d9f9f72588c4d52ba9559ff8588e9d9', 'request_id': 'req-1bd47075-3668-4c7a-b167-384df184d7d6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:45.711979 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1bd47075-3668-4c7a-b167-384df184d7d6 admin admin] The token cache is being invalidate because project 7d9f9f72588c4d52ba9559ff8588e9d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:00:45.712368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1bd47075-3668-4c7a-b167-384df184d7d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:45.713703 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1bd47075-3668-4c7a-b167-384df184d7d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:00:45.715459 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1194/2406] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:00:45 2022] DELETE /identity/v3/projects/7d9f9f72588c4d52ba9559ff8588e9d9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:00:55.642924 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=78,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:00:55.708849 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:04.470806 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dcd1a-4e0c-4847-8c40-abd3a62c42d4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:04.472264 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ed4dcd1a-4e0c-4847-8c40-abd3a62c42d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:04.528297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dcd1a-4e0c-4847-8c40-abd3a62c42d4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:04.575907 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212cd94-655b-4795-b098-2baeb78a66ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:04.576451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212cd94-655b-4795-b098-2baeb78a66ad service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:04.576729 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212cd94-655b-4795-b098-2baeb78a66ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:04.577000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212cd94-655b-4795-b098-2baeb78a66ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:04.578718 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a212cd94-655b-4795-b098-2baeb78a66ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:04.650452 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212cd94-655b-4795-b098-2baeb78a66ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:04.651895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212cd94-655b-4795-b098-2baeb78a66ad service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:04.663312 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1213/2407] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:05.536691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd47075-3668-4c7a-b167-384df184d7d6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:05.538116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1bd47075-3668-4c7a-b167-384df184d7d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:05.594985 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd47075-3668-4c7a-b167-384df184d7d6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:05.598498 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec6335-1655-43ab-a3cd-acaf0c31c655 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d298efe48464956b7a03cba1001060b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:05.599097 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec6335-1655-43ab-a3cd-acaf0c31c655 service glance] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:05.599377 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec6335-1655-43ab-a3cd-acaf0c31c655 service glance] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:05.599652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec6335-1655-43ab-a3cd-acaf0c31c655 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:05.601404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d4ec6335-1655-43ab-a3cd-acaf0c31c655 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:05.615694 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec6335-1655-43ab-a3cd-acaf0c31c655 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:05.617185 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec6335-1655-43ab-a3cd-acaf0c31c655 service glance] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:05.628003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1195/2408] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:08.127757 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212cd94-655b-4795-b098-2baeb78a66ad service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:08.129136 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a212cd94-655b-4795-b098-2baeb78a66ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:08.143004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212cd94-655b-4795-b098-2baeb78a66ad service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:08.148557 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1416e-0855-4132-a927-15e9c7d8415e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:08.149233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1416e-0855-4132-a927-15e9c7d8415e service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:08.149518 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1416e-0855-4132-a927-15e9c7d8415e service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:08.149935 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1416e-0855-4132-a927-15e9c7d8415e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:08.151614 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-59c1416e-0855-4132-a927-15e9c7d8415e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:08.206647 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:08.209113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1416e-0855-4132-a927-15e9c7d8415e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:08.210987 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1416e-0855-4132-a927-15e9c7d8415e service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:08.220401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1214/2409] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:11.903163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec6335-1655-43ab-a3cd-acaf0c31c655 service glance] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:11.905221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d4ec6335-1655-43ab-a3cd-acaf0c31c655 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:11.917008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec6335-1655-43ab-a3cd-acaf0c31c655 service glance] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:11.920528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476517a-c3b4-4144-8a82-88ce060ffac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:11.921127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476517a-c3b4-4144-8a82-88ce060ffac7 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:11.921403 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476517a-c3b4-4144-8a82-88ce060ffac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:11.921669 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476517a-c3b4-4144-8a82-88ce060ffac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:11.923342 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7476517a-c3b4-4144-8a82-88ce060ffac7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:11.990698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476517a-c3b4-4144-8a82-88ce060ffac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:11.992345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476517a-c3b4-4144-8a82-88ce060ffac7 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:12.003656 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1196/2410] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:15.184478 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1416e-0855-4132-a927-15e9c7d8415e service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:15.185959 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-59c1416e-0855-4132-a927-15e9c7d8415e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:15.200428 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1416e-0855-4132-a927-15e9c7d8415e service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:15.205040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca57e3-7f1b-49ef-8aac-b159c0f89640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:15.205693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca57e3-7f1b-49ef-8aac-b159c0f89640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:15.205969 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca57e3-7f1b-49ef-8aac-b159c0f89640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:15.206239 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca57e3-7f1b-49ef-8aac-b159c0f89640 admin admin] PATH_INFO: `/v3/users/af23fcaecde74f71a3e7bc7231194a06` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:15.207353 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca57e3-7f1b-49ef-8aac-b159c0f89640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af23fcaecde74f71a3e7bc7231194a06)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:15.209298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca57e3-7f1b-49ef-8aac-b159c0f89640 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:15.256828 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5bca57e3-7f1b-49ef-8aac-b159c0f89640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af23fcaecde74f71a3e7bc7231194a06'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:15.267059 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5bca57e3-7f1b-49ef-8aac-b159c0f89640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af23fcaecde74f71a3e7bc7231194a06'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:15.280526 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5bca57e3-7f1b-49ef-8aac-b159c0f89640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af23fcaecde74f71a3e7bc7231194a06'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:15.281220 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5bca57e3-7f1b-49ef-8aac-b159c0f89640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af23fcaecde74f71a3e7bc7231194a06'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:15.281857 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5bca57e3-7f1b-49ef-8aac-b159c0f89640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af23fcaecde74f71a3e7bc7231194a06'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:15.295025 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1215/2411] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:01:15 2022] DELETE /identity/v3/users/af23fcaecde74f71a3e7bc7231194a06 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:15.470723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476517a-c3b4-4144-8a82-88ce060ffac7 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:15.481056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476517a-c3b4-4144-8a82-88ce060ffac7 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:15.541709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035911b-d527-48ad-ae1f-3013f124bac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:15.542349 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035911b-d527-48ad-ae1f-3013f124bac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:15.542630 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035911b-d527-48ad-ae1f-3013f124bac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:15.542928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035911b-d527-48ad-ae1f-3013f124bac9 admin admin] PATH_INFO: `/v3/projects/d585f42b0a534b7cbf55a90f5b48e41f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:15.544078 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035911b-d527-48ad-ae1f-3013f124bac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d585f42b0a534b7cbf55a90f5b48e41f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:15.546123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035911b-d527-48ad-ae1f-3013f124bac9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:15.587789 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:15.596261 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c035911b-d527-48ad-ae1f-3013f124bac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd585f42b0a534b7cbf55a90f5b48e41f', 'request_id': 'req-c035911b-d527-48ad-ae1f-3013f124bac9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:15.607973 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c035911b-d527-48ad-ae1f-3013f124bac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd585f42b0a534b7cbf55a90f5b48e41f', 'request_id': 'req-c035911b-d527-48ad-ae1f-3013f124bac9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:15.614181 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c035911b-d527-48ad-ae1f-3013f124bac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd585f42b0a534b7cbf55a90f5b48e41f', 'request_id': 'req-c035911b-d527-48ad-ae1f-3013f124bac9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:15.626374 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c035911b-d527-48ad-ae1f-3013f124bac9 admin admin] The token cache is being invalidate because project d585f42b0a534b7cbf55a90f5b48e41f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:01:15.626660 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c035911b-d527-48ad-ae1f-3013f124bac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:15.627305 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-c035911b-d527-48ad-ae1f-3013f124bac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:15.628800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1197/2412] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:01:15 2022] DELETE /identity/v3/projects/d585f42b0a534b7cbf55a90f5b48e41f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:15.634021 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10922210-85e0-429c-8dc3-b9fd31b51fa6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:15.634668 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10922210-85e0-429c-8dc3-b9fd31b51fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:15.634936 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10922210-85e0-429c-8dc3-b9fd31b51fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:15.655250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-10922210-85e0-429c-8dc3-b9fd31b51fa6 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:15.656475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-10922210-85e0-429c-8dc3-b9fd31b51fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:15.716507 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1216/2413] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:01:15.724213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a075f06-ce6b-4ede-a164-cefd00d0e9f0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:15.724505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a075f06-ce6b-4ede-a164-cefd00d0e9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:15.724780 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a075f06-ce6b-4ede-a164-cefd00d0e9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:15.746256 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-5a075f06-ce6b-4ede-a164-cefd00d0e9f0 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:15.747456 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5a075f06-ce6b-4ede-a164-cefd00d0e9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:15.755403 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1198/2414] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:15.759614 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10922210-85e0-429c-8dc3-b9fd31b51fa6 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:15.769329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10922210-85e0-429c-8dc3-b9fd31b51fa6 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:15.773891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e4859-9081-4e3b-bfd2-91447d877c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:15.774482 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e4859-9081-4e3b-bfd2-91447d877c5b admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:15.774757 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e4859-9081-4e3b-bfd2-91447d877c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:15.775025 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e4859-9081-4e3b-bfd2-91447d877c5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:15.775668 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e4859-9081-4e3b-bfd2-91447d877c5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:01:15.775970 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e4859-9081-4e3b-bfd2-91447d877c5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:15.777586 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e4859-9081-4e3b-bfd2-91447d877c5b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:15.789094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1217/2415] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:01:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:01:15.793905 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a075f06-ce6b-4ede-a164-cefd00d0e9f0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:15.803129 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a075f06-ce6b-4ede-a164-cefd00d0e9f0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:15.808702 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc36489-0942-4214-8740-943a8487da69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:15.809300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc36489-0942-4214-8740-943a8487da69 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:15.809582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc36489-0942-4214-8740-943a8487da69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:15.809858 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc36489-0942-4214-8740-943a8487da69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:15.810487 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc36489-0942-4214-8740-943a8487da69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:15.812473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc36489-0942-4214-8740-943a8487da69 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:15.841408 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1199/2416] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:01:15 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:01:15.845795 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e4859-9081-4e3b-bfd2-91447d877c5b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:15.856505 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e4859-9081-4e3b-bfd2-91447d877c5b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:15.905666 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:15.914450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb8d83-ba7e-4bb9-a4b9-3a88453a1633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:15.915883 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb8d83-ba7e-4bb9-a4b9-3a88453a1633 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:15.916195 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb8d83-ba7e-4bb9-a4b9-3a88453a1633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:15.916479 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb8d83-ba7e-4bb9-a4b9-3a88453a1633 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:15.917116 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb8d83-ba7e-4bb9-a4b9-3a88453a1633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:15.919075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb8d83-ba7e-4bb9-a4b9-3a88453a1633 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:15.940033 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1218/2417] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:01:15 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:01:15.949555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc36489-0942-4214-8740-943a8487da69 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:15.959942 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc36489-0942-4214-8740-943a8487da69 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:15.964731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aba760-e2da-4f96-a0dd-ef978c2b2955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:15.965319 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aba760-e2da-4f96-a0dd-ef978c2b2955 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:15.965593 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aba760-e2da-4f96-a0dd-ef978c2b2955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:15.965862 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aba760-e2da-4f96-a0dd-ef978c2b2955 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:15.966491 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aba760-e2da-4f96-a0dd-ef978c2b2955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:15.968106 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aba760-e2da-4f96-a0dd-ef978c2b2955 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:15.979050 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1200/2418] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:01:15.983137 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb8d83-ba7e-4bb9-a4b9-3a88453a1633 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:15.993813 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb8d83-ba7e-4bb9-a4b9-3a88453a1633 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:15.998514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f346b5-126d-4dd1-a499-4cef8cac7074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:15.999107 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f346b5-126d-4dd1-a499-4cef8cac7074 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:15.999389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f346b5-126d-4dd1-a499-4cef8cac7074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:15.999663 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f346b5-126d-4dd1-a499-4cef8cac7074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:16.000334 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f346b5-126d-4dd1-a499-4cef8cac7074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:16.001935 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f346b5-126d-4dd1-a499-4cef8cac7074 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:16.012793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1219/2419] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:01:16.016891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aba760-e2da-4f96-a0dd-ef978c2b2955 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:16.028083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aba760-e2da-4f96-a0dd-ef978c2b2955 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:16.032764 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a6d09-142e-4194-8245-31257f22e1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:16.033428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a6d09-142e-4194-8245-31257f22e1fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:16.033709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a6d09-142e-4194-8245-31257f22e1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:16.033982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a6d09-142e-4194-8245-31257f22e1fb admin admin] PATH_INFO: `/v3/projects/7cfa7a813df8437689e2ac3290395ff5/users/f8551e69c1ed4a618202b95527c900d1/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:16.050371 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a6d09-142e-4194-8245-31257f22e1fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cfa7a813df8437689e2ac3290395ff5, user_id=f8551e69c1ed4a618202b95527c900d1, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:16.053097 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a6d09-142e-4194-8245-31257f22e1fb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:16.072022 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1201/2420] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:01:16 2022] PUT /identity/v3/projects/7cfa7a813df8437689e2ac3290395ff5/users/f8551e69c1ed4a618202b95527c900d1/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:16.073784 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16067296-8b25-4848-b524-88a7d7c6ada2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:16.074093 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16067296-8b25-4848-b524-88a7d7c6ada2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:16.074454 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16067296-8b25-4848-b524-88a7d7c6ada2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:16.095776 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-16067296-8b25-4848-b524-88a7d7c6ada2 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:16.097262 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-16067296-8b25-4848-b524-88a7d7c6ada2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:16.158184 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1220/2421] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:16.168181 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a6d09-142e-4194-8245-31257f22e1fb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:16.169869 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e68a6d09-142e-4194-8245-31257f22e1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:16.225597 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a6d09-142e-4194-8245-31257f22e1fb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:16.229279 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25e9b7-8478-44ac-b4b5-3a56bedff904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:16.229876 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25e9b7-8478-44ac-b4b5-3a56bedff904 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:16.230152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25e9b7-8478-44ac-b4b5-3a56bedff904 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:16.230419 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25e9b7-8478-44ac-b4b5-3a56bedff904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:16.239143 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25e9b7-8478-44ac-b4b5-3a56bedff904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:16.240610 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc25e9b7-8478-44ac-b4b5-3a56bedff904 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:16.250269 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1202/2422] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:01:16.888866 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c319b-5261-4ed3-a379-458e29f5007c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:16.889449 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c319b-5261-4ed3-a379-458e29f5007c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:16.889615 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c319b-5261-4ed3-a379-458e29f5007c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:16.919077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d80c319b-5261-4ed3-a379-458e29f5007c None None] MFA Rules not processed for user `f8551e69c1ed4a618202b95527c900d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:16.920353 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d80c319b-5261-4ed3-a379-458e29f5007c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:16.984760 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1221/2423] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:16 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:16.989341 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25e9b7-8478-44ac-b4b5-3a56bedff904 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:16.998953 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25e9b7-8478-44ac-b4b5-3a56bedff904 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:17.003495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d195e0-2d8c-4097-86e3-7bec4d66867c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:17.004124 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d195e0-2d8c-4097-86e3-7bec4d66867c admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:17.004405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d195e0-2d8c-4097-86e3-7bec4d66867c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:17.004678 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d195e0-2d8c-4097-86e3-7bec4d66867c admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:17.005302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d195e0-2d8c-4097-86e3-7bec4d66867c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:17.007210 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d195e0-2d8c-4097-86e3-7bec4d66867c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:17.035264 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1203/2424] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:01:16 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:01:17.040328 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c319b-5261-4ed3-a379-458e29f5007c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:17.051530 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c319b-5261-4ed3-a379-458e29f5007c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:17.109483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e1923-305b-4454-bbea-ec9008f414ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:17.110098 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e1923-305b-4454-bbea-ec9008f414ec admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:17.110376 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e1923-305b-4454-bbea-ec9008f414ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:17.110647 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e1923-305b-4454-bbea-ec9008f414ec admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:17.111273 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e1923-305b-4454-bbea-ec9008f414ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:17.113225 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e1923-305b-4454-bbea-ec9008f414ec admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:17.122962 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:17.135830 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1222/2425] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:01:17 2022] POST /identity/v3/users => generated 309 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:01:17.139785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d195e0-2d8c-4097-86e3-7bec4d66867c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:17.150680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d195e0-2d8c-4097-86e3-7bec4d66867c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:17.155229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adda6d-8c69-467f-b47c-760fb3d0a443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:17.155823 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adda6d-8c69-467f-b47c-760fb3d0a443 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:17.156146 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adda6d-8c69-467f-b47c-760fb3d0a443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:17.156464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adda6d-8c69-467f-b47c-760fb3d0a443 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:17.157085 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95adda6d-8c69-467f-b47c-760fb3d0a443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:17.158682 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95adda6d-8c69-467f-b47c-760fb3d0a443 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:17.169421 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1204/2426] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:01:17.173671 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e1923-305b-4454-bbea-ec9008f414ec admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:17.183755 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e1923-305b-4454-bbea-ec9008f414ec admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:17.188680 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414793d-737b-475b-8584-a92210898491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:17.189373 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414793d-737b-475b-8584-a92210898491 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:17.189651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414793d-737b-475b-8584-a92210898491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:17.189926 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414793d-737b-475b-8584-a92210898491 admin admin] PATH_INFO: `/v3/projects/2ee5ac8672584400ae606fd0b81d34d1/users/f02e82d2495b44429337319231760e8b/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:17.205537 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414793d-737b-475b-8584-a92210898491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee5ac8672584400ae606fd0b81d34d1, user_id=f02e82d2495b44429337319231760e8b, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:17.208314 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414793d-737b-475b-8584-a92210898491 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:17.221780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1223/2427] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:01:17 2022] PUT /identity/v3/projects/2ee5ac8672584400ae606fd0b81d34d1/users/f02e82d2495b44429337319231760e8b/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:17.225853 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adda6d-8c69-467f-b47c-760fb3d0a443 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:17.235800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adda6d-8c69-467f-b47c-760fb3d0a443 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:17.265329 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:17.294335 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531d316-2063-445c-b01c-8694782b8741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:17.294952 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531d316-2063-445c-b01c-8694782b8741 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:17.295236 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531d316-2063-445c-b01c-8694782b8741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:17.295510 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531d316-2063-445c-b01c-8694782b8741 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:17.296200 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531d316-2063-445c-b01c-8694782b8741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:17.297921 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531d316-2063-445c-b01c-8694782b8741 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:17.309608 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1205/2428] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:01:17.313723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414793d-737b-475b-8584-a92210898491 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:17.324969 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414793d-737b-475b-8584-a92210898491 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:17.330091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b80796-a591-4348-99f8-f911116a228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:17.330768 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80796-a591-4348-99f8-f911116a228e admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:17.331052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80796-a591-4348-99f8-f911116a228e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:17.331335 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b80796-a591-4348-99f8-f911116a228e admin admin] PATH_INFO: `/v3/projects/2ee5ac8672584400ae606fd0b81d34d1/users/f02e82d2495b44429337319231760e8b/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:17.333290 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b80796-a591-4348-99f8-f911116a228e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee5ac8672584400ae606fd0b81d34d1, user_id=f02e82d2495b44429337319231760e8b, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:17.336014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b80796-a591-4348-99f8-f911116a228e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:17.346669 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1224/2429] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:01:17 2022] PUT /identity/v3/projects/2ee5ac8672584400ae606fd0b81d34d1/users/f02e82d2495b44429337319231760e8b/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:18.007161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad910c8-a0a7-46ec-a792-145f8770e3be None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:18.007650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad910c8-a0a7-46ec-a792-145f8770e3be None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:18.007732 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad910c8-a0a7-46ec-a792-145f8770e3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:18.043339 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3ad910c8-a0a7-46ec-a792-145f8770e3be None None] MFA Rules not processed for user `f02e82d2495b44429337319231760e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:18.044876 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3ad910c8-a0a7-46ec-a792-145f8770e3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:18.126062 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1206/2430] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:18 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:19.146843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b80796-a591-4348-99f8-f911116a228e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:19.214428 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b80796-a591-4348-99f8-f911116a228e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:19.219373 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269654e-a6ed-41b4-abec-5678e1db9242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:19.220034 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269654e-a6ed-41b4-abec-5678e1db9242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:19.220321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269654e-a6ed-41b4-abec-5678e1db9242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:19.220598 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269654e-a6ed-41b4-abec-5678e1db9242 admin admin] PATH_INFO: `/v3/users/f8551e69c1ed4a618202b95527c900d1` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:19.221773 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269654e-a6ed-41b4-abec-5678e1db9242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8551e69c1ed4a618202b95527c900d1)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:19.223713 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269654e-a6ed-41b4-abec-5678e1db9242 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:19.275856 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f269654e-a6ed-41b4-abec-5678e1db9242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8551e69c1ed4a618202b95527c900d1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:19.285823 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f269654e-a6ed-41b4-abec-5678e1db9242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8551e69c1ed4a618202b95527c900d1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:19.298854 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f269654e-a6ed-41b4-abec-5678e1db9242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8551e69c1ed4a618202b95527c900d1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:19.299540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f269654e-a6ed-41b4-abec-5678e1db9242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8551e69c1ed4a618202b95527c900d1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:19.300172 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f269654e-a6ed-41b4-abec-5678e1db9242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8551e69c1ed4a618202b95527c900d1'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:19.312900 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1225/2431] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:01:19 2022] DELETE /identity/v3/users/f8551e69c1ed4a618202b95527c900d1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:19.484356 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad910c8-a0a7-46ec-a792-145f8770e3be None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:19.495771 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad910c8-a0a7-46ec-a792-145f8770e3be None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:19.557331 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102e03d-f232-494c-957d-e29f08c4f7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:19.557965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102e03d-f232-494c-957d-e29f08c4f7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:19.558246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102e03d-f232-494c-957d-e29f08c4f7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:19.558520 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102e03d-f232-494c-957d-e29f08c4f7a8 admin admin] PATH_INFO: `/v3/projects/7cfa7a813df8437689e2ac3290395ff5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:19.559628 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102e03d-f232-494c-957d-e29f08c4f7a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cfa7a813df8437689e2ac3290395ff5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:19.561612 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102e03d-f232-494c-957d-e29f08c4f7a8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:19.608767 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f102e03d-f232-494c-957d-e29f08c4f7a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cfa7a813df8437689e2ac3290395ff5', 'request_id': 'req-f102e03d-f232-494c-957d-e29f08c4f7a8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:19.616132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f102e03d-f232-494c-957d-e29f08c4f7a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cfa7a813df8437689e2ac3290395ff5', 'request_id': 'req-f102e03d-f232-494c-957d-e29f08c4f7a8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:19.617335 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:19.624269 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f102e03d-f232-494c-957d-e29f08c4f7a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cfa7a813df8437689e2ac3290395ff5', 'request_id': 'req-f102e03d-f232-494c-957d-e29f08c4f7a8'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:19.637923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f102e03d-f232-494c-957d-e29f08c4f7a8 admin admin] The token cache is being invalidate because project 7cfa7a813df8437689e2ac3290395ff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:01:19.638051 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f102e03d-f232-494c-957d-e29f08c4f7a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:19.638715 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f102e03d-f232-494c-957d-e29f08c4f7a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:19.640438 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1207/2432] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:01:19 2022] DELETE /identity/v3/projects/7cfa7a813df8437689e2ac3290395ff5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:19.644465 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269654e-a6ed-41b4-abec-5678e1db9242 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:19.646305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f269654e-a6ed-41b4-abec-5678e1db9242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:19.659260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269654e-a6ed-41b4-abec-5678e1db9242 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:19.691564 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:19.719688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343cd11-337f-4dd1-b253-1e8c9788daee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:19.720360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343cd11-337f-4dd1-b253-1e8c9788daee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:19.720758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343cd11-337f-4dd1-b253-1e8c9788daee admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:19.721566 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343cd11-337f-4dd1-b253-1e8c9788daee admin admin] PATH_INFO: `/v3/users/f02e82d2495b44429337319231760e8b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:19.722934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343cd11-337f-4dd1-b253-1e8c9788daee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f02e82d2495b44429337319231760e8b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:19.725536 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343cd11-337f-4dd1-b253-1e8c9788daee admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:19.774259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6343cd11-337f-4dd1-b253-1e8c9788daee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f02e82d2495b44429337319231760e8b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:19.782578 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6343cd11-337f-4dd1-b253-1e8c9788daee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f02e82d2495b44429337319231760e8b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:19.795553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6343cd11-337f-4dd1-b253-1e8c9788daee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f02e82d2495b44429337319231760e8b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:19.796226 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6343cd11-337f-4dd1-b253-1e8c9788daee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f02e82d2495b44429337319231760e8b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:19.796831 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6343cd11-337f-4dd1-b253-1e8c9788daee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f02e82d2495b44429337319231760e8b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:19.808740 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1226/2433] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:01:19 2022] DELETE /identity/v3/users/f02e82d2495b44429337319231760e8b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:19.979520 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102e03d-f232-494c-957d-e29f08c4f7a8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:19.981564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f102e03d-f232-494c-957d-e29f08c4f7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:19.997473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102e03d-f232-494c-957d-e29f08c4f7a8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:20.055327 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08824f12-677c-4efd-85a9-29b43d89ed6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:20.055955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08824f12-677c-4efd-85a9-29b43d89ed6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:20.056335 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08824f12-677c-4efd-85a9-29b43d89ed6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:20.056628 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08824f12-677c-4efd-85a9-29b43d89ed6a admin admin] PATH_INFO: `/v3/projects/2ee5ac8672584400ae606fd0b81d34d1` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:20.057742 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08824f12-677c-4efd-85a9-29b43d89ed6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ee5ac8672584400ae606fd0b81d34d1)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:20.059653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08824f12-677c-4efd-85a9-29b43d89ed6a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:20.105460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-08824f12-677c-4efd-85a9-29b43d89ed6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ee5ac8672584400ae606fd0b81d34d1', 'request_id': 'req-08824f12-677c-4efd-85a9-29b43d89ed6a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:20.112187 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-08824f12-677c-4efd-85a9-29b43d89ed6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ee5ac8672584400ae606fd0b81d34d1', 'request_id': 'req-08824f12-677c-4efd-85a9-29b43d89ed6a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:20.118026 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-08824f12-677c-4efd-85a9-29b43d89ed6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ee5ac8672584400ae606fd0b81d34d1', 'request_id': 'req-08824f12-677c-4efd-85a9-29b43d89ed6a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:20.129102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-08824f12-677c-4efd-85a9-29b43d89ed6a admin admin] The token cache is being invalidate because project 2ee5ac8672584400ae606fd0b81d34d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:01:20.129396 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-08824f12-677c-4efd-85a9-29b43d89ed6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:20.130032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-08824f12-677c-4efd-85a9-29b43d89ed6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:20.131508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1208/2434] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:01:19 2022] DELETE /identity/v3/projects/2ee5ac8672584400ae606fd0b81d34d1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:20.137182 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac74b5-b502-4cf3-947e-70a3db9962e5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:20.137467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac74b5-b502-4cf3-947e-70a3db9962e5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:20.137742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac74b5-b502-4cf3-947e-70a3db9962e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:20.158527 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-07ac74b5-b502-4cf3-947e-70a3db9962e5 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:20.159764 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-07ac74b5-b502-4cf3-947e-70a3db9962e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:20.219759 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1227/2435] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:20.227691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0a248-d9e2-46f8-b8f3-60d7797a7685 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:20.227979 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0a248-d9e2-46f8-b8f3-60d7797a7685 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:20.228283 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0a248-d9e2-46f8-b8f3-60d7797a7685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:20.248022 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7bb0a248-d9e2-46f8-b8f3-60d7797a7685 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:20.249221 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7bb0a248-d9e2-46f8-b8f3-60d7797a7685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:20.257107 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1209/2436] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:01:20.261972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac74b5-b502-4cf3-947e-70a3db9962e5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:20.271676 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac74b5-b502-4cf3-947e-70a3db9962e5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:20.276927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed5de6-d777-4cc3-9bda-57503140c569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:20.277518 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed5de6-d777-4cc3-9bda-57503140c569 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:20.277791 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed5de6-d777-4cc3-9bda-57503140c569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:20.278060 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed5de6-d777-4cc3-9bda-57503140c569 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:20.278692 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed5de6-d777-4cc3-9bda-57503140c569 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:01:20.278991 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed5de6-d777-4cc3-9bda-57503140c569 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:20.280725 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed5de6-d777-4cc3-9bda-57503140c569 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:20.293126 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1228/2437] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:01:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:01:20.297663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0a248-d9e2-46f8-b8f3-60d7797a7685 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:20.307343 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0a248-d9e2-46f8-b8f3-60d7797a7685 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:20.312160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660812e-a8b3-4230-83d2-b1f02b6272f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:20.312779 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660812e-a8b3-4230-83d2-b1f02b6272f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:20.313064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660812e-a8b3-4230-83d2-b1f02b6272f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:20.313340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660812e-a8b3-4230-83d2-b1f02b6272f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:20.313975 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660812e-a8b3-4230-83d2-b1f02b6272f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:20.315932 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4660812e-a8b3-4230-83d2-b1f02b6272f1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:20.346793 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1210/2438] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:01:20 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:01:20.351112 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed5de6-d777-4cc3-9bda-57503140c569 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:20.361458 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed5de6-d777-4cc3-9bda-57503140c569 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:20.403176 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:20.423222 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe01a32-a284-46cb-bc7b-21607a8d5f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:20.423839 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe01a32-a284-46cb-bc7b-21607a8d5f8f admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:20.424654 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe01a32-a284-46cb-bc7b-21607a8d5f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:20.424654 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe01a32-a284-46cb-bc7b-21607a8d5f8f admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:20.425070 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe01a32-a284-46cb-bc7b-21607a8d5f8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:20.427101 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe01a32-a284-46cb-bc7b-21607a8d5f8f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:20.449466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1229/2439] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:01:20 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:01:20.453527 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660812e-a8b3-4230-83d2-b1f02b6272f1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:20.464092 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660812e-a8b3-4230-83d2-b1f02b6272f1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:20.468738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2445f2-5a61-42da-a93a-2aa0ec4cb4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:20.469359 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2445f2-5a61-42da-a93a-2aa0ec4cb4bb admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:20.469637 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2445f2-5a61-42da-a93a-2aa0ec4cb4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:20.469903 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2445f2-5a61-42da-a93a-2aa0ec4cb4bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:20.470562 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2445f2-5a61-42da-a93a-2aa0ec4cb4bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:20.472193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2445f2-5a61-42da-a93a-2aa0ec4cb4bb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:20.482956 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1211/2440] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:01:20.487107 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe01a32-a284-46cb-bc7b-21607a8d5f8f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:20.497824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe01a32-a284-46cb-bc7b-21607a8d5f8f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:20.502441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341ad97e-3c5a-4599-bb6c-67b84ba08e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:20.503028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ad97e-3c5a-4599-bb6c-67b84ba08e93 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:20.503302 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ad97e-3c5a-4599-bb6c-67b84ba08e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:20.503570 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ad97e-3c5a-4599-bb6c-67b84ba08e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:20.504239 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ad97e-3c5a-4599-bb6c-67b84ba08e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:20.505803 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341ad97e-3c5a-4599-bb6c-67b84ba08e93 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:20.516593 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1230/2441] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:01:20.520586 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2445f2-5a61-42da-a93a-2aa0ec4cb4bb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:20.531324 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2445f2-5a61-42da-a93a-2aa0ec4cb4bb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:20.536180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c4762-7fd5-4979-8fcb-6b685188064d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:20.536820 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c4762-7fd5-4979-8fcb-6b685188064d admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:20.537097 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c4762-7fd5-4979-8fcb-6b685188064d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:20.537369 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c4762-7fd5-4979-8fcb-6b685188064d admin admin] PATH_INFO: `/v3/projects/ca01893c42e54bedb6000cb055b836b9/users/0dda2be09edf49caa444cc97757135b3/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:20.552507 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c4762-7fd5-4979-8fcb-6b685188064d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca01893c42e54bedb6000cb055b836b9, user_id=0dda2be09edf49caa444cc97757135b3, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:20.555228 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c4762-7fd5-4979-8fcb-6b685188064d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:20.567664 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1212/2442] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:01:20 2022] PUT /identity/v3/projects/ca01893c42e54bedb6000cb055b836b9/users/0dda2be09edf49caa444cc97757135b3/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:01:20.579287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65676329-67d4-4917-85b2-3064aeb4b104 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:20.579572 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65676329-67d4-4917-85b2-3064aeb4b104 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:20.579849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65676329-67d4-4917-85b2-3064aeb4b104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:20.608276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-65676329-67d4-4917-85b2-3064aeb4b104 None None] MFA Rules not processed for user `0dda2be09edf49caa444cc97757135b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:20.609495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-65676329-67d4-4917-85b2-3064aeb4b104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:20.672287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1231/2443] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:01:20.676809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c4762-7fd5-4979-8fcb-6b685188064d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:20.689630 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:20.740429 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c4762-7fd5-4979-8fcb-6b685188064d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:20.745950 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58aa196-ba65-494f-bf0f-2c22e162944f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:20.746552 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58aa196-ba65-494f-bf0f-2c22e162944f admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:20.746837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58aa196-ba65-494f-bf0f-2c22e162944f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:20.747111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58aa196-ba65-494f-bf0f-2c22e162944f admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:20.747747 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58aa196-ba65-494f-bf0f-2c22e162944f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:20.749708 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58aa196-ba65-494f-bf0f-2c22e162944f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:20.775911 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1213/2444] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:01:20 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:01:20.780094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65676329-67d4-4917-85b2-3064aeb4b104 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:20.791294 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65676329-67d4-4917-85b2-3064aeb4b104 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:20.848626 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01744264-5fd9-4039-bfed-59de13b5b1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:20.849227 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01744264-5fd9-4039-bfed-59de13b5b1ee admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:20.849502 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01744264-5fd9-4039-bfed-59de13b5b1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:20.849770 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01744264-5fd9-4039-bfed-59de13b5b1ee admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:20.850389 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01744264-5fd9-4039-bfed-59de13b5b1ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:20.853042 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01744264-5fd9-4039-bfed-59de13b5b1ee admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:20.876781 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1232/2445] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:01:20 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:01:20.878076 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58aa196-ba65-494f-bf0f-2c22e162944f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:20.889203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58aa196-ba65-494f-bf0f-2c22e162944f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:20.894141 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604aaaa-9dc7-4a7d-a829-cb9f3c956c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:20.894746 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604aaaa-9dc7-4a7d-a829-cb9f3c956c79 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:20.895025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604aaaa-9dc7-4a7d-a829-cb9f3c956c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:20.895297 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604aaaa-9dc7-4a7d-a829-cb9f3c956c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:20.895935 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604aaaa-9dc7-4a7d-a829-cb9f3c956c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:20.897581 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604aaaa-9dc7-4a7d-a829-cb9f3c956c79 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:20.908726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1214/2446] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:01:20.913221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01744264-5fd9-4039-bfed-59de13b5b1ee admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:20.923668 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01744264-5fd9-4039-bfed-59de13b5b1ee admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:20.928182 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d6fd4-ea33-49fe-bba0-488cd3c59615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:20.928821 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d6fd4-ea33-49fe-bba0-488cd3c59615 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:20.929097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d6fd4-ea33-49fe-bba0-488cd3c59615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:20.929369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d6fd4-ea33-49fe-bba0-488cd3c59615 admin admin] PATH_INFO: `/v3/projects/e7b018b37f2c4c55a69184656c02afdb/users/2e6b509a41af43ef85d870beeae99738/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:20.946460 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d6fd4-ea33-49fe-bba0-488cd3c59615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7b018b37f2c4c55a69184656c02afdb, user_id=2e6b509a41af43ef85d870beeae99738, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:20.949838 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d6fd4-ea33-49fe-bba0-488cd3c59615 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:20.964677 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1233/2447] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:01:20 2022] PUT /identity/v3/projects/e7b018b37f2c4c55a69184656c02afdb/users/2e6b509a41af43ef85d870beeae99738/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:20.968698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604aaaa-9dc7-4a7d-a829-cb9f3c956c79 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:20.978846 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604aaaa-9dc7-4a7d-a829-cb9f3c956c79 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:21.034970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50cec7-fbee-4021-8b59-23258ea0e5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:21.035833 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50cec7-fbee-4021-8b59-23258ea0e5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:21.036143 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50cec7-fbee-4021-8b59-23258ea0e5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:21.036419 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50cec7-fbee-4021-8b59-23258ea0e5a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:21.037055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50cec7-fbee-4021-8b59-23258ea0e5a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:21.038655 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50cec7-fbee-4021-8b59-23258ea0e5a5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:21.048261 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1215/2448] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:01:21.052484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d6fd4-ea33-49fe-bba0-488cd3c59615 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:21.063803 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d6fd4-ea33-49fe-bba0-488cd3c59615 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:21.068584 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739801bb-6b84-4aa4-bf4a-8a0ba297c82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:21.069237 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739801bb-6b84-4aa4-bf4a-8a0ba297c82f admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:21.069517 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739801bb-6b84-4aa4-bf4a-8a0ba297c82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:21.069791 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739801bb-6b84-4aa4-bf4a-8a0ba297c82f admin admin] PATH_INFO: `/v3/projects/e7b018b37f2c4c55a69184656c02afdb/users/2e6b509a41af43ef85d870beeae99738/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:21.072451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739801bb-6b84-4aa4-bf4a-8a0ba297c82f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7b018b37f2c4c55a69184656c02afdb, user_id=2e6b509a41af43ef85d870beeae99738, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:21.075104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739801bb-6b84-4aa4-bf4a-8a0ba297c82f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:21.085387 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1234/2449] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:01:21 2022] PUT /identity/v3/projects/e7b018b37f2c4c55a69184656c02afdb/users/2e6b509a41af43ef85d870beeae99738/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:21.096506 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f4a2b-900b-4288-b1c3-835fdcbeb3ea None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:21.096799 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f4a2b-900b-4288-b1c3-835fdcbeb3ea None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:21.097104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f4a2b-900b-4288-b1c3-835fdcbeb3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:21.125462 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e43f4a2b-900b-4288-b1c3-835fdcbeb3ea None None] MFA Rules not processed for user `2e6b509a41af43ef85d870beeae99738`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:21.126781 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e43f4a2b-900b-4288-b1c3-835fdcbeb3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:21.198589 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1216/2450] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:21.209976 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739801bb-6b84-4aa4-bf4a-8a0ba297c82f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:21.211716 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-739801bb-6b84-4aa4-bf4a-8a0ba297c82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:21.217761 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:21.271883 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739801bb-6b84-4aa4-bf4a-8a0ba297c82f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:21.275723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c0158-2270-4110-a356-3398e88108b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:21.276360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c0158-2270-4110-a356-3398e88108b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:21.276645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c0158-2270-4110-a356-3398e88108b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:21.276922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c0158-2270-4110-a356-3398e88108b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:21.286228 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c0158-2270-4110-a356-3398e88108b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:21.287665 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c0158-2270-4110-a356-3398e88108b8 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:21.297430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1235/2451] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:21.344253 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f4a2b-900b-4288-b1c3-835fdcbeb3ea None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:21.345650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e43f4a2b-900b-4288-b1c3-835fdcbeb3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:21.357878 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f4a2b-900b-4288-b1c3-835fdcbeb3ea None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:21.361522 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b017c1-00fb-4038-912c-c67a4f8e1c55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:21.362125 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b017c1-00fb-4038-912c-c67a4f8e1c55 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:21.362408 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b017c1-00fb-4038-912c-c67a4f8e1c55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:21.362717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b017c1-00fb-4038-912c-c67a4f8e1c55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:21.366796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:21.423702 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b017c1-00fb-4038-912c-c67a4f8e1c55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:21.425197 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b017c1-00fb-4038-912c-c67a4f8e1c55 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:21.434213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1217/2452] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:23.960179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079cac4-3eea-4380-b69e-38c0c17d94d0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:23.960735 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079cac4-3eea-4380-b69e-38c0c17d94d0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:23.960735 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079cac4-3eea-4380-b69e-38c0c17d94d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:23.981239 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6079cac4-3eea-4380-b69e-38c0c17d94d0 None None] MFA Rules not processed for user `e51ae6959aac49898e75c6786c5dbdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:23.982441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6079cac4-3eea-4380-b69e-38c0c17d94d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:24.039961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1236/2453] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Sep 9 21:01:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:24.085163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b017c1-00fb-4038-912c-c67a4f8e1c55 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:24.086591 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f2b017c1-00fb-4038-912c-c67a4f8e1c55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:24.157151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b017c1-00fb-4038-912c-c67a4f8e1c55 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:24.162392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac4e2b-0ecf-4f21-85c9-ab751fe0f29d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9570eaa112de460cb9e371278bfb300b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:24.163000 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac4e2b-0ecf-4f21-85c9-ab751fe0f29d service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:24.163282 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac4e2b-0ecf-4f21-85c9-ab751fe0f29d service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:24.163556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac4e2b-0ecf-4f21-85c9-ab751fe0f29d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:24.171968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac4e2b-0ecf-4f21-85c9-ab751fe0f29d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:24.173604 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac4e2b-0ecf-4f21-85c9-ab751fe0f29d service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:24.181929 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1218/2454] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Sep 9 21:01:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 21:01:25.063687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079cac4-3eea-4380-b69e-38c0c17d94d0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:25.163085 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079cac4-3eea-4380-b69e-38c0c17d94d0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:25.169653 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5fc8f-65bd-408f-a242-273e518206ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:25.170772 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5fc8f-65bd-408f-a242-273e518206ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:25.171338 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5fc8f-65bd-408f-a242-273e518206ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:25.171804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5fc8f-65bd-408f-a242-273e518206ad admin admin] PATH_INFO: `/v3/users/0dda2be09edf49caa444cc97757135b3` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:25.173463 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5fc8f-65bd-408f-a242-273e518206ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dda2be09edf49caa444cc97757135b3)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:25.178581 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5fc8f-65bd-408f-a242-273e518206ad admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:25.254610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-97d5fc8f-65bd-408f-a242-273e518206ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dda2be09edf49caa444cc97757135b3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:25.258757 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:25.266038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-97d5fc8f-65bd-408f-a242-273e518206ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dda2be09edf49caa444cc97757135b3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:25.296400 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-97d5fc8f-65bd-408f-a242-273e518206ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dda2be09edf49caa444cc97757135b3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:25.297577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-97d5fc8f-65bd-408f-a242-273e518206ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dda2be09edf49caa444cc97757135b3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:25.298381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-97d5fc8f-65bd-408f-a242-273e518206ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dda2be09edf49caa444cc97757135b3'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:25.322253 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1237/2455] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:01:25 2022] DELETE /identity/v3/users/0dda2be09edf49caa444cc97757135b3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:25.326766 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a4e36-4edf-4d28-b595-c44395180c17 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:25.328070 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a4e36-4edf-4d28-b595-c44395180c17 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:25.328608 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a4e36-4edf-4d28-b595-c44395180c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:25.363900 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-643a4e36-4edf-4d28-b595-c44395180c17 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:25.365589 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-643a4e36-4edf-4d28-b595-c44395180c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:25.434065 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1219/2456] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:25.443970 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5fc8f-65bd-408f-a242-273e518206ad admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:25.445553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-97d5fc8f-65bd-408f-a242-273e518206ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:25.514711 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5fc8f-65bd-408f-a242-273e518206ad admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:25.518615 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee5e7b-8735-40da-9311-e9996713298d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:25.519355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee5e7b-8735-40da-9311-e9996713298d service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:25.519703 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee5e7b-8735-40da-9311-e9996713298d service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:25.520081 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee5e7b-8735-40da-9311-e9996713298d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:25.531556 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee5e7b-8735-40da-9311-e9996713298d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:25.533017 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ee5e7b-8735-40da-9311-e9996713298d service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:25.547081 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1238/2457] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:25.859868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a4e36-4edf-4d28-b595-c44395180c17 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:25.861486 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-643a4e36-4edf-4d28-b595-c44395180c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:25.877327 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a4e36-4edf-4d28-b595-c44395180c17 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:25.883108 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ef1ab-aaa1-4153-8781-e737bd9cf030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:25.884713 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ef1ab-aaa1-4153-8781-e737bd9cf030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:25.885184 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ef1ab-aaa1-4153-8781-e737bd9cf030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:25.885615 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ef1ab-aaa1-4153-8781-e737bd9cf030 admin admin] PATH_INFO: `/v3/projects/ca01893c42e54bedb6000cb055b836b9` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:25.886959 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ef1ab-aaa1-4153-8781-e737bd9cf030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca01893c42e54bedb6000cb055b836b9)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:25.889497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ef1ab-aaa1-4153-8781-e737bd9cf030 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:25.937071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:25.954828 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e89ef1ab-aaa1-4153-8781-e737bd9cf030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca01893c42e54bedb6000cb055b836b9', 'request_id': 'req-e89ef1ab-aaa1-4153-8781-e737bd9cf030'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:25.963567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e89ef1ab-aaa1-4153-8781-e737bd9cf030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca01893c42e54bedb6000cb055b836b9', 'request_id': 'req-e89ef1ab-aaa1-4153-8781-e737bd9cf030'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:25.969629 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e89ef1ab-aaa1-4153-8781-e737bd9cf030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca01893c42e54bedb6000cb055b836b9', 'request_id': 'req-e89ef1ab-aaa1-4153-8781-e737bd9cf030'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:25.982961 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e89ef1ab-aaa1-4153-8781-e737bd9cf030 admin admin] The token cache is being invalidate because project ca01893c42e54bedb6000cb055b836b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:01:25.983249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e89ef1ab-aaa1-4153-8781-e737bd9cf030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:25.983899 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-e89ef1ab-aaa1-4153-8781-e737bd9cf030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:25.985405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1220/2458] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:01:25 2022] DELETE /identity/v3/projects/ca01893c42e54bedb6000cb055b836b9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:25.989769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee5e7b-8735-40da-9311-e9996713298d service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:26.002779 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ee5e7b-8735-40da-9311-e9996713298d service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:26.074833 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49bc8e-e47f-4b8b-961d-19f9eb026dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:26.075637 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49bc8e-e47f-4b8b-961d-19f9eb026dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:26.076052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49bc8e-e47f-4b8b-961d-19f9eb026dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:26.076431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49bc8e-e47f-4b8b-961d-19f9eb026dfe admin admin] PATH_INFO: `/v3/users/2e6b509a41af43ef85d870beeae99738` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:26.077686 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49bc8e-e47f-4b8b-961d-19f9eb026dfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e6b509a41af43ef85d870beeae99738)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:26.079725 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49bc8e-e47f-4b8b-961d-19f9eb026dfe admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:26.135415 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2a49bc8e-e47f-4b8b-961d-19f9eb026dfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e6b509a41af43ef85d870beeae99738'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:26.144380 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2a49bc8e-e47f-4b8b-961d-19f9eb026dfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e6b509a41af43ef85d870beeae99738'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:26.158050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2a49bc8e-e47f-4b8b-961d-19f9eb026dfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e6b509a41af43ef85d870beeae99738'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:26.159124 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2a49bc8e-e47f-4b8b-961d-19f9eb026dfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e6b509a41af43ef85d870beeae99738'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:26.159742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2a49bc8e-e47f-4b8b-961d-19f9eb026dfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e6b509a41af43ef85d870beeae99738'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:26.162469 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:26.180332 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1239/2459] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:01:25 2022] DELETE /identity/v3/users/2e6b509a41af43ef85d870beeae99738 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:26.502908 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ef1ab-aaa1-4153-8781-e737bd9cf030 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:26.505095 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e89ef1ab-aaa1-4153-8781-e737bd9cf030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:26.527857 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ef1ab-aaa1-4153-8781-e737bd9cf030 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:26.605500 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad55fae-fbf0-4476-adb3-97d664a094aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:26.606163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad55fae-fbf0-4476-adb3-97d664a094aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:26.606464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad55fae-fbf0-4476-adb3-97d664a094aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:26.606740 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad55fae-fbf0-4476-adb3-97d664a094aa admin admin] PATH_INFO: `/v3/projects/e7b018b37f2c4c55a69184656c02afdb` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:26.607884 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad55fae-fbf0-4476-adb3-97d664a094aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7b018b37f2c4c55a69184656c02afdb)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:26.609852 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad55fae-fbf0-4476-adb3-97d664a094aa admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:26.669583 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7ad55fae-fbf0-4476-adb3-97d664a094aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7b018b37f2c4c55a69184656c02afdb', 'request_id': 'req-7ad55fae-fbf0-4476-adb3-97d664a094aa'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:26.679482 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7ad55fae-fbf0-4476-adb3-97d664a094aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7b018b37f2c4c55a69184656c02afdb', 'request_id': 'req-7ad55fae-fbf0-4476-adb3-97d664a094aa'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:26.686732 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7ad55fae-fbf0-4476-adb3-97d664a094aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7b018b37f2c4c55a69184656c02afdb', 'request_id': 'req-7ad55fae-fbf0-4476-adb3-97d664a094aa'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:26.700913 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7ad55fae-fbf0-4476-adb3-97d664a094aa admin admin] The token cache is being invalidate because project e7b018b37f2c4c55a69184656c02afdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:01:26.701203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7ad55fae-fbf0-4476-adb3-97d664a094aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:26.701874 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7ad55fae-fbf0-4476-adb3-97d664a094aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:26.703569 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1221/2460] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:01:26 2022] DELETE /identity/v3/projects/e7b018b37f2c4c55a69184656c02afdb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:26.708424 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7705ef2-e004-4f02-852e-07d4049371fd None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:26.708828 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7705ef2-e004-4f02-852e-07d4049371fd None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:26.709247 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7705ef2-e004-4f02-852e-07d4049371fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:26.741345 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d7705ef2-e004-4f02-852e-07d4049371fd None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:26.742928 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d7705ef2-e004-4f02-852e-07d4049371fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:26.809197 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1240/2461] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:01:26.817375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd84ca-4935-4015-ac18-d414c59cdf32 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:26.817657 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd84ca-4935-4015-ac18-d414c59cdf32 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:26.817939 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd84ca-4935-4015-ac18-d414c59cdf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:26.839875 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fcdd84ca-4935-4015-ac18-d414c59cdf32 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:26.841149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fcdd84ca-4935-4015-ac18-d414c59cdf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:26.851617 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1222/2462] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:26.856235 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7705ef2-e004-4f02-852e-07d4049371fd None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:26.866903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7705ef2-e004-4f02-852e-07d4049371fd None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:26.873736 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3c37e-a7c7-4259-8c05-25ae19d462fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:26.874365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3c37e-a7c7-4259-8c05-25ae19d462fd admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:26.874789 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3c37e-a7c7-4259-8c05-25ae19d462fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:26.875070 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3c37e-a7c7-4259-8c05-25ae19d462fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:26.875858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3c37e-a7c7-4259-8c05-25ae19d462fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:01:26.876212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3c37e-a7c7-4259-8c05-25ae19d462fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:26.877877 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3c37e-a7c7-4259-8c05-25ae19d462fd admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:26.893613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1241/2463] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:01:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:01:26.898397 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd84ca-4935-4015-ac18-d414c59cdf32 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:26.908013 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd84ca-4935-4015-ac18-d414c59cdf32 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:26.916260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fefab4-013b-461f-aaea-f5904fa4a255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:26.916883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fefab4-013b-461f-aaea-f5904fa4a255 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:26.917166 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fefab4-013b-461f-aaea-f5904fa4a255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:26.917446 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fefab4-013b-461f-aaea-f5904fa4a255 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:26.918078 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fefab4-013b-461f-aaea-f5904fa4a255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:26.920091 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fefab4-013b-461f-aaea-f5904fa4a255 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:26.956040 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1223/2464] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:01:26 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:01:26.961402 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3c37e-a7c7-4259-8c05-25ae19d462fd admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:26.972794 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3c37e-a7c7-4259-8c05-25ae19d462fd admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:27.043245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a95066-9e2a-4932-9f6f-b25b2fb7b520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:27.043883 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a95066-9e2a-4932-9f6f-b25b2fb7b520 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:27.044192 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a95066-9e2a-4932-9f6f-b25b2fb7b520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:27.044469 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a95066-9e2a-4932-9f6f-b25b2fb7b520 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:27.045138 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a95066-9e2a-4932-9f6f-b25b2fb7b520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:27.047201 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a95066-9e2a-4932-9f6f-b25b2fb7b520 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:27.081847 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1242/2465] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:01:26 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:01:27.083147 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fefab4-013b-461f-aaea-f5904fa4a255 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:27.094990 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fefab4-013b-461f-aaea-f5904fa4a255 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:27.100414 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b40b35-e5f9-40c5-8150-f3d97bb2dba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:27.101112 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b40b35-e5f9-40c5-8150-f3d97bb2dba0 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:27.101403 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b40b35-e5f9-40c5-8150-f3d97bb2dba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:27.101679 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b40b35-e5f9-40c5-8150-f3d97bb2dba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:27.102361 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b40b35-e5f9-40c5-8150-f3d97bb2dba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:27.104720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b40b35-e5f9-40c5-8150-f3d97bb2dba0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:27.116327 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1224/2466] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:01:27.121524 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a95066-9e2a-4932-9f6f-b25b2fb7b520 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:27.132065 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a95066-9e2a-4932-9f6f-b25b2fb7b520 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:27.136902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffc019-becd-428e-acf9-38840b1abee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:27.137577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffc019-becd-428e-acf9-38840b1abee4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:27.137955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffc019-becd-428e-acf9-38840b1abee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:27.138292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffc019-becd-428e-acf9-38840b1abee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:27.139001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffc019-becd-428e-acf9-38840b1abee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:27.140730 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffc019-becd-428e-acf9-38840b1abee4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:27.166199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1243/2467] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:01:27.170505 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b40b35-e5f9-40c5-8150-f3d97bb2dba0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:27.197982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b40b35-e5f9-40c5-8150-f3d97bb2dba0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:27.202719 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933eaa6d-c16e-4955-a718-5ab969d48cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:27.203382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933eaa6d-c16e-4955-a718-5ab969d48cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:27.203663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933eaa6d-c16e-4955-a718-5ab969d48cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:27.203934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933eaa6d-c16e-4955-a718-5ab969d48cf4 admin admin] PATH_INFO: `/v3/projects/0b1713cdd63c4ca9ac9f26e06a0ff751/users/0fb4ac4236c84681bdc9ae0ded448c67/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:27.207932 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:27.221399 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933eaa6d-c16e-4955-a718-5ab969d48cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1713cdd63c4ca9ac9f26e06a0ff751, user_id=0fb4ac4236c84681bdc9ae0ded448c67, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:27.224306 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933eaa6d-c16e-4955-a718-5ab969d48cf4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:27.240928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1225/2468] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:01:27 2022] PUT /identity/v3/projects/0b1713cdd63c4ca9ac9f26e06a0ff751/users/0fb4ac4236c84681bdc9ae0ded448c67/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:27.253694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dbfab-638e-4772-9553-77210d9774a4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:27.253950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dbfab-638e-4772-9553-77210d9774a4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:27.254276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dbfab-638e-4772-9553-77210d9774a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:27.288909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-022dbfab-638e-4772-9553-77210d9774a4 None None] MFA Rules not processed for user `0fb4ac4236c84681bdc9ae0ded448c67`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:27.291067 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-022dbfab-638e-4772-9553-77210d9774a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:27.347355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:27.371227 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1244/2469] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:27.376123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933eaa6d-c16e-4955-a718-5ab969d48cf4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:27.447955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933eaa6d-c16e-4955-a718-5ab969d48cf4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:27.454636 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c79d71-fe46-4ea6-92cb-53111f3d14e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:27.455378 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c79d71-fe46-4ea6-92cb-53111f3d14e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:27.455756 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c79d71-fe46-4ea6-92cb-53111f3d14e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:27.456140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c79d71-fe46-4ea6-92cb-53111f3d14e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:27.456863 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c79d71-fe46-4ea6-92cb-53111f3d14e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:27.458896 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c79d71-fe46-4ea6-92cb-53111f3d14e1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:27.493455 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1226/2470] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:01:27 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:01:27.496690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022dbfab-638e-4772-9553-77210d9774a4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:27.508957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022dbfab-638e-4772-9553-77210d9774a4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:27.574297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e27952-3a5e-4e60-ac5f-c4353dd53f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:27.575285 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e27952-3a5e-4e60-ac5f-c4353dd53f0f admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:27.575713 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e27952-3a5e-4e60-ac5f-c4353dd53f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:27.576199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e27952-3a5e-4e60-ac5f-c4353dd53f0f admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:27.576862 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e27952-3a5e-4e60-ac5f-c4353dd53f0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:27.578930 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e27952-3a5e-4e60-ac5f-c4353dd53f0f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:27.614562 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1245/2471] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:01:27 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:01:27.619177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c79d71-fe46-4ea6-92cb-53111f3d14e1 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:27.642712 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c79d71-fe46-4ea6-92cb-53111f3d14e1 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:27.648689 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0013776-8188-4bbc-a1e3-051e9367975d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:27.649329 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0013776-8188-4bbc-a1e3-051e9367975d admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:27.650406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0013776-8188-4bbc-a1e3-051e9367975d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:27.650741 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0013776-8188-4bbc-a1e3-051e9367975d admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:27.651394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0013776-8188-4bbc-a1e3-051e9367975d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:27.653033 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0013776-8188-4bbc-a1e3-051e9367975d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:27.668472 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1227/2472] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:01:27.670497 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e27952-3a5e-4e60-ac5f-c4353dd53f0f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:27.681736 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e27952-3a5e-4e60-ac5f-c4353dd53f0f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:27.688500 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb573d-b6e7-428a-9f89-674bcf8344a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:27.689329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb573d-b6e7-428a-9f89-674bcf8344a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:27.689764 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb573d-b6e7-428a-9f89-674bcf8344a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:27.692997 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb573d-b6e7-428a-9f89-674bcf8344a9 admin admin] PATH_INFO: `/v3/projects/78eab2d351554f469dd00d3428b98b0a/users/e8144e6e6d3b42ef89bf2981a3221c58/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:27.713750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb573d-b6e7-428a-9f89-674bcf8344a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78eab2d351554f469dd00d3428b98b0a, user_id=e8144e6e6d3b42ef89bf2981a3221c58, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:27.717873 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb573d-b6e7-428a-9f89-674bcf8344a9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:27.738126 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1246/2473] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:01:27 2022] PUT /identity/v3/projects/78eab2d351554f469dd00d3428b98b0a/users/e8144e6e6d3b42ef89bf2981a3221c58/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:27.742020 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0013776-8188-4bbc-a1e3-051e9367975d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:27.753718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0013776-8188-4bbc-a1e3-051e9367975d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:27.829632 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080ca71-4431-4e49-a9c0-c07e102ef418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:27.830251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080ca71-4431-4e49-a9c0-c07e102ef418 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:27.830527 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080ca71-4431-4e49-a9c0-c07e102ef418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:27.830803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080ca71-4431-4e49-a9c0-c07e102ef418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:27.831448 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080ca71-4431-4e49-a9c0-c07e102ef418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:27.833183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080ca71-4431-4e49-a9c0-c07e102ef418 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:27.844878 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1228/2474] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:27 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:01:27.850878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb573d-b6e7-428a-9f89-674bcf8344a9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:27.862606 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb573d-b6e7-428a-9f89-674bcf8344a9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:27.867844 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4f436-6e46-46be-ae89-5ffdbbc3bf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:27.869108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4f436-6e46-46be-ae89-5ffdbbc3bf77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:27.869385 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4f436-6e46-46be-ae89-5ffdbbc3bf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:27.869751 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4f436-6e46-46be-ae89-5ffdbbc3bf77 admin admin] PATH_INFO: `/v3/projects/78eab2d351554f469dd00d3428b98b0a/users/e8144e6e6d3b42ef89bf2981a3221c58/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:27.871714 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4f436-6e46-46be-ae89-5ffdbbc3bf77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78eab2d351554f469dd00d3428b98b0a, user_id=e8144e6e6d3b42ef89bf2981a3221c58, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:27.874557 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4f436-6e46-46be-ae89-5ffdbbc3bf77 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:27.894864 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1247/2475] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:01:27 2022] PUT /identity/v3/projects/78eab2d351554f469dd00d3428b98b0a/users/e8144e6e6d3b42ef89bf2981a3221c58/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:27.896344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18458061-fa8a-458c-b005-78612e13e4bb None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:27.896644 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18458061-fa8a-458c-b005-78612e13e4bb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:27.896971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18458061-fa8a-458c-b005-78612e13e4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:27.930183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-18458061-fa8a-458c-b005-78612e13e4bb None None] MFA Rules not processed for user `e8144e6e6d3b42ef89bf2981a3221c58`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:27.932024 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-18458061-fa8a-458c-b005-78612e13e4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:27.989422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:28.024012 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1229/2476] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:01:28.036995 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4f436-6e46-46be-ae89-5ffdbbc3bf77 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:28.038798 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0bf4f436-6e46-46be-ae89-5ffdbbc3bf77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:28.108900 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4f436-6e46-46be-ae89-5ffdbbc3bf77 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:28.115125 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8105e68-dcad-478b-9ae7-e89092512298 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:28.116281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8105e68-dcad-478b-9ae7-e89092512298 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:28.116857 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8105e68-dcad-478b-9ae7-e89092512298 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:28.117106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8105e68-dcad-478b-9ae7-e89092512298 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:28.184885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:28.190359 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8105e68-dcad-478b-9ae7-e89092512298 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:28.192258 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8105e68-dcad-478b-9ae7-e89092512298 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:28.205931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1248/2477] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:29.658273 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18458061-fa8a-458c-b005-78612e13e4bb None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:29.659681 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-18458061-fa8a-458c-b005-78612e13e4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:29.673690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18458061-fa8a-458c-b005-78612e13e4bb None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:29.677773 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4036c6-eecf-40a5-98ef-bffb6f4c33d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:29.678562 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4036c6-eecf-40a5-98ef-bffb6f4c33d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:29.678909 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4036c6-eecf-40a5-98ef-bffb6f4c33d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:29.679185 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4036c6-eecf-40a5-98ef-bffb6f4c33d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:29.706772 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4036c6-eecf-40a5-98ef-bffb6f4c33d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:29.708335 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4036c6-eecf-40a5-98ef-bffb6f4c33d7 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:29.721064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1230/2478] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:29 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:33.652385 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8105e68-dcad-478b-9ae7-e89092512298 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:33.715494 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8105e68-dcad-478b-9ae7-e89092512298 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:33.720101 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982fa59-4f00-405b-95b7-75a563adcbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:33.720729 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982fa59-4f00-405b-95b7-75a563adcbcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:33.721005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982fa59-4f00-405b-95b7-75a563adcbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:33.721278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982fa59-4f00-405b-95b7-75a563adcbcf admin admin] PATH_INFO: `/v3/users/0fb4ac4236c84681bdc9ae0ded448c67` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:33.722403 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982fa59-4f00-405b-95b7-75a563adcbcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fb4ac4236c84681bdc9ae0ded448c67)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:33.724368 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982fa59-4f00-405b-95b7-75a563adcbcf admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:33.772831 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4982fa59-4f00-405b-95b7-75a563adcbcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fb4ac4236c84681bdc9ae0ded448c67'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:33.781557 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4982fa59-4f00-405b-95b7-75a563adcbcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fb4ac4236c84681bdc9ae0ded448c67'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:33.795221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4982fa59-4f00-405b-95b7-75a563adcbcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fb4ac4236c84681bdc9ae0ded448c67'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:33.796032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4982fa59-4f00-405b-95b7-75a563adcbcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fb4ac4236c84681bdc9ae0ded448c67'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:33.796767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4982fa59-4f00-405b-95b7-75a563adcbcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fb4ac4236c84681bdc9ae0ded448c67'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:33.810357 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1249/2479] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:01:33 2022] DELETE /identity/v3/users/0fb4ac4236c84681bdc9ae0ded448c67 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:01:33.814676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128eaff2-bb5a-4521-a249-5b88d369ec40 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:33.815174 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128eaff2-bb5a-4521-a249-5b88d369ec40 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:33.815294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128eaff2-bb5a-4521-a249-5b88d369ec40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:33.834228 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-128eaff2-bb5a-4521-a249-5b88d369ec40 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:33.835458 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-128eaff2-bb5a-4521-a249-5b88d369ec40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:33.895520 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1231/2480] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:33.905855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982fa59-4f00-405b-95b7-75a563adcbcf admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:33.907304 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4982fa59-4f00-405b-95b7-75a563adcbcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:33.970202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982fa59-4f00-405b-95b7-75a563adcbcf admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:33.975577 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49746a82-5900-4773-9b07-6ab42439041c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:33.976319 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49746a82-5900-4773-9b07-6ab42439041c service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:33.976677 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49746a82-5900-4773-9b07-6ab42439041c service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:33.977026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49746a82-5900-4773-9b07-6ab42439041c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:33.987606 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49746a82-5900-4773-9b07-6ab42439041c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:33.989088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49746a82-5900-4773-9b07-6ab42439041c service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:33.999158 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1250/2481] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:34.076367 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128eaff2-bb5a-4521-a249-5b88d369ec40 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:34.077859 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-128eaff2-bb5a-4521-a249-5b88d369ec40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:34.093151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128eaff2-bb5a-4521-a249-5b88d369ec40 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:34.096926 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ab828-b6b8-4d11-a0f0-1dd9bc1dfc54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:34.097539 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ab828-b6b8-4d11-a0f0-1dd9bc1dfc54 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:34.097836 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ab828-b6b8-4d11-a0f0-1dd9bc1dfc54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:34.098298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ab828-b6b8-4d11-a0f0-1dd9bc1dfc54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:34.100029 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8b0ab828-b6b8-4d11-a0f0-1dd9bc1dfc54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:34.109769 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ab828-b6b8-4d11-a0f0-1dd9bc1dfc54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:34.111206 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0ab828-b6b8-4d11-a0f0-1dd9bc1dfc54 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:34.120036 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1232/2482] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:34.279331 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49746a82-5900-4773-9b07-6ab42439041c service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:34.280857 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-49746a82-5900-4773-9b07-6ab42439041c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:34.312241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49746a82-5900-4773-9b07-6ab42439041c service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:34.316956 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b1a81-64d5-4ff3-a08e-39c6d15f4b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:34.317583 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b1a81-64d5-4ff3-a08e-39c6d15f4b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:34.317860 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b1a81-64d5-4ff3-a08e-39c6d15f4b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:34.318127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b1a81-64d5-4ff3-a08e-39c6d15f4b1a admin admin] PATH_INFO: `/v3/projects/0b1713cdd63c4ca9ac9f26e06a0ff751` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:34.319241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b1a81-64d5-4ff3-a08e-39c6d15f4b1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1713cdd63c4ca9ac9f26e06a0ff751)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:34.321347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b1a81-64d5-4ff3-a08e-39c6d15f4b1a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:34.332325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:34.370543 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-713b1a81-64d5-4ff3-a08e-39c6d15f4b1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1713cdd63c4ca9ac9f26e06a0ff751', 'request_id': 'req-713b1a81-64d5-4ff3-a08e-39c6d15f4b1a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:34.378587 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-713b1a81-64d5-4ff3-a08e-39c6d15f4b1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1713cdd63c4ca9ac9f26e06a0ff751', 'request_id': 'req-713b1a81-64d5-4ff3-a08e-39c6d15f4b1a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:34.386099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-713b1a81-64d5-4ff3-a08e-39c6d15f4b1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1713cdd63c4ca9ac9f26e06a0ff751', 'request_id': 'req-713b1a81-64d5-4ff3-a08e-39c6d15f4b1a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:34.397118 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-713b1a81-64d5-4ff3-a08e-39c6d15f4b1a admin admin] The token cache is being invalidate because project 0b1713cdd63c4ca9ac9f26e06a0ff751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:01:34.397409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-713b1a81-64d5-4ff3-a08e-39c6d15f4b1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:34.398040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-713b1a81-64d5-4ff3-a08e-39c6d15f4b1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:34.400484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1251/2483] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:01:34 2022] DELETE /identity/v3/projects/0b1713cdd63c4ca9ac9f26e06a0ff751 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:34.404530 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ab828-b6b8-4d11-a0f0-1dd9bc1dfc54 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:34.417156 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ab828-b6b8-4d11-a0f0-1dd9bc1dfc54 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:34.478497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d531dc5-355d-409c-9727-7e5c5700b1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:34.479135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d531dc5-355d-409c-9727-7e5c5700b1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:34.479413 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d531dc5-355d-409c-9727-7e5c5700b1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:34.479692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d531dc5-355d-409c-9727-7e5c5700b1ff admin admin] PATH_INFO: `/v3/users/e8144e6e6d3b42ef89bf2981a3221c58` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:34.480870 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d531dc5-355d-409c-9727-7e5c5700b1ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8144e6e6d3b42ef89bf2981a3221c58)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:34.482812 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d531dc5-355d-409c-9727-7e5c5700b1ff admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:34.531322 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7d531dc5-355d-409c-9727-7e5c5700b1ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8144e6e6d3b42ef89bf2981a3221c58'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:34.540245 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7d531dc5-355d-409c-9727-7e5c5700b1ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8144e6e6d3b42ef89bf2981a3221c58'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:34.541050 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7d531dc5-355d-409c-9727-7e5c5700b1ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8144e6e6d3b42ef89bf2981a3221c58'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:34.541659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7d531dc5-355d-409c-9727-7e5c5700b1ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8144e6e6d3b42ef89bf2981a3221c58'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:34.543782 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:34.551040 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-7d531dc5-355d-409c-9727-7e5c5700b1ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8144e6e6d3b42ef89bf2981a3221c58'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:34.570589 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1233/2484] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:01:34 2022] DELETE /identity/v3/users/e8144e6e6d3b42ef89bf2981a3221c58 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:34.836545 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b1a81-64d5-4ff3-a08e-39c6d15f4b1a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:34.838504 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-713b1a81-64d5-4ff3-a08e-39c6d15f4b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:34.851545 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b1a81-64d5-4ff3-a08e-39c6d15f4b1a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:34.911099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc1a87-80aa-43b3-be35-9c7ba90dac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:34.911732 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc1a87-80aa-43b3-be35-9c7ba90dac7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:34.912032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc1a87-80aa-43b3-be35-9c7ba90dac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:34.912311 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc1a87-80aa-43b3-be35-9c7ba90dac7e admin admin] PATH_INFO: `/v3/projects/78eab2d351554f469dd00d3428b98b0a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:34.913430 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc1a87-80aa-43b3-be35-9c7ba90dac7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=78eab2d351554f469dd00d3428b98b0a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:34.915370 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc1a87-80aa-43b3-be35-9c7ba90dac7e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:34.963835 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-79dc1a87-80aa-43b3-be35-9c7ba90dac7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78eab2d351554f469dd00d3428b98b0a', 'request_id': 'req-79dc1a87-80aa-43b3-be35-9c7ba90dac7e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:34.972305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-79dc1a87-80aa-43b3-be35-9c7ba90dac7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78eab2d351554f469dd00d3428b98b0a', 'request_id': 'req-79dc1a87-80aa-43b3-be35-9c7ba90dac7e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:34.978221 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-79dc1a87-80aa-43b3-be35-9c7ba90dac7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78eab2d351554f469dd00d3428b98b0a', 'request_id': 'req-79dc1a87-80aa-43b3-be35-9c7ba90dac7e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:34.989984 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-79dc1a87-80aa-43b3-be35-9c7ba90dac7e admin admin] The token cache is being invalidate because project 78eab2d351554f469dd00d3428b98b0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:01:34.990273 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-79dc1a87-80aa-43b3-be35-9c7ba90dac7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:34.990929 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-79dc1a87-80aa-43b3-be35-9c7ba90dac7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:34.992652 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1252/2485] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:01:34 2022] DELETE /identity/v3/projects/78eab2d351554f469dd00d3428b98b0a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:34.998303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620d55f-7902-49fa-b337-8af49046c26a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:34.998810 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620d55f-7902-49fa-b337-8af49046c26a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:34.998926 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620d55f-7902-49fa-b337-8af49046c26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:35.019560 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e620d55f-7902-49fa-b337-8af49046c26a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:35.020860 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e620d55f-7902-49fa-b337-8af49046c26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:35.081147 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1234/2486] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:35.089722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515f694-4b44-4699-9f43-f8e2d0b8d2b8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:35.089951 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515f694-4b44-4699-9f43-f8e2d0b8d2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:35.090229 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515f694-4b44-4699-9f43-f8e2d0b8d2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:35.110189 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-c515f694-4b44-4699-9f43-f8e2d0b8d2b8 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:35.111392 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-c515f694-4b44-4699-9f43-f8e2d0b8d2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:35.119414 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1253/2487] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:01:35.123712 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620d55f-7902-49fa-b337-8af49046c26a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:35.133232 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620d55f-7902-49fa-b337-8af49046c26a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:35.138340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18929f2e-0f98-49d9-9a35-a282b7c1b920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:35.138929 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18929f2e-0f98-49d9-9a35-a282b7c1b920 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:35.139203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18929f2e-0f98-49d9-9a35-a282b7c1b920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:35.139469 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18929f2e-0f98-49d9-9a35-a282b7c1b920 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:35.140186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18929f2e-0f98-49d9-9a35-a282b7c1b920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:01:35.140521 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18929f2e-0f98-49d9-9a35-a282b7c1b920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:35.143411 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18929f2e-0f98-49d9-9a35-a282b7c1b920 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:35.159672 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1235/2488] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:01:35.164463 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515f694-4b44-4699-9f43-f8e2d0b8d2b8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:35.173955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c515f694-4b44-4699-9f43-f8e2d0b8d2b8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:35.178647 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7e2b0-b6d0-4f43-88e7-35b5089703cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:35.179245 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7e2b0-b6d0-4f43-88e7-35b5089703cd admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:35.179524 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7e2b0-b6d0-4f43-88e7-35b5089703cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:35.179794 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7e2b0-b6d0-4f43-88e7-35b5089703cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:35.180490 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7e2b0-b6d0-4f43-88e7-35b5089703cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:35.182486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7e2b0-b6d0-4f43-88e7-35b5089703cd admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:35.204025 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:35.215729 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1254/2489] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:01:35 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:01:35.216861 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18929f2e-0f98-49d9-9a35-a282b7c1b920 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:35.226698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18929f2e-0f98-49d9-9a35-a282b7c1b920 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:35.281942 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c3c23-fbeb-4220-b2ad-8421efb6a40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:35.282543 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c3c23-fbeb-4220-b2ad-8421efb6a40f admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:35.282818 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c3c23-fbeb-4220-b2ad-8421efb6a40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:35.283114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c3c23-fbeb-4220-b2ad-8421efb6a40f admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:35.283753 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c3c23-fbeb-4220-b2ad-8421efb6a40f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:35.285979 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c3c23-fbeb-4220-b2ad-8421efb6a40f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:35.308295 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1236/2490] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:01:35 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:01:35.312621 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7e2b0-b6d0-4f43-88e7-35b5089703cd admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:35.323475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7e2b0-b6d0-4f43-88e7-35b5089703cd admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:35.328172 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c64ef7-fdcd-4a3d-b631-7d8a85667ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:35.328769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c64ef7-fdcd-4a3d-b631-7d8a85667ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:35.329047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c64ef7-fdcd-4a3d-b631-7d8a85667ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:35.329322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c64ef7-fdcd-4a3d-b631-7d8a85667ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:35.329969 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c64ef7-fdcd-4a3d-b631-7d8a85667ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:35.331555 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c64ef7-fdcd-4a3d-b631-7d8a85667ea4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:35.342176 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1255/2491] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:01:35.346007 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c3c23-fbeb-4220-b2ad-8421efb6a40f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:35.357202 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c3c23-fbeb-4220-b2ad-8421efb6a40f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:35.361819 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0778e63-9138-4a94-b3fc-cdabbb123820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:35.362416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0778e63-9138-4a94-b3fc-cdabbb123820 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:35.362692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0778e63-9138-4a94-b3fc-cdabbb123820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:35.362961 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0778e63-9138-4a94-b3fc-cdabbb123820 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:35.363618 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0778e63-9138-4a94-b3fc-cdabbb123820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:35.365360 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0778e63-9138-4a94-b3fc-cdabbb123820 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:35.376126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1237/2492] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:01:35.380354 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c64ef7-fdcd-4a3d-b631-7d8a85667ea4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:35.390750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c64ef7-fdcd-4a3d-b631-7d8a85667ea4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:35.395352 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8751cf-620f-48dc-a463-c8c3a9112528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:35.396015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8751cf-620f-48dc-a463-c8c3a9112528 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:35.396306 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8751cf-620f-48dc-a463-c8c3a9112528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:35.396581 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8751cf-620f-48dc-a463-c8c3a9112528 admin admin] PATH_INFO: `/v3/projects/3bf80998f05d4d258c6f822f327db8f7/users/23cafbfe77074165b2351796db9b4513/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:35.411736 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8751cf-620f-48dc-a463-c8c3a9112528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf80998f05d4d258c6f822f327db8f7, user_id=23cafbfe77074165b2351796db9b4513, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:35.414530 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8751cf-620f-48dc-a463-c8c3a9112528 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:35.428454 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1256/2493] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:01:35 2022] PUT /identity/v3/projects/3bf80998f05d4d258c6f822f327db8f7/users/23cafbfe77074165b2351796db9b4513/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:35.440303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235d240-be5b-4c64-b17b-29304896a7e3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:35.440598 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235d240-be5b-4c64-b17b-29304896a7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:35.440878 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235d240-be5b-4c64-b17b-29304896a7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:35.468950 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f235d240-be5b-4c64-b17b-29304896a7e3 None None] MFA Rules not processed for user `23cafbfe77074165b2351796db9b4513`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:35.470187 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f235d240-be5b-4c64-b17b-29304896a7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:35.499367 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:35.537449 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1238/2494] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:35.542608 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8751cf-620f-48dc-a463-c8c3a9112528 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:35.604226 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8751cf-620f-48dc-a463-c8c3a9112528 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:35.608765 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd794e00-357f-4217-a8a5-d6bd9d9e931a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:35.609365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd794e00-357f-4217-a8a5-d6bd9d9e931a admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:35.609641 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd794e00-357f-4217-a8a5-d6bd9d9e931a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:35.609912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd794e00-357f-4217-a8a5-d6bd9d9e931a admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:35.610538 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd794e00-357f-4217-a8a5-d6bd9d9e931a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:35.612472 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd794e00-357f-4217-a8a5-d6bd9d9e931a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:35.638138 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1257/2495] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:01:35 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:01:35.642222 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235d240-be5b-4c64-b17b-29304896a7e3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:35.654064 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235d240-be5b-4c64-b17b-29304896a7e3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:35.708844 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e3cfa-4501-4792-ba7c-d1c6efe089f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:35.709442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e3cfa-4501-4792-ba7c-d1c6efe089f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:35.709724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e3cfa-4501-4792-ba7c-d1c6efe089f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:35.709996 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e3cfa-4501-4792-ba7c-d1c6efe089f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:35.710621 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e3cfa-4501-4792-ba7c-d1c6efe089f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:35.713220 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e3cfa-4501-4792-ba7c-d1c6efe089f4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:35.733788 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1239/2496] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:01:35 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:01:35.737765 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd794e00-357f-4217-a8a5-d6bd9d9e931a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:35.748493 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd794e00-357f-4217-a8a5-d6bd9d9e931a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:35.753080 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819465a-8d8b-41ef-b562-9ee17ebed3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:35.753667 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819465a-8d8b-41ef-b562-9ee17ebed3eb admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:35.753943 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819465a-8d8b-41ef-b562-9ee17ebed3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:35.754217 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819465a-8d8b-41ef-b562-9ee17ebed3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:35.754856 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819465a-8d8b-41ef-b562-9ee17ebed3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:35.756475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819465a-8d8b-41ef-b562-9ee17ebed3eb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:35.767473 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1258/2497] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:01:35.771173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e3cfa-4501-4792-ba7c-d1c6efe089f4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:35.781066 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e3cfa-4501-4792-ba7c-d1c6efe089f4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:35.785932 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ae77f-3a81-4c92-bff1-4ed5e661c7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:35.786522 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ae77f-3a81-4c92-bff1-4ed5e661c7ee admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:35.786804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ae77f-3a81-4c92-bff1-4ed5e661c7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:35.787076 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ae77f-3a81-4c92-bff1-4ed5e661c7ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:35.787708 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ae77f-3a81-4c92-bff1-4ed5e661c7ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:35.789332 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ae77f-3a81-4c92-bff1-4ed5e661c7ee admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:35.799160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1240/2498] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:01:35.803312 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819465a-8d8b-41ef-b562-9ee17ebed3eb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:35.813641 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819465a-8d8b-41ef-b562-9ee17ebed3eb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:35.818236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a888f2-a765-4239-8d9b-e2aff5781710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:35.818867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a888f2-a765-4239-8d9b-e2aff5781710 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:35.819146 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a888f2-a765-4239-8d9b-e2aff5781710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:35.819418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a888f2-a765-4239-8d9b-e2aff5781710 admin admin] PATH_INFO: `/v3/projects/b35b13af5ca44259965ac0553f428b7a/users/79563d4ab4f54bdaaef3398e476e2f9d/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:35.835039 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a888f2-a765-4239-8d9b-e2aff5781710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35b13af5ca44259965ac0553f428b7a, user_id=79563d4ab4f54bdaaef3398e476e2f9d, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:35.837983 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a888f2-a765-4239-8d9b-e2aff5781710 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:35.849938 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1259/2499] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:01:35 2022] PUT /identity/v3/projects/b35b13af5ca44259965ac0553f428b7a/users/79563d4ab4f54bdaaef3398e476e2f9d/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:35.860586 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671abe2d-4ff2-495f-907c-e02966fa09eb None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:35.860814 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671abe2d-4ff2-495f-907c-e02966fa09eb None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:35.861089 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671abe2d-4ff2-495f-907c-e02966fa09eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:35.889326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-671abe2d-4ff2-495f-907c-e02966fa09eb None None] MFA Rules not processed for user `79563d4ab4f54bdaaef3398e476e2f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:35.890613 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-671abe2d-4ff2-495f-907c-e02966fa09eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:35.957497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1241/2500] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:35.962083 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a888f2-a765-4239-8d9b-e2aff5781710 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:36.022890 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a888f2-a765-4239-8d9b-e2aff5781710 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:36.027737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237413b-33ca-45d3-80de-9a03653b5c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:36.028378 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237413b-33ca-45d3-80de-9a03653b5c1b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:36.028657 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237413b-33ca-45d3-80de-9a03653b5c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:36.028935 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237413b-33ca-45d3-80de-9a03653b5c1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:36.029590 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237413b-33ca-45d3-80de-9a03653b5c1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:36.031497 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237413b-33ca-45d3-80de-9a03653b5c1b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:36.052947 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:36.061486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1260/2501] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:01:35 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:01:36.065349 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671abe2d-4ff2-495f-907c-e02966fa09eb None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:36.076117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671abe2d-4ff2-495f-907c-e02966fa09eb None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:36.110228 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:36.136293 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6b7cd-67fa-4ca9-972f-aa2c58ba979c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:36.136824 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6b7cd-67fa-4ca9-972f-aa2c58ba979c admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:36.137102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6b7cd-67fa-4ca9-972f-aa2c58ba979c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:36.137376 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6b7cd-67fa-4ca9-972f-aa2c58ba979c admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:36.138046 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6b7cd-67fa-4ca9-972f-aa2c58ba979c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:36.139977 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6b7cd-67fa-4ca9-972f-aa2c58ba979c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:36.165891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1242/2502] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:01:36 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:01:36.167238 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237413b-33ca-45d3-80de-9a03653b5c1b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:36.177618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237413b-33ca-45d3-80de-9a03653b5c1b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:36.183649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29d4f8-0687-4fe7-a74c-7a70716e3495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:36.184582 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29d4f8-0687-4fe7-a74c-7a70716e3495 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:36.184582 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29d4f8-0687-4fe7-a74c-7a70716e3495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:36.184793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29d4f8-0687-4fe7-a74c-7a70716e3495 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:36.185441 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29d4f8-0687-4fe7-a74c-7a70716e3495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:36.187066 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff29d4f8-0687-4fe7-a74c-7a70716e3495 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:36.201124 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1261/2503] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:01:36.202364 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6b7cd-67fa-4ca9-972f-aa2c58ba979c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:36.214447 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6b7cd-67fa-4ca9-972f-aa2c58ba979c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:36.220685 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671af91e-6d53-487e-b9a1-cf18d55f7fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:36.221409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671af91e-6d53-487e-b9a1-cf18d55f7fab admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:36.221638 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671af91e-6d53-487e-b9a1-cf18d55f7fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:36.221912 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671af91e-6d53-487e-b9a1-cf18d55f7fab admin admin] PATH_INFO: `/v3/projects/9cf92fa416bf4c1c840e2e3887471d78/users/f7908f1f2541486383f465c96b3a3263/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:36.244494 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671af91e-6d53-487e-b9a1-cf18d55f7fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf92fa416bf4c1c840e2e3887471d78, user_id=f7908f1f2541486383f465c96b3a3263, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:36.247246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671af91e-6d53-487e-b9a1-cf18d55f7fab admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:36.264405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1243/2504] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:01:36 2022] PUT /identity/v3/projects/9cf92fa416bf4c1c840e2e3887471d78/users/f7908f1f2541486383f465c96b3a3263/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:36.268152 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29d4f8-0687-4fe7-a74c-7a70716e3495 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:36.279540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29d4f8-0687-4fe7-a74c-7a70716e3495 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:36.342125 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc23cc-d9a5-46ef-8f81-40b1695536a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:36.342739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc23cc-d9a5-46ef-8f81-40b1695536a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:36.343019 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc23cc-d9a5-46ef-8f81-40b1695536a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:36.343393 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc23cc-d9a5-46ef-8f81-40b1695536a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:36.344187 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc23cc-d9a5-46ef-8f81-40b1695536a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:36.345777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc23cc-d9a5-46ef-8f81-40b1695536a9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:36.357219 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1262/2505] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:01:36.361118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671af91e-6d53-487e-b9a1-cf18d55f7fab admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:36.372050 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671af91e-6d53-487e-b9a1-cf18d55f7fab admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:36.376685 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933f22c-9d1f-4947-87de-ae1d47329d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:36.377345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933f22c-9d1f-4947-87de-ae1d47329d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:36.377617 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933f22c-9d1f-4947-87de-ae1d47329d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:36.377886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933f22c-9d1f-4947-87de-ae1d47329d33 admin admin] PATH_INFO: `/v3/projects/9cf92fa416bf4c1c840e2e3887471d78/users/f7908f1f2541486383f465c96b3a3263/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:36.380021 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933f22c-9d1f-4947-87de-ae1d47329d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf92fa416bf4c1c840e2e3887471d78, user_id=f7908f1f2541486383f465c96b3a3263, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:36.382803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933f22c-9d1f-4947-87de-ae1d47329d33 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:36.393691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1244/2506] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:01:36 2022] PUT /identity/v3/projects/9cf92fa416bf4c1c840e2e3887471d78/users/f7908f1f2541486383f465c96b3a3263/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:01:36.405435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358e38b-24cc-4b33-9033-4c9d3a9b49bc None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:36.405729 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358e38b-24cc-4b33-9033-4c9d3a9b49bc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:36.406009 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358e38b-24cc-4b33-9033-4c9d3a9b49bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:36.434882 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-1358e38b-24cc-4b33-9033-4c9d3a9b49bc None None] MFA Rules not processed for user `f7908f1f2541486383f465c96b3a3263`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:36.436145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1358e38b-24cc-4b33-9033-4c9d3a9b49bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:36.504378 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1263/2507] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:36.515937 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933f22c-9d1f-4947-87de-ae1d47329d33 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:36.517709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2933f22c-9d1f-4947-87de-ae1d47329d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:36.576565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933f22c-9d1f-4947-87de-ae1d47329d33 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:36.580200 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a4128-d3d6-49a2-a979-93b7f55cbe5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:36.580800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a4128-d3d6-49a2-a979-93b7f55cbe5a service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:36.581078 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a4128-d3d6-49a2-a979-93b7f55cbe5a service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:36.581350 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a4128-d3d6-49a2-a979-93b7f55cbe5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:36.590904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a4128-d3d6-49a2-a979-93b7f55cbe5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:36.592382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a4128-d3d6-49a2-a979-93b7f55cbe5a service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:36.603074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1245/2508] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:36.709079 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358e38b-24cc-4b33-9033-4c9d3a9b49bc None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:36.710517 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-1358e38b-24cc-4b33-9033-4c9d3a9b49bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:36.790590 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358e38b-24cc-4b33-9033-4c9d3a9b49bc None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:36.796152 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac2cd7-17d3-470c-84e9-65c8b119b531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:36.796755 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac2cd7-17d3-470c-84e9-65c8b119b531 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:36.797031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac2cd7-17d3-470c-84e9-65c8b119b531 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:36.797301 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac2cd7-17d3-470c-84e9-65c8b119b531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:36.799010 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7aac2cd7-17d3-470c-84e9-65c8b119b531 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:36.805171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:36.862279 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac2cd7-17d3-470c-84e9-65c8b119b531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:36.863876 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac2cd7-17d3-470c-84e9-65c8b119b531 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:36.873935 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1264/2509] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:37.119430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a4128-d3d6-49a2-a979-93b7f55cbe5a service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:37.121161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2b7a4128-d3d6-49a2-a979-93b7f55cbe5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:37.133820 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a4128-d3d6-49a2-a979-93b7f55cbe5a service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:37.139574 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0aaacf-b4ba-4f06-8719-970436c579e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:37.140259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0aaacf-b4ba-4f06-8719-970436c579e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:37.140732 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0aaacf-b4ba-4f06-8719-970436c579e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:37.141193 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0aaacf-b4ba-4f06-8719-970436c579e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:37.237670 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0aaacf-b4ba-4f06-8719-970436c579e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:37.240110 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0aaacf-b4ba-4f06-8719-970436c579e1 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:37.253522 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1246/2510] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:38.340512 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac2cd7-17d3-470c-84e9-65c8b119b531 service nova] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:38.342058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7aac2cd7-17d3-470c-84e9-65c8b119b531 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:38.409433 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac2cd7-17d3-470c-84e9-65c8b119b531 service nova] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:38.414377 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f62fe-499a-4f13-b2c6-9aaa99717f7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:38.415822 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f62fe-499a-4f13-b2c6-9aaa99717f7a service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:38.416349 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f62fe-499a-4f13-b2c6-9aaa99717f7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:38.417452 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f62fe-499a-4f13-b2c6-9aaa99717f7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:38.419299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f25f62fe-499a-4f13-b2c6-9aaa99717f7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:38.429760 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f62fe-499a-4f13-b2c6-9aaa99717f7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:38.431805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f62fe-499a-4f13-b2c6-9aaa99717f7a service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:38.441315 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1265/2511] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:38.603786 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d492868-2864-4ac7-bc9c-1e62a269dd32 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:38.604373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d492868-2864-4ac7-bc9c-1e62a269dd32 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:38.604373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d492868-2864-4ac7-bc9c-1e62a269dd32 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:38.605891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1247/2512] 10.222.0.15 () {54 vars in 921 bytes} [Fri Sep 9 21:01:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:01:38.621408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a318423-8d44-4217-a221-beb28cd30998 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:38.621714 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a318423-8d44-4217-a221-beb28cd30998 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:38.621950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a318423-8d44-4217-a221-beb28cd30998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:38.673082 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2a318423-8d44-4217-a221-beb28cd30998 None None] MFA Rules not processed for user `dc210376e57a41e6b3812110db249099`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:38.674573 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2a318423-8d44-4217-a221-beb28cd30998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:38.686363 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1266/2513] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Sep 9 21:01:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:38.699474 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d492868-2864-4ac7-bc9c-1e62a269dd32 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:38.702308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2d492868-2864-4ac7-bc9c-1e62a269dd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:38.747097 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:38.777902 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d492868-2864-4ac7-bc9c-1e62a269dd32 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:38.781946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4e551-dbe5-4264-9898-581d9a0818bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d298efe48464956b7a03cba1001060b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:38.782866 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4e551-dbe5-4264-9898-581d9a0818bc service glance] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:38.783199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4e551-dbe5-4264-9898-581d9a0818bc service glance] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:38.783748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4e551-dbe5-4264-9898-581d9a0818bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:38.810733 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4e551-dbe5-4264-9898-581d9a0818bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:38.812418 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4e551-dbe5-4264-9898-581d9a0818bc service glance] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:38.825736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1248/2514] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:38.906246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3136c8a-7df8-47c6-aa8f-2fc4b5bdb7e3 None None] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:38.906705 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3136c8a-7df8-47c6-aa8f-2fc4b5bdb7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:38.906992 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3136c8a-7df8-47c6-aa8f-2fc4b5bdb7e3 None None] PATH_INFO: `/` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:38.908575 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1267/2515] 10.222.0.15 () {54 vars in 921 bytes} [Fri Sep 9 21:01:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:01:38.913991 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54642fdc-a307-41ec-9402-0bf38109f836 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:38.914358 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54642fdc-a307-41ec-9402-0bf38109f836 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:38.915434 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54642fdc-a307-41ec-9402-0bf38109f836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:38.936440 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-54642fdc-a307-41ec-9402-0bf38109f836 None None] MFA Rules not processed for user `27e2be33ebdc4c5a97befcbd4d09ee4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:38.937748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-54642fdc-a307-41ec-9402-0bf38109f836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:38.944576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1249/2516] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Sep 9 21:01:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:38.957102 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3136c8a-7df8-47c6-aa8f-2fc4b5bdb7e3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:38.969273 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3136c8a-7df8-47c6-aa8f-2fc4b5bdb7e3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:38.973187 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cef8ec-754e-4dd7-9ecc-9b1d16da7ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:38.973793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cef8ec-754e-4dd7-9ecc-9b1d16da7ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:38.974090 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cef8ec-754e-4dd7-9ecc-9b1d16da7ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:38.974350 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cef8ec-754e-4dd7-9ecc-9b1d16da7ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:38.982483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cef8ec-754e-4dd7-9ecc-9b1d16da7ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:38.984124 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cef8ec-754e-4dd7-9ecc-9b1d16da7ea4 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:38.992527 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1268/2517] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:39.084801 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a1818-6b16-4137-a1af-044df86300b2 None None] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:39.085083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a1818-6b16-4137-a1af-044df86300b2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:39.085369 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8a1818-6b16-4137-a1af-044df86300b2 None None] PATH_INFO: `/` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:39.086810 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1250/2518] 10.222.0.15 () {54 vars in 921 bytes} [Fri Sep 9 21:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 09 21:01:39.092128 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e86e7a-e874-4e57-b836-c1b071e44e6d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:39.092417 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e86e7a-e874-4e57-b836-c1b071e44e6d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:39.092695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e86e7a-e874-4e57-b836-c1b071e44e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:39.113720 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-71e86e7a-e874-4e57-b836-c1b071e44e6d None None] MFA Rules not processed for user `dc210376e57a41e6b3812110db249099`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:39.115179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-71e86e7a-e874-4e57-b836-c1b071e44e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:39.125484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1269/2519] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Sep 9 21:01:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:39.135903 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a1818-6b16-4137-a1af-044df86300b2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:39.146826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8a1818-6b16-4137-a1af-044df86300b2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:39.150569 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc74421f-89eb-44ca-81c1-5f792297aa93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:39.151157 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74421f-89eb-44ca-81c1-5f792297aa93 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:39.151447 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74421f-89eb-44ca-81c1-5f792297aa93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:39.151700 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc74421f-89eb-44ca-81c1-5f792297aa93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:39.161973 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc74421f-89eb-44ca-81c1-5f792297aa93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:39.163402 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc74421f-89eb-44ca-81c1-5f792297aa93 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:39.174855 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1251/2520] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:39.238957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e86e7a-e874-4e57-b836-c1b071e44e6d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:39.240904 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-71e86e7a-e874-4e57-b836-c1b071e44e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:39.313938 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e86e7a-e874-4e57-b836-c1b071e44e6d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:39.319312 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06498831-27f8-4706-90ce-eda014fa4f75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc28d9a1b3f4feca0deeb5f266f8b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:39.319926 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06498831-27f8-4706-90ce-eda014fa4f75 service placement] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:39.320237 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06498831-27f8-4706-90ce-eda014fa4f75 service placement] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:39.320513 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06498831-27f8-4706-90ce-eda014fa4f75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:39.322326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-06498831-27f8-4706-90ce-eda014fa4f75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:39.334272 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06498831-27f8-4706-90ce-eda014fa4f75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:39.335850 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06498831-27f8-4706-90ce-eda014fa4f75 service placement] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:39.346427 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1270/2521] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:41.159078 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42766b95-acaf-4b24-89a7-7704da2c82e6 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:41.159563 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42766b95-acaf-4b24-89a7-7704da2c82e6 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:41.159698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42766b95-acaf-4b24-89a7-7704da2c82e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:41.180192 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-42766b95-acaf-4b24-89a7-7704da2c82e6 None None] MFA Rules not processed for user `e51ae6959aac49898e75c6786c5dbdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:41.182182 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-42766b95-acaf-4b24-89a7-7704da2c82e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:41.243799 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1252/2522] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Sep 9 21:01:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:01:41.256883 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06498831-27f8-4706-90ce-eda014fa4f75 service placement] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:41.258474 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-06498831-27f8-4706-90ce-eda014fa4f75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:41.273824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:41.351286 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06498831-27f8-4706-90ce-eda014fa4f75 service placement] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:41.358319 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f63d9-cbaf-4799-a852-4abda28b40e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9570eaa112de460cb9e371278bfb300b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:41.359200 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f63d9-cbaf-4799-a852-4abda28b40e0 service swift] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:41.359487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f63d9-cbaf-4799-a852-4abda28b40e0 service swift] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:41.360099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519f63d9-cbaf-4799-a852-4abda28b40e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:41.369847 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f63d9-cbaf-4799-a852-4abda28b40e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:41.372368 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519f63d9-cbaf-4799-a852-4abda28b40e0 service swift] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:41.380131 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1271/2523] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Sep 9 21:01:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 21:01:41.469379 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42766b95-acaf-4b24-89a7-7704da2c82e6 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:41.481330 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42766b95-acaf-4b24-89a7-7704da2c82e6 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:41.485443 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534da88-c9d4-4ee1-9765-2d17abc2a3dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:41.486063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534da88-c9d4-4ee1-9765-2d17abc2a3dc service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:41.486400 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534da88-c9d4-4ee1-9765-2d17abc2a3dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:41.486932 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534da88-c9d4-4ee1-9765-2d17abc2a3dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:41.562857 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534da88-c9d4-4ee1-9765-2d17abc2a3dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:41.564700 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534da88-c9d4-4ee1-9765-2d17abc2a3dc service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:41.577207 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1253/2524] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:41 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:43.816527 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f63d9-cbaf-4799-a852-4abda28b40e0 service swift] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:43.881958 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519f63d9-cbaf-4799-a852-4abda28b40e0 service swift] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:43.886471 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58d47c-8b93-41d9-bb20-26a5cd650a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:43.887099 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58d47c-8b93-41d9-bb20-26a5cd650a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:43.887380 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58d47c-8b93-41d9-bb20-26a5cd650a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:43.887656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f58d47c-8b93-41d9-bb20-26a5cd650a9e admin admin] PATH_INFO: `/v3/users/23cafbfe77074165b2351796db9b4513` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:43.888815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58d47c-8b93-41d9-bb20-26a5cd650a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=23cafbfe77074165b2351796db9b4513)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:43.890733 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f58d47c-8b93-41d9-bb20-26a5cd650a9e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:43.953381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5f58d47c-8b93-41d9-bb20-26a5cd650a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23cafbfe77074165b2351796db9b4513'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:43.965002 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5f58d47c-8b93-41d9-bb20-26a5cd650a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23cafbfe77074165b2351796db9b4513'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:43.982678 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5f58d47c-8b93-41d9-bb20-26a5cd650a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23cafbfe77074165b2351796db9b4513'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:43.983588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5f58d47c-8b93-41d9-bb20-26a5cd650a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23cafbfe77074165b2351796db9b4513'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:43.984285 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-5f58d47c-8b93-41d9-bb20-26a5cd650a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23cafbfe77074165b2351796db9b4513'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:44.000702 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1272/2525] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:01:43 2022] DELETE /identity/v3/users/23cafbfe77074165b2351796db9b4513 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:44.002415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf0f8c-bf96-4b40-98e8-4bb25665be7a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:44.003237 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf0f8c-bf96-4b40-98e8-4bb25665be7a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:44.003525 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf0f8c-bf96-4b40-98e8-4bb25665be7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:44.031238 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-edbf0f8c-bf96-4b40-98e8-4bb25665be7a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:44.032798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-edbf0f8c-bf96-4b40-98e8-4bb25665be7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:44.092604 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:44.103804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1254/2526] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:01:44.115891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58d47c-8b93-41d9-bb20-26a5cd650a9e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:44.117025 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5f58d47c-8b93-41d9-bb20-26a5cd650a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:44.163354 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:44.204540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f58d47c-8b93-41d9-bb20-26a5cd650a9e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:44.208217 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31bc07-a6a9-4b5a-a907-e6541afe5874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:44.208831 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31bc07-a6a9-4b5a-a907-e6541afe5874 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:44.209109 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31bc07-a6a9-4b5a-a907-e6541afe5874 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:44.209383 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31bc07-a6a9-4b5a-a907-e6541afe5874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:44.219371 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31bc07-a6a9-4b5a-a907-e6541afe5874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:44.220861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31bc07-a6a9-4b5a-a907-e6541afe5874 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:44.230427 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1273/2527] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:44.527389 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf0f8c-bf96-4b40-98e8-4bb25665be7a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:44.529175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-edbf0f8c-bf96-4b40-98e8-4bb25665be7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:44.542138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf0f8c-bf96-4b40-98e8-4bb25665be7a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:44.547232 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5302a-a72a-4879-84a7-331d5fbc3732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:44.548118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5302a-a72a-4879-84a7-331d5fbc3732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:44.548411 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5302a-a72a-4879-84a7-331d5fbc3732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:44.548692 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5302a-a72a-4879-84a7-331d5fbc3732 admin admin] PATH_INFO: `/v3/projects/3bf80998f05d4d258c6f822f327db8f7` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:44.550053 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5302a-a72a-4879-84a7-331d5fbc3732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf80998f05d4d258c6f822f327db8f7)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:44.552219 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc5302a-a72a-4879-84a7-331d5fbc3732 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:44.607770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bfc5302a-a72a-4879-84a7-331d5fbc3732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf80998f05d4d258c6f822f327db8f7', 'request_id': 'req-bfc5302a-a72a-4879-84a7-331d5fbc3732'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:44.616558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bfc5302a-a72a-4879-84a7-331d5fbc3732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf80998f05d4d258c6f822f327db8f7', 'request_id': 'req-bfc5302a-a72a-4879-84a7-331d5fbc3732'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:44.631265 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bfc5302a-a72a-4879-84a7-331d5fbc3732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf80998f05d4d258c6f822f327db8f7', 'request_id': 'req-bfc5302a-a72a-4879-84a7-331d5fbc3732'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:44.645608 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bfc5302a-a72a-4879-84a7-331d5fbc3732 admin admin] The token cache is being invalidate because project 3bf80998f05d4d258c6f822f327db8f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:01:44.645800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bfc5302a-a72a-4879-84a7-331d5fbc3732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:44.646598 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-bfc5302a-a72a-4879-84a7-331d5fbc3732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:44.650947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1255/2528] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:01:44 2022] DELETE /identity/v3/projects/3bf80998f05d4d258c6f822f327db8f7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:44.652241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31bc07-a6a9-4b5a-a907-e6541afe5874 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:44.664285 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31bc07-a6a9-4b5a-a907-e6541afe5874 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:44.758274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779c404-baec-44ff-8a0f-db7da6628283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:44.759547 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779c404-baec-44ff-8a0f-db7da6628283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:44.759831 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779c404-baec-44ff-8a0f-db7da6628283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:44.760142 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779c404-baec-44ff-8a0f-db7da6628283 admin admin] PATH_INFO: `/v3/users/79563d4ab4f54bdaaef3398e476e2f9d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:44.761336 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779c404-baec-44ff-8a0f-db7da6628283 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79563d4ab4f54bdaaef3398e476e2f9d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:44.763293 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779c404-baec-44ff-8a0f-db7da6628283 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:44.837456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0779c404-baec-44ff-8a0f-db7da6628283 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79563d4ab4f54bdaaef3398e476e2f9d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:44.850160 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0779c404-baec-44ff-8a0f-db7da6628283 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79563d4ab4f54bdaaef3398e476e2f9d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:44.866020 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0779c404-baec-44ff-8a0f-db7da6628283 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79563d4ab4f54bdaaef3398e476e2f9d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:44.866837 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0779c404-baec-44ff-8a0f-db7da6628283 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79563d4ab4f54bdaaef3398e476e2f9d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:44.867436 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0779c404-baec-44ff-8a0f-db7da6628283 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79563d4ab4f54bdaaef3398e476e2f9d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:44.880014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1274/2529] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:01:44 2022] DELETE /identity/v3/users/79563d4ab4f54bdaaef3398e476e2f9d => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:45.169416 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5302a-a72a-4879-84a7-331d5fbc3732 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:45.171068 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-bfc5302a-a72a-4879-84a7-331d5fbc3732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:45.185583 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5302a-a72a-4879-84a7-331d5fbc3732 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:45.254398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f89054-8fac-4d6b-8c49-7449eb937c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:45.255194 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f89054-8fac-4d6b-8c49-7449eb937c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:45.255576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f89054-8fac-4d6b-8c49-7449eb937c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:45.256011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f89054-8fac-4d6b-8c49-7449eb937c10 admin admin] PATH_INFO: `/v3/projects/b35b13af5ca44259965ac0553f428b7a` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:45.257242 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f89054-8fac-4d6b-8c49-7449eb937c10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b35b13af5ca44259965ac0553f428b7a)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:45.260085 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f89054-8fac-4d6b-8c49-7449eb937c10 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:45.330979 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-90f89054-8fac-4d6b-8c49-7449eb937c10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b35b13af5ca44259965ac0553f428b7a', 'request_id': 'req-90f89054-8fac-4d6b-8c49-7449eb937c10'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:45.344979 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-90f89054-8fac-4d6b-8c49-7449eb937c10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b35b13af5ca44259965ac0553f428b7a', 'request_id': 'req-90f89054-8fac-4d6b-8c49-7449eb937c10'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:45.376391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-90f89054-8fac-4d6b-8c49-7449eb937c10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b35b13af5ca44259965ac0553f428b7a', 'request_id': 'req-90f89054-8fac-4d6b-8c49-7449eb937c10'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:45.400841 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-90f89054-8fac-4d6b-8c49-7449eb937c10 admin admin] The token cache is being invalidate because project b35b13af5ca44259965ac0553f428b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:01:45.401149 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-90f89054-8fac-4d6b-8c49-7449eb937c10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:45.401894 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-90f89054-8fac-4d6b-8c49-7449eb937c10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:45.408643 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1256/2530] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:01:45 2022] DELETE /identity/v3/projects/b35b13af5ca44259965ac0553f428b7a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:45.410010 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779c404-baec-44ff-8a0f-db7da6628283 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:45.411821 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0779c404-baec-44ff-8a0f-db7da6628283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:45.427567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779c404-baec-44ff-8a0f-db7da6628283 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:45.481574 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:45.502956 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edc9bd-9e8a-493b-be10-3431cee26e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:45.503606 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edc9bd-9e8a-493b-be10-3431cee26e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:45.503892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edc9bd-9e8a-493b-be10-3431cee26e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:45.504203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edc9bd-9e8a-493b-be10-3431cee26e96 admin admin] PATH_INFO: `/v3/users/f7908f1f2541486383f465c96b3a3263` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:45.505418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edc9bd-9e8a-493b-be10-3431cee26e96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7908f1f2541486383f465c96b3a3263)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:45.507512 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edc9bd-9e8a-493b-be10-3431cee26e96 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:45.557771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-04edc9bd-9e8a-493b-be10-3431cee26e96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7908f1f2541486383f465c96b3a3263'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:45.566238 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-04edc9bd-9e8a-493b-be10-3431cee26e96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7908f1f2541486383f465c96b3a3263'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:45.581939 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-04edc9bd-9e8a-493b-be10-3431cee26e96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7908f1f2541486383f465c96b3a3263'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:45.582759 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-04edc9bd-9e8a-493b-be10-3431cee26e96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7908f1f2541486383f465c96b3a3263'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:45.583654 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-04edc9bd-9e8a-493b-be10-3431cee26e96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7908f1f2541486383f465c96b3a3263'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:45.598590 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1275/2531] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:01:45 2022] DELETE /identity/v3/users/f7908f1f2541486383f465c96b3a3263 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:45.909110 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f89054-8fac-4d6b-8c49-7449eb937c10 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:45.910835 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-90f89054-8fac-4d6b-8c49-7449eb937c10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:45.925941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f89054-8fac-4d6b-8c49-7449eb937c10 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:45.957103 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:46.036764 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77ebce-2459-40b8-985c-fd7210aa5d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:46.037972 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77ebce-2459-40b8-985c-fd7210aa5d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:46.037972 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77ebce-2459-40b8-985c-fd7210aa5d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:46.040823 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77ebce-2459-40b8-985c-fd7210aa5d4d admin admin] PATH_INFO: `/v3/projects/9cf92fa416bf4c1c840e2e3887471d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:46.044736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77ebce-2459-40b8-985c-fd7210aa5d4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cf92fa416bf4c1c840e2e3887471d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:46.047163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77ebce-2459-40b8-985c-fd7210aa5d4d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:46.124051 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2e77ebce-2459-40b8-985c-fd7210aa5d4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cf92fa416bf4c1c840e2e3887471d78', 'request_id': 'req-2e77ebce-2459-40b8-985c-fd7210aa5d4d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:46.136231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2e77ebce-2459-40b8-985c-fd7210aa5d4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cf92fa416bf4c1c840e2e3887471d78', 'request_id': 'req-2e77ebce-2459-40b8-985c-fd7210aa5d4d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:46.144287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2e77ebce-2459-40b8-985c-fd7210aa5d4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cf92fa416bf4c1c840e2e3887471d78', 'request_id': 'req-2e77ebce-2459-40b8-985c-fd7210aa5d4d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:46.157813 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2e77ebce-2459-40b8-985c-fd7210aa5d4d admin admin] The token cache is being invalidate because project 9cf92fa416bf4c1c840e2e3887471d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:01:46.158129 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2e77ebce-2459-40b8-985c-fd7210aa5d4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:46.158883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2e77ebce-2459-40b8-985c-fd7210aa5d4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:46.160444 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1257/2532] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:01:45 2022] DELETE /identity/v3/projects/9cf92fa416bf4c1c840e2e3887471d78 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:46.171088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936cdeb-39c1-4f79-9665-247cdb65cbd1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:46.171634 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936cdeb-39c1-4f79-9665-247cdb65cbd1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:46.171634 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936cdeb-39c1-4f79-9665-247cdb65cbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:46.192424 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2936cdeb-39c1-4f79-9665-247cdb65cbd1 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:46.193825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2936cdeb-39c1-4f79-9665-247cdb65cbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:46.267020 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1276/2533] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:46.268397 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cad79-752e-45c5-8110-d32732d1f87e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:46.268849 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cad79-752e-45c5-8110-d32732d1f87e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:46.269075 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cad79-752e-45c5-8110-d32732d1f87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:46.291008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fa7cad79-752e-45c5-8110-d32732d1f87e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:46.292250 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fa7cad79-752e-45c5-8110-d32732d1f87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:46.300238 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1258/2534] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:01:46.304613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936cdeb-39c1-4f79-9665-247cdb65cbd1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:46.315432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936cdeb-39c1-4f79-9665-247cdb65cbd1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:46.320169 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789b3b2-fc70-4610-8778-924840d30427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:46.320843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789b3b2-fc70-4610-8778-924840d30427 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:46.321100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789b3b2-fc70-4610-8778-924840d30427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:46.321377 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789b3b2-fc70-4610-8778-924840d30427 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:46.322060 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789b3b2-fc70-4610-8778-924840d30427 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:01:46.322367 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789b3b2-fc70-4610-8778-924840d30427 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:46.324017 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6789b3b2-fc70-4610-8778-924840d30427 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:46.344627 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1277/2535] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:01:46.349337 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cad79-752e-45c5-8110-d32732d1f87e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:46.360670 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cad79-752e-45c5-8110-d32732d1f87e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:46.365595 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98facf65-b525-4efd-95c1-877c70a3d1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:46.366212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98facf65-b525-4efd-95c1-877c70a3d1fd admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:46.366492 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98facf65-b525-4efd-95c1-877c70a3d1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:46.366765 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98facf65-b525-4efd-95c1-877c70a3d1fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:46.367400 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98facf65-b525-4efd-95c1-877c70a3d1fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:46.369591 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98facf65-b525-4efd-95c1-877c70a3d1fd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:46.403157 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1259/2536] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:01:46 2022] POST /identity/v3/projects => generated 407 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:01:46.407334 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789b3b2-fc70-4610-8778-924840d30427 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:46.421589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789b3b2-fc70-4610-8778-924840d30427 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:46.476359 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:46.492335 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf257e04-10f4-4528-801d-621f5ba6d704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:46.493118 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf257e04-10f4-4528-801d-621f5ba6d704 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:46.493450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf257e04-10f4-4528-801d-621f5ba6d704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:46.493778 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf257e04-10f4-4528-801d-621f5ba6d704 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:46.494437 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf257e04-10f4-4528-801d-621f5ba6d704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:46.496407 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf257e04-10f4-4528-801d-621f5ba6d704 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:46.521454 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1278/2537] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:01:46 2022] POST /identity/v3/users => generated 304 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:01:46.527454 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98facf65-b525-4efd-95c1-877c70a3d1fd admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:46.538849 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98facf65-b525-4efd-95c1-877c70a3d1fd admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:46.544751 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba26a97-1310-40bb-a923-4821b65f3410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:46.545688 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba26a97-1310-40bb-a923-4821b65f3410 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:46.545968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba26a97-1310-40bb-a923-4821b65f3410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:46.546309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba26a97-1310-40bb-a923-4821b65f3410 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:46.547043 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba26a97-1310-40bb-a923-4821b65f3410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:46.548841 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba26a97-1310-40bb-a923-4821b65f3410 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:46.573639 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1260/2538] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:01:46.577791 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf257e04-10f4-4528-801d-621f5ba6d704 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:46.589582 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf257e04-10f4-4528-801d-621f5ba6d704 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:46.601327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3828dd4e-5b20-4d8e-a5a8-06e83a86760e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:46.603807 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828dd4e-5b20-4d8e-a5a8-06e83a86760e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:46.604358 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828dd4e-5b20-4d8e-a5a8-06e83a86760e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:46.604942 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3828dd4e-5b20-4d8e-a5a8-06e83a86760e admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:46.605813 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828dd4e-5b20-4d8e-a5a8-06e83a86760e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:46.607656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3828dd4e-5b20-4d8e-a5a8-06e83a86760e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:46.748561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1279/2539] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:01:46.753008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba26a97-1310-40bb-a923-4821b65f3410 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:46.765012 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba26a97-1310-40bb-a923-4821b65f3410 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:46.769833 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fab79e-0c21-4727-8561-c20ee68c4e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:46.770503 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fab79e-0c21-4727-8561-c20ee68c4e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:46.770784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fab79e-0c21-4727-8561-c20ee68c4e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:46.771058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fab79e-0c21-4727-8561-c20ee68c4e81 admin admin] PATH_INFO: `/v3/projects/cecf95e130b84264b0bc8abc2814ca98/users/72d06e2a608d4c43a229c5fafa0f9c16/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:46.786987 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fab79e-0c21-4727-8561-c20ee68c4e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cecf95e130b84264b0bc8abc2814ca98, user_id=72d06e2a608d4c43a229c5fafa0f9c16, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:46.789953 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fab79e-0c21-4727-8561-c20ee68c4e81 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:46.818273 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1261/2540] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:01:46 2022] PUT /identity/v3/projects/cecf95e130b84264b0bc8abc2814ca98/users/72d06e2a608d4c43a229c5fafa0f9c16/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:46.822990 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18340a-48f8-4163-a041-037fcb7f17d0 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:46.823276 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18340a-48f8-4163-a041-037fcb7f17d0 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:46.823549 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d18340a-48f8-4163-a041-037fcb7f17d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:46.852665 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0d18340a-48f8-4163-a041-037fcb7f17d0 None None] MFA Rules not processed for user `72d06e2a608d4c43a229c5fafa0f9c16`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:46.853901 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0d18340a-48f8-4163-a041-037fcb7f17d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:46.929346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1280/2541] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:46 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:01:46.934105 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fab79e-0c21-4727-8561-c20ee68c4e81 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:46.978235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:47.001259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fab79e-0c21-4727-8561-c20ee68c4e81 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:47.006083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21875cb7-fb26-4877-a625-590d82e6dea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:47.008729 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21875cb7-fb26-4877-a625-590d82e6dea3 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:47.009134 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21875cb7-fb26-4877-a625-590d82e6dea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:47.009544 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21875cb7-fb26-4877-a625-590d82e6dea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:47.010497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21875cb7-fb26-4877-a625-590d82e6dea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:47.012962 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21875cb7-fb26-4877-a625-590d82e6dea3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:47.043956 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1262/2542] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:01:46 2022] POST /identity/v3/projects => generated 407 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:01:47.048249 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18340a-48f8-4163-a041-037fcb7f17d0 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:47.059657 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d18340a-48f8-4163-a041-037fcb7f17d0 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:47.119583 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc03d0-5376-43be-a080-3e3eb7241b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:47.120237 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc03d0-5376-43be-a080-3e3eb7241b86 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:47.120520 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc03d0-5376-43be-a080-3e3eb7241b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:47.120795 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc03d0-5376-43be-a080-3e3eb7241b86 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:47.121427 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc03d0-5376-43be-a080-3e3eb7241b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:47.123375 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc03d0-5376-43be-a080-3e3eb7241b86 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:47.158340 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1281/2543] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:01:47 2022] POST /identity/v3/users => generated 310 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:01:47.159515 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21875cb7-fb26-4877-a625-590d82e6dea3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:47.175186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21875cb7-fb26-4877-a625-590d82e6dea3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:47.180745 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649db29-f36b-480f-b190-0dd5c1d312a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:47.181567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649db29-f36b-480f-b190-0dd5c1d312a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:47.181886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649db29-f36b-480f-b190-0dd5c1d312a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:47.182159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649db29-f36b-480f-b190-0dd5c1d312a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:47.182853 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649db29-f36b-480f-b190-0dd5c1d312a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:47.184516 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649db29-f36b-480f-b190-0dd5c1d312a5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:47.196747 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1263/2544] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:01:47.201712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc03d0-5376-43be-a080-3e3eb7241b86 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:47.218396 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc03d0-5376-43be-a080-3e3eb7241b86 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:47.223677 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcfae1-3be3-4b6c-b211-0d4b864f4b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:47.224495 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcfae1-3be3-4b6c-b211-0d4b864f4b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:47.224845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcfae1-3be3-4b6c-b211-0d4b864f4b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:47.225248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbcfae1-3be3-4b6c-b211-0d4b864f4b14 admin admin] PATH_INFO: `/v3/projects/1d94c115ec9e4741bc338da2fede7f27/users/46eac3962739478b9cf71a5601589b6b/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:47.243714 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcfae1-3be3-4b6c-b211-0d4b864f4b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d94c115ec9e4741bc338da2fede7f27, user_id=46eac3962739478b9cf71a5601589b6b, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:47.246804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbcfae1-3be3-4b6c-b211-0d4b864f4b14 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:47.264418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1282/2545] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:01:47 2022] PUT /identity/v3/projects/1d94c115ec9e4741bc338da2fede7f27/users/46eac3962739478b9cf71a5601589b6b/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:47.268645 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649db29-f36b-480f-b190-0dd5c1d312a5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:47.281738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649db29-f36b-480f-b190-0dd5c1d312a5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:47.376550 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46a186-d4df-464f-9579-e713ddd2ff3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:47.377454 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46a186-d4df-464f-9579-e713ddd2ff3e admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:47.377776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46a186-d4df-464f-9579-e713ddd2ff3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:47.377997 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46a186-d4df-464f-9579-e713ddd2ff3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:47.378659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46a186-d4df-464f-9579-e713ddd2ff3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:47.380291 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb46a186-d4df-464f-9579-e713ddd2ff3e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:47.390847 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1264/2546] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:01:47.395201 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcfae1-3be3-4b6c-b211-0d4b864f4b14 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:47.405670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbcfae1-3be3-4b6c-b211-0d4b864f4b14 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:47.410287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d764e9-5de8-4390-843a-9bd7b973718d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:47.411193 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d764e9-5de8-4390-843a-9bd7b973718d admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:47.411470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d764e9-5de8-4390-843a-9bd7b973718d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:47.411741 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d764e9-5de8-4390-843a-9bd7b973718d admin admin] PATH_INFO: `/v3/projects/1d94c115ec9e4741bc338da2fede7f27/users/46eac3962739478b9cf71a5601589b6b/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:47.413688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d764e9-5de8-4390-843a-9bd7b973718d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d94c115ec9e4741bc338da2fede7f27, user_id=46eac3962739478b9cf71a5601589b6b, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:47.417295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d764e9-5de8-4390-843a-9bd7b973718d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:47.429723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1283/2547] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:01:47 2022] PUT /identity/v3/projects/1d94c115ec9e4741bc338da2fede7f27/users/46eac3962739478b9cf71a5601589b6b/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:47.497501 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c80f83-812a-4184-a874-b1f8a44d10a2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:47.497791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c80f83-812a-4184-a874-b1f8a44d10a2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:47.498071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c80f83-812a-4184-a874-b1f8a44d10a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:47.529406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a5c80f83-812a-4184-a874-b1f8a44d10a2 None None] MFA Rules not processed for user `46eac3962739478b9cf71a5601589b6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:47.530698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a5c80f83-812a-4184-a874-b1f8a44d10a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:47.609495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1265/2548] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:47 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:47.620523 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d764e9-5de8-4390-843a-9bd7b973718d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:47.622248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d9d764e9-5de8-4390-843a-9bd7b973718d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:47.661021 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:47.710485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d764e9-5de8-4390-843a-9bd7b973718d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:47.715051 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918076ca-8ae6-4c95-b794-cb5c4a0150ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:47.719134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918076ca-8ae6-4c95-b794-cb5c4a0150ae service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:47.719687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918076ca-8ae6-4c95-b794-cb5c4a0150ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:47.720179 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918076ca-8ae6-4c95-b794-cb5c4a0150ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:47.731538 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918076ca-8ae6-4c95-b794-cb5c4a0150ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:47.733299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918076ca-8ae6-4c95-b794-cb5c4a0150ae service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:47.747188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1284/2549] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:47 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:47.935735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c80f83-812a-4184-a874-b1f8a44d10a2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:47.946988 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c80f83-812a-4184-a874-b1f8a44d10a2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:47.950955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd90ee-e359-4842-bb22-2f662502d0e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:47.951374 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd90ee-e359-4842-bb22-2f662502d0e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:47.951718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd90ee-e359-4842-bb22-2f662502d0e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:47.952090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd90ee-e359-4842-bb22-2f662502d0e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:47.995900 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:48.029369 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd90ee-e359-4842-bb22-2f662502d0e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:48.030886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd90ee-e359-4842-bb22-2f662502d0e0 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:48.041367 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1266/2550] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:47 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:53.631775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918076ca-8ae6-4c95-b794-cb5c4a0150ae service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:53.710222 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918076ca-8ae6-4c95-b794-cb5c4a0150ae service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:53.715836 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34558323-12b8-41cb-8e94-ec7f96525773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:53.716688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34558323-12b8-41cb-8e94-ec7f96525773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:53.717064 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34558323-12b8-41cb-8e94-ec7f96525773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:53.717485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34558323-12b8-41cb-8e94-ec7f96525773 admin admin] PATH_INFO: `/v3/users/72d06e2a608d4c43a229c5fafa0f9c16` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:53.718818 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34558323-12b8-41cb-8e94-ec7f96525773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72d06e2a608d4c43a229c5fafa0f9c16)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:53.721171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34558323-12b8-41cb-8e94-ec7f96525773 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:53.782421 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-34558323-12b8-41cb-8e94-ec7f96525773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72d06e2a608d4c43a229c5fafa0f9c16'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:53.794181 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-34558323-12b8-41cb-8e94-ec7f96525773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72d06e2a608d4c43a229c5fafa0f9c16'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:53.811522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-34558323-12b8-41cb-8e94-ec7f96525773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72d06e2a608d4c43a229c5fafa0f9c16'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:53.812329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-34558323-12b8-41cb-8e94-ec7f96525773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72d06e2a608d4c43a229c5fafa0f9c16'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:53.815231 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-34558323-12b8-41cb-8e94-ec7f96525773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72d06e2a608d4c43a229c5fafa0f9c16'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:53.831289 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1285/2551] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:01:53 2022] DELETE /identity/v3/users/72d06e2a608d4c43a229c5fafa0f9c16 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:53.836422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894eb2c-2f06-4750-ab05-779a33da2302 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:53.837018 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894eb2c-2f06-4750-ab05-779a33da2302 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:53.837486 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894eb2c-2f06-4750-ab05-779a33da2302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:53.857850 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-6894eb2c-2f06-4750-ab05-779a33da2302 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:53.859047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6894eb2c-2f06-4750-ab05-779a33da2302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:53.922792 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1267/2552] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:53.933210 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34558323-12b8-41cb-8e94-ec7f96525773 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:53.934622 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-34558323-12b8-41cb-8e94-ec7f96525773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:53.973172 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:54.017785 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34558323-12b8-41cb-8e94-ec7f96525773 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:54.020954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca523180-1e8d-4ba2-a2c9-f670d9f9792b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:54.021574 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca523180-1e8d-4ba2-a2c9-f670d9f9792b service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:54.021853 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca523180-1e8d-4ba2-a2c9-f670d9f9792b service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:54.022127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca523180-1e8d-4ba2-a2c9-f670d9f9792b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:54.032544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca523180-1e8d-4ba2-a2c9-f670d9f9792b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:54.033994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca523180-1e8d-4ba2-a2c9-f670d9f9792b service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:54.048228 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894eb2c-2f06-4750-ab05-779a33da2302 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:54.050008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6894eb2c-2f06-4750-ab05-779a33da2302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:54.064341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1286/2553] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:54.145910 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894eb2c-2f06-4750-ab05-779a33da2302 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:54.153328 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159280d1-9c02-42fa-bb31-910099b06b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:54.154011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159280d1-9c02-42fa-bb31-910099b06b5e service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:54.154646 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159280d1-9c02-42fa-bb31-910099b06b5e service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:54.154972 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159280d1-9c02-42fa-bb31-910099b06b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:54.158259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-159280d1-9c02-42fa-bb31-910099b06b5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:54.177897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159280d1-9c02-42fa-bb31-910099b06b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:54.180063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159280d1-9c02-42fa-bb31-910099b06b5e service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:54.208199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1268/2554] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:01:54.433793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca523180-1e8d-4ba2-a2c9-f670d9f9792b service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:54.435412 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ca523180-1e8d-4ba2-a2c9-f670d9f9792b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:54.451485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca523180-1e8d-4ba2-a2c9-f670d9f9792b service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:54.456199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a48b63-0fec-49a4-b9da-dbba92044ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:54.456895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a48b63-0fec-49a4-b9da-dbba92044ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:54.457234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a48b63-0fec-49a4-b9da-dbba92044ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:54.457570 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a48b63-0fec-49a4-b9da-dbba92044ec6 admin admin] PATH_INFO: `/v3/projects/cecf95e130b84264b0bc8abc2814ca98` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:54.458871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a48b63-0fec-49a4-b9da-dbba92044ec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cecf95e130b84264b0bc8abc2814ca98)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:54.460882 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a48b63-0fec-49a4-b9da-dbba92044ec6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:54.510246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-10a48b63-0fec-49a4-b9da-dbba92044ec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cecf95e130b84264b0bc8abc2814ca98', 'request_id': 'req-10a48b63-0fec-49a4-b9da-dbba92044ec6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:54.518636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-10a48b63-0fec-49a4-b9da-dbba92044ec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cecf95e130b84264b0bc8abc2814ca98', 'request_id': 'req-10a48b63-0fec-49a4-b9da-dbba92044ec6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:54.524856 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-10a48b63-0fec-49a4-b9da-dbba92044ec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cecf95e130b84264b0bc8abc2814ca98', 'request_id': 'req-10a48b63-0fec-49a4-b9da-dbba92044ec6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:54.536298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-10a48b63-0fec-49a4-b9da-dbba92044ec6 admin admin] The token cache is being invalidate because project cecf95e130b84264b0bc8abc2814ca98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:01:54.536517 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-10a48b63-0fec-49a4-b9da-dbba92044ec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:54.537174 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-10a48b63-0fec-49a4-b9da-dbba92044ec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:54.538661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1287/2555] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:01:54 2022] DELETE /identity/v3/projects/cecf95e130b84264b0bc8abc2814ca98 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:54.543449 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159280d1-9c02-42fa-bb31-910099b06b5e service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:54.554265 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159280d1-9c02-42fa-bb31-910099b06b5e service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:54.614821 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:54.624475 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a88fa0-c802-4e24-bd41-a8209c4ac030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:54.625232 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a88fa0-c802-4e24-bd41-a8209c4ac030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:54.625955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a88fa0-c802-4e24-bd41-a8209c4ac030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:54.626372 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a88fa0-c802-4e24-bd41-a8209c4ac030 admin admin] PATH_INFO: `/v3/users/46eac3962739478b9cf71a5601589b6b` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:54.628028 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a88fa0-c802-4e24-bd41-a8209c4ac030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46eac3962739478b9cf71a5601589b6b)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:54.630189 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a88fa0-c802-4e24-bd41-a8209c4ac030 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:54.704271 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-77a88fa0-c802-4e24-bd41-a8209c4ac030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46eac3962739478b9cf71a5601589b6b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:54.717249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-77a88fa0-c802-4e24-bd41-a8209c4ac030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46eac3962739478b9cf71a5601589b6b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:54.717917 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-77a88fa0-c802-4e24-bd41-a8209c4ac030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46eac3962739478b9cf71a5601589b6b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:54.718866 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-77a88fa0-c802-4e24-bd41-a8209c4ac030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46eac3962739478b9cf71a5601589b6b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:54.728793 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-77a88fa0-c802-4e24-bd41-a8209c4ac030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46eac3962739478b9cf71a5601589b6b'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:54.748734 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1269/2556] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:01:54 2022] DELETE /identity/v3/users/46eac3962739478b9cf71a5601589b6b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:55.057412 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a48b63-0fec-49a4-b9da-dbba92044ec6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:55.062291 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-10a48b63-0fec-49a4-b9da-dbba92044ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:55.081240 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a48b63-0fec-49a4-b9da-dbba92044ec6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:55.169671 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e5c9d-d8f2-433c-8c9c-d276b185583b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:55.170308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e5c9d-d8f2-433c-8c9c-d276b185583b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:55.170587 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e5c9d-d8f2-433c-8c9c-d276b185583b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:55.170925 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e5c9d-d8f2-433c-8c9c-d276b185583b admin admin] PATH_INFO: `/v3/projects/1d94c115ec9e4741bc338da2fede7f27` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:55.172220 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e5c9d-d8f2-433c-8c9c-d276b185583b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d94c115ec9e4741bc338da2fede7f27)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:55.174292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e5c9d-d8f2-433c-8c9c-d276b185583b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:55.240831 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-830e5c9d-d8f2-433c-8c9c-d276b185583b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d94c115ec9e4741bc338da2fede7f27', 'request_id': 'req-830e5c9d-d8f2-433c-8c9c-d276b185583b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:55.251708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-830e5c9d-d8f2-433c-8c9c-d276b185583b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d94c115ec9e4741bc338da2fede7f27', 'request_id': 'req-830e5c9d-d8f2-433c-8c9c-d276b185583b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:55.257415 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:55.262322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-830e5c9d-d8f2-433c-8c9c-d276b185583b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d94c115ec9e4741bc338da2fede7f27', 'request_id': 'req-830e5c9d-d8f2-433c-8c9c-d276b185583b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:55.278423 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-830e5c9d-d8f2-433c-8c9c-d276b185583b admin admin] The token cache is being invalidate because project 1d94c115ec9e4741bc338da2fede7f27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:01:55.279267 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-830e5c9d-d8f2-433c-8c9c-d276b185583b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:55.279741 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-830e5c9d-d8f2-433c-8c9c-d276b185583b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:01:55.281732 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1288/2557] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:01:55 2022] DELETE /identity/v3/projects/1d94c115ec9e4741bc338da2fede7f27 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:55.288443 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e83baf-ceeb-4297-b6d1-7d006bd6d40a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:55.290005 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e83baf-ceeb-4297-b6d1-7d006bd6d40a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:55.290469 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e83baf-ceeb-4297-b6d1-7d006bd6d40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:55.325253 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e5e83baf-ceeb-4297-b6d1-7d006bd6d40a None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:55.326554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e5e83baf-ceeb-4297-b6d1-7d006bd6d40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:55.406442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1270/2558] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:55.408918 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4e2a3-18da-4167-8650-9f5f3ca3b7f2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:55.409203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4e2a3-18da-4167-8650-9f5f3ca3b7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:55.409477 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4e2a3-18da-4167-8650-9f5f3ca3b7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:55.434386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-80a4e2a3-18da-4167-8650-9f5f3ca3b7f2 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:55.435662 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-80a4e2a3-18da-4167-8650-9f5f3ca3b7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:55.446328 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1289/2559] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:55.450789 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e83baf-ceeb-4297-b6d1-7d006bd6d40a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:55.462405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e83baf-ceeb-4297-b6d1-7d006bd6d40a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:55.470550 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8878020-3f90-4dee-a0a6-fa02b171d750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:55.472261 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8878020-3f90-4dee-a0a6-fa02b171d750 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:55.472652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8878020-3f90-4dee-a0a6-fa02b171d750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:55.473034 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8878020-3f90-4dee-a0a6-fa02b171d750 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:55.473810 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8878020-3f90-4dee-a0a6-fa02b171d750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:01:55.474391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8878020-3f90-4dee-a0a6-fa02b171d750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:55.476186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8878020-3f90-4dee-a0a6-fa02b171d750 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:55.493752 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1271/2560] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:01:55.498349 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4e2a3-18da-4167-8650-9f5f3ca3b7f2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:55.508200 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4e2a3-18da-4167-8650-9f5f3ca3b7f2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:55.513456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301699b-77f7-45cf-9c1c-dd7037096d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:55.514143 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301699b-77f7-45cf-9c1c-dd7037096d46 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:55.514420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301699b-77f7-45cf-9c1c-dd7037096d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:55.514985 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301699b-77f7-45cf-9c1c-dd7037096d46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:55.515642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301699b-77f7-45cf-9c1c-dd7037096d46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:55.517598 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301699b-77f7-45cf-9c1c-dd7037096d46 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:55.547875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1290/2561] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:01:55 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:01:55.552215 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8878020-3f90-4dee-a0a6-fa02b171d750 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:55.563474 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8878020-3f90-4dee-a0a6-fa02b171d750 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:55.625829 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af30f2-f6dc-401a-b78e-a8f1a7569e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:55.626451 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af30f2-f6dc-401a-b78e-a8f1a7569e55 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:55.626786 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af30f2-f6dc-401a-b78e-a8f1a7569e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:55.627062 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67af30f2-f6dc-401a-b78e-a8f1a7569e55 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:55.627702 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af30f2-f6dc-401a-b78e-a8f1a7569e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:55.629663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67af30f2-f6dc-401a-b78e-a8f1a7569e55 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:55.642127 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:55.665483 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1272/2562] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:01:55 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:01:55.666182 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301699b-77f7-45cf-9c1c-dd7037096d46 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:55.678075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301699b-77f7-45cf-9c1c-dd7037096d46 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:55.684065 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5057d09-72ca-4372-a962-f84305d1f492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:55.684938 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5057d09-72ca-4372-a962-f84305d1f492 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:55.685058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5057d09-72ca-4372-a962-f84305d1f492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:55.685402 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5057d09-72ca-4372-a962-f84305d1f492 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:55.686510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5057d09-72ca-4372-a962-f84305d1f492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:55.688115 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5057d09-72ca-4372-a962-f84305d1f492 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:55.700773 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1291/2563] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:01:55.703789 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af30f2-f6dc-401a-b78e-a8f1a7569e55 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:55.715798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67af30f2-f6dc-401a-b78e-a8f1a7569e55 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:55.720531 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2a66d-31cb-468f-88a7-0fc3a5a3ed59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:55.721145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2a66d-31cb-468f-88a7-0fc3a5a3ed59 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:55.721427 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2a66d-31cb-468f-88a7-0fc3a5a3ed59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:55.721702 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2a66d-31cb-468f-88a7-0fc3a5a3ed59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:55.722541 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2a66d-31cb-468f-88a7-0fc3a5a3ed59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:55.724031 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2a66d-31cb-468f-88a7-0fc3a5a3ed59 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:55.736102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1273/2564] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:01:55.740933 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5057d09-72ca-4372-a962-f84305d1f492 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:55.754675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5057d09-72ca-4372-a962-f84305d1f492 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:55.760561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e70c92-5522-4875-a420-ce2b42963956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:55.761226 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e70c92-5522-4875-a420-ce2b42963956 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:55.761500 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e70c92-5522-4875-a420-ce2b42963956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:55.761895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e70c92-5522-4875-a420-ce2b42963956 admin admin] PATH_INFO: `/v3/projects/219a7bef407242ac92946ef50352d6cf/users/5ddf001800304b94b5f59ef2c9e83c00/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:55.778041 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e70c92-5522-4875-a420-ce2b42963956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=219a7bef407242ac92946ef50352d6cf, user_id=5ddf001800304b94b5f59ef2c9e83c00, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:55.780861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e70c92-5522-4875-a420-ce2b42963956 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:55.795613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1292/2565] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:01:55 2022] PUT /identity/v3/projects/219a7bef407242ac92946ef50352d6cf/users/5ddf001800304b94b5f59ef2c9e83c00/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:01:55.808126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ced774-9f6b-4188-8152-d1d5d75efed8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:55.808499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ced774-9f6b-4188-8152-d1d5d75efed8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:55.808876 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ced774-9f6b-4188-8152-d1d5d75efed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:55.854462 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-14ced774-9f6b-4188-8152-d1d5d75efed8 None None] MFA Rules not processed for user `5ddf001800304b94b5f59ef2c9e83c00`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:55.855942 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-14ced774-9f6b-4188-8152-d1d5d75efed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:55.953979 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1274/2566] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:55.955254 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e70c92-5522-4875-a420-ce2b42963956 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:56.035842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e70c92-5522-4875-a420-ce2b42963956 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:56.042130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769c1a3-973f-469d-ba6e-d77b58d4f53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:56.042750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769c1a3-973f-469d-ba6e-d77b58d4f53f admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:56.043029 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769c1a3-973f-469d-ba6e-d77b58d4f53f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:56.043305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769c1a3-973f-469d-ba6e-d77b58d4f53f admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:56.043943 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769c1a3-973f-469d-ba6e-d77b58d4f53f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:56.045879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769c1a3-973f-469d-ba6e-d77b58d4f53f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:56.079619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1293/2567] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:01:55 2022] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:01:56.083908 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ced774-9f6b-4188-8152-d1d5d75efed8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:56.094822 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ced774-9f6b-4188-8152-d1d5d75efed8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:56.154864 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b9cd2-1ffc-4be3-9bab-f778cfc9298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:56.155469 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b9cd2-1ffc-4be3-9bab-f778cfc9298d admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:56.155830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b9cd2-1ffc-4be3-9bab-f778cfc9298d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:56.156140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b9cd2-1ffc-4be3-9bab-f778cfc9298d admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:56.156828 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b9cd2-1ffc-4be3-9bab-f778cfc9298d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:56.158772 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b9cd2-1ffc-4be3-9bab-f778cfc9298d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:56.180317 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1275/2568] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:01:56 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:01:56.185592 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769c1a3-973f-469d-ba6e-d77b58d4f53f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:56.196325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769c1a3-973f-469d-ba6e-d77b58d4f53f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:56.201341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e898801-5517-4ce4-8e2f-aa4cd0a845d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:56.201957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e898801-5517-4ce4-8e2f-aa4cd0a845d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:56.202238 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e898801-5517-4ce4-8e2f-aa4cd0a845d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:56.202513 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e898801-5517-4ce4-8e2f-aa4cd0a845d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:56.203161 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e898801-5517-4ce4-8e2f-aa4cd0a845d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:56.204796 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e898801-5517-4ce4-8e2f-aa4cd0a845d9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:56.217917 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1294/2569] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:01:56.222281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b9cd2-1ffc-4be3-9bab-f778cfc9298d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:56.232931 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b9cd2-1ffc-4be3-9bab-f778cfc9298d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:56.237583 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4419ef-484f-4d65-8031-0428535670b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:56.238480 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4419ef-484f-4d65-8031-0428535670b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:56.238603 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4419ef-484f-4d65-8031-0428535670b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:56.238789 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4419ef-484f-4d65-8031-0428535670b9 admin admin] PATH_INFO: `/v3/projects/a6729f6439e64f2094011de9082550b1/users/0215e55557f746c48f05f17f0473ba72/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:56.255056 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4419ef-484f-4d65-8031-0428535670b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6729f6439e64f2094011de9082550b1, user_id=0215e55557f746c48f05f17f0473ba72, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:56.257797 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4419ef-484f-4d65-8031-0428535670b9 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:56.270066 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1276/2570] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:01:56 2022] PUT /identity/v3/projects/a6729f6439e64f2094011de9082550b1/users/0215e55557f746c48f05f17f0473ba72/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:56.274031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e898801-5517-4ce4-8e2f-aa4cd0a845d9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:56.284004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e898801-5517-4ce4-8e2f-aa4cd0a845d9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:56.351307 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2840f0c-0a52-452f-89f6-8dccf89bd5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:56.351558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2840f0c-0a52-452f-89f6-8dccf89bd5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:56.351711 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2840f0c-0a52-452f-89f6-8dccf89bd5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:56.352000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2840f0c-0a52-452f-89f6-8dccf89bd5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:56.354176 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2840f0c-0a52-452f-89f6-8dccf89bd5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:56.355926 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2840f0c-0a52-452f-89f6-8dccf89bd5a7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:56.356701 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:56.366485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1295/2571] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:01:56.380015 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4419ef-484f-4d65-8031-0428535670b9 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:56.395487 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4419ef-484f-4d65-8031-0428535670b9 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:56.403275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268f49e-0246-4e94-ae17-1a73abea2b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:56.404029 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268f49e-0246-4e94-ae17-1a73abea2b5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:56.404382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268f49e-0246-4e94-ae17-1a73abea2b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:56.404582 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268f49e-0246-4e94-ae17-1a73abea2b5d admin admin] PATH_INFO: `/v3/projects/a6729f6439e64f2094011de9082550b1/users/0215e55557f746c48f05f17f0473ba72/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:56.406801 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268f49e-0246-4e94-ae17-1a73abea2b5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6729f6439e64f2094011de9082550b1, user_id=0215e55557f746c48f05f17f0473ba72, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:56.410266 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268f49e-0246-4e94-ae17-1a73abea2b5d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:56.431564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1277/2572] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:01:56 2022] PUT /identity/v3/projects/a6729f6439e64f2094011de9082550b1/users/0215e55557f746c48f05f17f0473ba72/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:01:56.442233 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30dcc2-d162-471b-a6d7-3309b7126b07 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:56.442522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30dcc2-d162-471b-a6d7-3309b7126b07 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:56.444123 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db30dcc2-d162-471b-a6d7-3309b7126b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:56.474061 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-db30dcc2-d162-471b-a6d7-3309b7126b07 None None] MFA Rules not processed for user `0215e55557f746c48f05f17f0473ba72`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:56.475280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-db30dcc2-d162-471b-a6d7-3309b7126b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:56.543175 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1296/2573] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:01:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:56.554622 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268f49e-0246-4e94-ae17-1a73abea2b5d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:56.556956 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2268f49e-0246-4e94-ae17-1a73abea2b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:56.584425 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:56.615826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268f49e-0246-4e94-ae17-1a73abea2b5d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:56.619496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c658db-f0a1-45cc-b3be-14ab3cdf1c88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:56.620122 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c658db-f0a1-45cc-b3be-14ab3cdf1c88 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:56.620408 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c658db-f0a1-45cc-b3be-14ab3cdf1c88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:56.620682 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c658db-f0a1-45cc-b3be-14ab3cdf1c88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:56.629525 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c658db-f0a1-45cc-b3be-14ab3cdf1c88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:56.630964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c658db-f0a1-45cc-b3be-14ab3cdf1c88 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:56.640397 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1278/2574] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:56.722366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30dcc2-d162-471b-a6d7-3309b7126b07 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:56.732585 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db30dcc2-d162-471b-a6d7-3309b7126b07 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:56.736156 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a45e91-f48c-466c-a00a-0665244ad286 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:56.736745 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a45e91-f48c-466c-a00a-0665244ad286 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:56.737021 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a45e91-f48c-466c-a00a-0665244ad286 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:56.737307 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a45e91-f48c-466c-a00a-0665244ad286 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:56.793793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a45e91-f48c-466c-a00a-0665244ad286 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:56.795216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a45e91-f48c-466c-a00a-0665244ad286 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:56.803823 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1297/2575] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:57.369593 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c658db-f0a1-45cc-b3be-14ab3cdf1c88 service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:57.371640 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-27c658db-f0a1-45cc-b3be-14ab3cdf1c88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:57.459040 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c658db-f0a1-45cc-b3be-14ab3cdf1c88 service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:57.464591 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af46c9-0ef4-4237-adee-65a55ed4dc5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:57.465198 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af46c9-0ef4-4237-adee-65a55ed4dc5b service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:57.465503 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af46c9-0ef4-4237-adee-65a55ed4dc5b service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:57.465752 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7af46c9-0ef4-4237-adee-65a55ed4dc5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:57.467479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c7af46c9-0ef4-4237-adee-65a55ed4dc5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:57.479708 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af46c9-0ef4-4237-adee-65a55ed4dc5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:57.481392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7af46c9-0ef4-4237-adee-65a55ed4dc5b service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:57.492624 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1279/2576] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:01:58.737086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfc37c-017f-4f20-8473-c876fec95195 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:58.737628 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfc37c-017f-4f20-8473-c876fec95195 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:58.737960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfc37c-017f-4f20-8473-c876fec95195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:58.762870 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-43cfc37c-017f-4f20-8473-c876fec95195 None None] MFA Rules not processed for user `e51ae6959aac49898e75c6786c5dbdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:01:58.764129 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-43cfc37c-017f-4f20-8473-c876fec95195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:58.822987 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1298/2577] 10.222.0.15 () {58 vars in 967 bytes} [Fri Sep 9 21:01:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:01:58.835345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af46c9-0ef4-4237-adee-65a55ed4dc5b service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:58.836832 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c7af46c9-0ef4-4237-adee-65a55ed4dc5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:58.906613 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7af46c9-0ef4-4237-adee-65a55ed4dc5b service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:58.911856 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e75dd-cd9f-409d-a2b4-904ad08b5712 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9570eaa112de460cb9e371278bfb300b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:58.912500 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e75dd-cd9f-409d-a2b4-904ad08b5712 service swift] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:58.912779 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e75dd-cd9f-409d-a2b4-904ad08b5712 service swift] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:58.913052 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e75dd-cd9f-409d-a2b4-904ad08b5712 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:58.921332 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e75dd-cd9f-409d-a2b4-904ad08b5712 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:58.922918 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e75dd-cd9f-409d-a2b4-904ad08b5712 service swift] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:58.931257 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1280/2578] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Sep 9 21:01:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 09 21:01:59.729622 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfc37c-017f-4f20-8473-c876fec95195 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:01:59.731070 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-43cfc37c-017f-4f20-8473-c876fec95195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:59.759412 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:01:59.789802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfc37c-017f-4f20-8473-c876fec95195 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:01:59.793715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f285bc-ebb5-4c95-b891-01942a03ec30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:01:59.794314 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f285bc-ebb5-4c95-b891-01942a03ec30 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:01:59.794589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f285bc-ebb5-4c95-b891-01942a03ec30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:01:59.794875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f285bc-ebb5-4c95-b891-01942a03ec30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:01:59.796609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e6f285bc-ebb5-4c95-b891-01942a03ec30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:01:59.861521 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f285bc-ebb5-4c95-b891-01942a03ec30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:01:59.862871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f285bc-ebb5-4c95-b891-01942a03ec30 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:01:59.874036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1299/2579] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:01:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:01.655741 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e75dd-cd9f-409d-a2b4-904ad08b5712 service swift] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:01.667975 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e75dd-cd9f-409d-a2b4-904ad08b5712 service swift] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:01.673161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2418b-5f9b-4eb8-80fb-8652514c945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:01.674334 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2418b-5f9b-4eb8-80fb-8652514c945d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:01.674724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2418b-5f9b-4eb8-80fb-8652514c945d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:01.675116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2418b-5f9b-4eb8-80fb-8652514c945d admin admin] PATH_INFO: `/v3/users/5ddf001800304b94b5f59ef2c9e83c00` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:01.676581 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2418b-5f9b-4eb8-80fb-8652514c945d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ddf001800304b94b5f59ef2c9e83c00)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:01.678638 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2418b-5f9b-4eb8-80fb-8652514c945d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:01.732538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:01.744931 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1ac2418b-5f9b-4eb8-80fb-8652514c945d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ddf001800304b94b5f59ef2c9e83c00'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:01.755590 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1ac2418b-5f9b-4eb8-80fb-8652514c945d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ddf001800304b94b5f59ef2c9e83c00'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:01.756564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1ac2418b-5f9b-4eb8-80fb-8652514c945d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ddf001800304b94b5f59ef2c9e83c00'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:01.757405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1ac2418b-5f9b-4eb8-80fb-8652514c945d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ddf001800304b94b5f59ef2c9e83c00'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:01.766088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1ac2418b-5f9b-4eb8-80fb-8652514c945d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ddf001800304b94b5f59ef2c9e83c00'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:01.787604 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1281/2580] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:02:01 2022] DELETE /identity/v3/users/5ddf001800304b94b5f59ef2c9e83c00 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:01.792917 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383a1b3-bcd7-4cad-a6b5-ff2f3bcb28a8 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:01.793458 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383a1b3-bcd7-4cad-a6b5-ff2f3bcb28a8 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:01.793458 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e383a1b3-bcd7-4cad-a6b5-ff2f3bcb28a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:01.814555 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e383a1b3-bcd7-4cad-a6b5-ff2f3bcb28a8 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:01.815957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e383a1b3-bcd7-4cad-a6b5-ff2f3bcb28a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:01.889166 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1300/2581] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:02:01.899202 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2418b-5f9b-4eb8-80fb-8652514c945d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:01.901123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1ac2418b-5f9b-4eb8-80fb-8652514c945d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:01.969560 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2418b-5f9b-4eb8-80fb-8652514c945d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:01.973302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4493b-4466-435b-8f32-e26b7c6344c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:01.973917 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4493b-4466-435b-8f32-e26b7c6344c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:01.974196 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4493b-4466-435b-8f32-e26b7c6344c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:01.974468 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f4493b-4466-435b-8f32-e26b7c6344c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:01.984339 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4493b-4466-435b-8f32-e26b7c6344c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:01.985712 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f4493b-4466-435b-8f32-e26b7c6344c8 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:01.995834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1282/2582] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:02.358124 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383a1b3-bcd7-4cad-a6b5-ff2f3bcb28a8 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:02.359589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e383a1b3-bcd7-4cad-a6b5-ff2f3bcb28a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:02.377501 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e383a1b3-bcd7-4cad-a6b5-ff2f3bcb28a8 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:02.393541 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a040a4d-c349-457a-b696-3b88134d74b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:02.394194 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a040a4d-c349-457a-b696-3b88134d74b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:02.394471 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a040a4d-c349-457a-b696-3b88134d74b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:02.394742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a040a4d-c349-457a-b696-3b88134d74b7 admin admin] PATH_INFO: `/v3/projects/219a7bef407242ac92946ef50352d6cf` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:02.396041 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a040a4d-c349-457a-b696-3b88134d74b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=219a7bef407242ac92946ef50352d6cf)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:02.398442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a040a4d-c349-457a-b696-3b88134d74b7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:02.468566 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6a040a4d-c349-457a-b696-3b88134d74b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219a7bef407242ac92946ef50352d6cf', 'request_id': 'req-6a040a4d-c349-457a-b696-3b88134d74b7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:02.478316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6a040a4d-c349-457a-b696-3b88134d74b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219a7bef407242ac92946ef50352d6cf', 'request_id': 'req-6a040a4d-c349-457a-b696-3b88134d74b7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:02.488799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6a040a4d-c349-457a-b696-3b88134d74b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219a7bef407242ac92946ef50352d6cf', 'request_id': 'req-6a040a4d-c349-457a-b696-3b88134d74b7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:02.497938 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:02.505125 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6a040a4d-c349-457a-b696-3b88134d74b7 admin admin] The token cache is being invalidate because project 219a7bef407242ac92946ef50352d6cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:02:02.505394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6a040a4d-c349-457a-b696-3b88134d74b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:02.506203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6a040a4d-c349-457a-b696-3b88134d74b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:02.512973 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1301/2583] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:02:02 2022] DELETE /identity/v3/projects/219a7bef407242ac92946ef50352d6cf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:02.514787 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4493b-4466-435b-8f32-e26b7c6344c8 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:02.526768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f4493b-4466-435b-8f32-e26b7c6344c8 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:02.597040 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5680c-4e45-4dd1-9479-28a13a98ba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:02.597678 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5680c-4e45-4dd1-9479-28a13a98ba11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:02.597956 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5680c-4e45-4dd1-9479-28a13a98ba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:02.598222 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5680c-4e45-4dd1-9479-28a13a98ba11 admin admin] PATH_INFO: `/v3/users/0215e55557f746c48f05f17f0473ba72` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:02.599338 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5680c-4e45-4dd1-9479-28a13a98ba11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0215e55557f746c48f05f17f0473ba72)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:02.601308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5680c-4e45-4dd1-9479-28a13a98ba11 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:02.652273 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-48d5680c-4e45-4dd1-9479-28a13a98ba11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0215e55557f746c48f05f17f0473ba72'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:02.660625 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-48d5680c-4e45-4dd1-9479-28a13a98ba11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0215e55557f746c48f05f17f0473ba72'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:02.661867 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-48d5680c-4e45-4dd1-9479-28a13a98ba11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0215e55557f746c48f05f17f0473ba72'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:02.662595 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-48d5680c-4e45-4dd1-9479-28a13a98ba11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0215e55557f746c48f05f17f0473ba72'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:02.668116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:02.672460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-48d5680c-4e45-4dd1-9479-28a13a98ba11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0215e55557f746c48f05f17f0473ba72'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:02.692364 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1283/2584] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:02:02 2022] DELETE /identity/v3/users/0215e55557f746c48f05f17f0473ba72 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:02:02.969235 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a040a4d-c349-457a-b696-3b88134d74b7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:02.970721 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6a040a4d-c349-457a-b696-3b88134d74b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:02.991934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a040a4d-c349-457a-b696-3b88134d74b7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:03.039183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5680c-4e45-4dd1-9479-28a13a98ba11 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:03.041364 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-48d5680c-4e45-4dd1-9479-28a13a98ba11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:03.067440 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6559262-5c33-4cfe-bcc9-32b05b2231ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:03.069005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6559262-5c33-4cfe-bcc9-32b05b2231ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:03.069279 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6559262-5c33-4cfe-bcc9-32b05b2231ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:03.069556 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6559262-5c33-4cfe-bcc9-32b05b2231ff admin admin] PATH_INFO: `/v3/users/9c758557426941babdaa68cbae43f881` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:03.071087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6559262-5c33-4cfe-bcc9-32b05b2231ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c758557426941babdaa68cbae43f881)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:03.073477 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6559262-5c33-4cfe-bcc9-32b05b2231ff admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:03.132059 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b6559262-5c33-4cfe-bcc9-32b05b2231ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c758557426941babdaa68cbae43f881'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:03.140431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b6559262-5c33-4cfe-bcc9-32b05b2231ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c758557426941babdaa68cbae43f881'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:03.146001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5680c-4e45-4dd1-9479-28a13a98ba11 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:03.151351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc089c2-1cc2-4b3e-add1-e892417885e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:03.152028 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc089c2-1cc2-4b3e-add1-e892417885e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:03.152305 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc089c2-1cc2-4b3e-add1-e892417885e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:03.152584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc089c2-1cc2-4b3e-add1-e892417885e7 admin admin] PATH_INFO: `/v3/projects/a6729f6439e64f2094011de9082550b1` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:03.153386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b6559262-5c33-4cfe-bcc9-32b05b2231ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c758557426941babdaa68cbae43f881'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:03.153710 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc089c2-1cc2-4b3e-add1-e892417885e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6729f6439e64f2094011de9082550b1)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:03.154114 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b6559262-5c33-4cfe-bcc9-32b05b2231ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c758557426941babdaa68cbae43f881'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:03.154782 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-b6559262-5c33-4cfe-bcc9-32b05b2231ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c758557426941babdaa68cbae43f881'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:03.155777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc089c2-1cc2-4b3e-add1-e892417885e7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:03.168741 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1302/2585] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:02:02 2022] DELETE /identity/v3/users/9c758557426941babdaa68cbae43f881 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:03.206992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dbc089c2-1cc2-4b3e-add1-e892417885e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6729f6439e64f2094011de9082550b1', 'request_id': 'req-dbc089c2-1cc2-4b3e-add1-e892417885e7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:03.219408 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dbc089c2-1cc2-4b3e-add1-e892417885e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6729f6439e64f2094011de9082550b1', 'request_id': 'req-dbc089c2-1cc2-4b3e-add1-e892417885e7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:03.225634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dbc089c2-1cc2-4b3e-add1-e892417885e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6729f6439e64f2094011de9082550b1', 'request_id': 'req-dbc089c2-1cc2-4b3e-add1-e892417885e7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:03.237730 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dbc089c2-1cc2-4b3e-add1-e892417885e7 admin admin] The token cache is being invalidate because project a6729f6439e64f2094011de9082550b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:02:03.238025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dbc089c2-1cc2-4b3e-add1-e892417885e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:03.238748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-dbc089c2-1cc2-4b3e-add1-e892417885e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:03.240293 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1284/2586] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:02:03 2022] DELETE /identity/v3/projects/a6729f6439e64f2094011de9082550b1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:02:03.245308 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04694c-271d-4b65-81b3-bf531a655e4f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:03.245673 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04694c-271d-4b65-81b3-bf531a655e4f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:03.246020 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04694c-271d-4b65-81b3-bf531a655e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:03.266444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5f04694c-271d-4b65-81b3-bf531a655e4f None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:03.267692 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5f04694c-271d-4b65-81b3-bf531a655e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:03.334054 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1303/2587] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:02:03.341872 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc042a-3e5d-4eaf-a4c3-82c402f50220 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:03.342161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc042a-3e5d-4eaf-a4c3-82c402f50220 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:03.342462 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc042a-3e5d-4eaf-a4c3-82c402f50220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:03.352798 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04694c-271d-4b65-81b3-bf531a655e4f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:03.354355 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5f04694c-271d-4b65-81b3-bf531a655e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:03.368323 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04694c-271d-4b65-81b3-bf531a655e4f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:03.373849 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3bbc042a-3e5d-4eaf-a4c3-82c402f50220 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:03.374032 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa988956-1f77-4b96-a980-2c92e468aad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:03.374685 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa988956-1f77-4b96-a980-2c92e468aad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:03.374964 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa988956-1f77-4b96-a980-2c92e468aad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:03.375083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3bbc042a-3e5d-4eaf-a4c3-82c402f50220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:03.375234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa988956-1f77-4b96-a980-2c92e468aad5 admin admin] PATH_INFO: `/v3/projects/410f9f5986604ba5bef24b84bc59e4f8` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:03.376529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa988956-1f77-4b96-a980-2c92e468aad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=410f9f5986604ba5bef24b84bc59e4f8)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:03.378563 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa988956-1f77-4b96-a980-2c92e468aad5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:03.385923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1285/2588] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:03.392780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:03.393939 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc042a-3e5d-4eaf-a4c3-82c402f50220 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:03.406108 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc042a-3e5d-4eaf-a4c3-82c402f50220 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:03.411512 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95e6eb-e674-49e9-9395-6e22540800d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:03.412536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95e6eb-e674-49e9-9395-6e22540800d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:03.412828 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95e6eb-e674-49e9-9395-6e22540800d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:03.413099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95e6eb-e674-49e9-9395-6e22540800d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:03.414242 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95e6eb-e674-49e9-9395-6e22540800d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:02:03.414695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95e6eb-e674-49e9-9395-6e22540800d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:03.417211 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95e6eb-e674-49e9-9395-6e22540800d0 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:03.432198 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1286/2589] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:02:03.436891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95e6eb-e674-49e9-9395-6e22540800d0 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:03.438918 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fa988956-1f77-4b96-a980-2c92e468aad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410f9f5986604ba5bef24b84bc59e4f8', 'request_id': 'req-fa988956-1f77-4b96-a980-2c92e468aad5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:03.447337 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fa988956-1f77-4b96-a980-2c92e468aad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410f9f5986604ba5bef24b84bc59e4f8', 'request_id': 'req-fa988956-1f77-4b96-a980-2c92e468aad5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:03.448780 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95e6eb-e674-49e9-9395-6e22540800d0 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:03.453045 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fa988956-1f77-4b96-a980-2c92e468aad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410f9f5986604ba5bef24b84bc59e4f8', 'request_id': 'req-fa988956-1f77-4b96-a980-2c92e468aad5'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:03.464628 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fa988956-1f77-4b96-a980-2c92e468aad5 admin admin] The token cache is being invalidate because project 410f9f5986604ba5bef24b84bc59e4f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:02:03.465058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fa988956-1f77-4b96-a980-2c92e468aad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:03.465710 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-fa988956-1f77-4b96-a980-2c92e468aad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:03.467228 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1304/2590] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:02:03 2022] DELETE /identity/v3/projects/410f9f5986604ba5bef24b84bc59e4f8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:02:03.471851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6ed9b-faed-47a8-8940-675ce004d48b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:03.472186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6ed9b-faed-47a8-8940-675ce004d48b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:03.472447 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6ed9b-faed-47a8-8940-675ce004d48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:03.492651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:03.493363 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-06b6ed9b-faed-47a8-8940-675ce004d48b None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:03.494857 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-06b6ed9b-faed-47a8-8940-675ce004d48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:03.510238 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969cb2b-d4ac-4ef9-a44a-defb67e552ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:03.510854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969cb2b-d4ac-4ef9-a44a-defb67e552ec admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:03.511132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969cb2b-d4ac-4ef9-a44a-defb67e552ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:03.511401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969cb2b-d4ac-4ef9-a44a-defb67e552ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:03.512046 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969cb2b-d4ac-4ef9-a44a-defb67e552ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:03.513962 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969cb2b-d4ac-4ef9-a44a-defb67e552ec admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:03.541736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1287/2591] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:02:03 2022] POST /identity/v3/projects => generated 399 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:02:03.545895 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969cb2b-d4ac-4ef9-a44a-defb67e552ec admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:03.548726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0969cb2b-d4ac-4ef9-a44a-defb67e552ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:03.557469 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1305/2592] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:02:03.565030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5e4bb-8e4d-4e04-a007-6463edeea276 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:03.565323 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5e4bb-8e4d-4e04-a007-6463edeea276 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:03.565600 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5e4bb-8e4d-4e04-a007-6463edeea276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:03.584934 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-b3c5e4bb-8e4d-4e04-a007-6463edeea276 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:03.586143 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-b3c5e4bb-8e4d-4e04-a007-6463edeea276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:03.615451 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969cb2b-d4ac-4ef9-a44a-defb67e552ec admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:03.620786 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81bcee-8d71-43de-ab3a-a9cc923326f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:03.621399 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81bcee-8d71-43de-ab3a-a9cc923326f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:03.621682 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81bcee-8d71-43de-ab3a-a9cc923326f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:03.621960 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81bcee-8d71-43de-ab3a-a9cc923326f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:03.622591 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81bcee-8d71-43de-ab3a-a9cc923326f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:03.624564 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81bcee-8d71-43de-ab3a-a9cc923326f8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:03.649192 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1288/2593] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:02:03 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:02:03.649383 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1306/2594] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:02:03.650555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81bcee-8d71-43de-ab3a-a9cc923326f8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:03.651143 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5e4bb-8e4d-4e04-a007-6463edeea276 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:03.660242 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81bcee-8d71-43de-ab3a-a9cc923326f8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:03.660454 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5e4bb-8e4d-4e04-a007-6463edeea276 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:03.667943 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12b9bb-4fe0-47a9-a8bd-c67548c8bd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:03.669605 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792f41d-37f7-4c93-ba04-60f10a2fb4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:03.669792 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12b9bb-4fe0-47a9-a8bd-c67548c8bd4e admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:03.669915 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792f41d-37f7-4c93-ba04-60f10a2fb4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:03.670037 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12b9bb-4fe0-47a9-a8bd-c67548c8bd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:03.670146 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792f41d-37f7-4c93-ba04-60f10a2fb4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:03.670239 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b12b9bb-4fe0-47a9-a8bd-c67548c8bd4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:03.670340 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792f41d-37f7-4c93-ba04-60f10a2fb4c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:03.670441 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12b9bb-4fe0-47a9-a8bd-c67548c8bd4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:03.670539 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792f41d-37f7-4c93-ba04-60f10a2fb4c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:02:03.670539 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792f41d-37f7-4c93-ba04-60f10a2fb4c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:03.670714 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b12b9bb-4fe0-47a9-a8bd-c67548c8bd4e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:03.670802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792f41d-37f7-4c93-ba04-60f10a2fb4c7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:03.683387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1289/2595] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:03.683585 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1307/2596] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:02:03.684563 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12b9bb-4fe0-47a9-a8bd-c67548c8bd4e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:03.686821 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792f41d-37f7-4c93-ba04-60f10a2fb4c7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:03.694735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b12b9bb-4fe0-47a9-a8bd-c67548c8bd4e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:03.696777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792f41d-37f7-4c93-ba04-60f10a2fb4c7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:03.699676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbe1e7-2790-41eb-aabf-cbf10889e924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:03.700304 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbe1e7-2790-41eb-aabf-cbf10889e924 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:03.700586 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbe1e7-2790-41eb-aabf-cbf10889e924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:03.700862 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbe1e7-2790-41eb-aabf-cbf10889e924 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:03.701536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbe1e7-2790-41eb-aabf-cbf10889e924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:03.701662 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bd851-78b0-4a76-a6a1-701325e02100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:03.702137 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bd851-78b0-4a76-a6a1-701325e02100 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:03.702417 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bd851-78b0-4a76-a6a1-701325e02100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:03.702692 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bd851-78b0-4a76-a6a1-701325e02100 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:03.703138 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbe1e7-2790-41eb-aabf-cbf10889e924 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:03.703316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bd851-78b0-4a76-a6a1-701325e02100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:03.705224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bd851-78b0-4a76-a6a1-701325e02100 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:03.714346 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1290/2597] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:02:03.718105 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbe1e7-2790-41eb-aabf-cbf10889e924 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:03.728691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbe1e7-2790-41eb-aabf-cbf10889e924 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:03.732763 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1308/2598] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:02:03 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:02:03.733593 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e9057-0926-4f2f-a6ec-ddc7c050c432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:03.734245 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e9057-0926-4f2f-a6ec-ddc7c050c432 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:03.734525 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e9057-0926-4f2f-a6ec-ddc7c050c432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:03.734799 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e9057-0926-4f2f-a6ec-ddc7c050c432 admin admin] PATH_INFO: `/v3/projects/f50d9fb2b1984d3c9ec7987136052d7c/users/aa6a199d453e465f8da37502610ca706/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:03.736877 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bd851-78b0-4a76-a6a1-701325e02100 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:03.746485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:03.751409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e9057-0926-4f2f-a6ec-ddc7c050c432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f50d9fb2b1984d3c9ec7987136052d7c, user_id=aa6a199d453e465f8da37502610ca706, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:03.754702 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e9057-0926-4f2f-a6ec-ddc7c050c432 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:03.769358 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1291/2599] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:03 2022] PUT /identity/v3/projects/f50d9fb2b1984d3c9ec7987136052d7c/users/aa6a199d453e465f8da37502610ca706/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:02:03.781144 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b46e56-0d46-4baf-a0a3-7eb333d75dd2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:03.781434 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b46e56-0d46-4baf-a0a3-7eb333d75dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:03.781715 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b46e56-0d46-4baf-a0a3-7eb333d75dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:03.803585 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bd851-78b0-4a76-a6a1-701325e02100 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:03.810435 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c5b46e56-0d46-4baf-a0a3-7eb333d75dd2 None None] MFA Rules not processed for user `aa6a199d453e465f8da37502610ca706`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:03.811658 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c5b46e56-0d46-4baf-a0a3-7eb333d75dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:03.861137 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d2ada-8bef-4b55-952c-361cc189e12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:03.861746 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d2ada-8bef-4b55-952c-361cc189e12b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:03.862022 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d2ada-8bef-4b55-952c-361cc189e12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:03.862294 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0d2ada-8bef-4b55-952c-361cc189e12b admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:03.862927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d2ada-8bef-4b55-952c-361cc189e12b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:03.864866 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0d2ada-8bef-4b55-952c-361cc189e12b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:03.877257 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1292/2600] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:03 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:02:03.892321 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1309/2601] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:02:03 2022] POST /identity/v3/users => generated 303 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:02:03.892495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b46e56-0d46-4baf-a0a3-7eb333d75dd2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:03.892495 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c5b46e56-0d46-4baf-a0a3-7eb333d75dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:03.893521 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d2ada-8bef-4b55-952c-361cc189e12b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:03.898797 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:03.904861 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0d2ada-8bef-4b55-952c-361cc189e12b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:03.910905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514fca3-492b-4867-919d-0521f9941d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:03.911519 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514fca3-492b-4867-919d-0521f9941d01 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:03.911804 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514fca3-492b-4867-919d-0521f9941d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:03.912111 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514fca3-492b-4867-919d-0521f9941d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:03.913212 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514fca3-492b-4867-919d-0521f9941d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:03.915785 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6514fca3-492b-4867-919d-0521f9941d01 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:03.927060 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1310/2602] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:03.931648 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514fca3-492b-4867-919d-0521f9941d01 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:03.942803 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6514fca3-492b-4867-919d-0521f9941d01 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:03.947712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b6e55-f218-4cba-a7e8-f6725d703340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:03.948323 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b6e55-f218-4cba-a7e8-f6725d703340 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:03.948601 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b6e55-f218-4cba-a7e8-f6725d703340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:03.948963 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b6e55-f218-4cba-a7e8-f6725d703340 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:03.949598 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b6e55-f218-4cba-a7e8-f6725d703340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:03.951156 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b6e55-f218-4cba-a7e8-f6725d703340 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:03.953317 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b46e56-0d46-4baf-a0a3-7eb333d75dd2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:03.957412 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdbb783-4fe9-41b0-b79c-97a5d3178392 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:03.958087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbb783-4fe9-41b0-b79c-97a5d3178392 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:03.958365 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbb783-4fe9-41b0-b79c-97a5d3178392 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:03.958772 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdbb783-4fe9-41b0-b79c-97a5d3178392 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:03.969226 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdbb783-4fe9-41b0-b79c-97a5d3178392 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:03.970777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdbb783-4fe9-41b0-b79c-97a5d3178392 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:03.972035 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1311/2603] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:02:03.976158 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b6e55-f218-4cba-a7e8-f6725d703340 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:03.984528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1293/2604] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:03 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:02:03.986429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b6e55-f218-4cba-a7e8-f6725d703340 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:03.991073 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e74757-f466-4c1c-831a-1b0aa9141e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:03.991713 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e74757-f466-4c1c-831a-1b0aa9141e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:03.991996 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e74757-f466-4c1c-831a-1b0aa9141e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:03.992289 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e74757-f466-4c1c-831a-1b0aa9141e7a admin admin] PATH_INFO: `/v3/projects/8d7c23c0bf704488be6766f0f6d33094/users/b41502578d184157b02a8db3e85c29f8/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:04.007273 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e74757-f466-4c1c-831a-1b0aa9141e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7c23c0bf704488be6766f0f6d33094, user_id=b41502578d184157b02a8db3e85c29f8, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:04.010863 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e74757-f466-4c1c-831a-1b0aa9141e7a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:04.024947 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1312/2605] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:03 2022] PUT /identity/v3/projects/8d7c23c0bf704488be6766f0f6d33094/users/b41502578d184157b02a8db3e85c29f8/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:02:04.035005 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2992fa-0a97-44af-9856-04b5e990fb2a None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:04.035363 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2992fa-0a97-44af-9856-04b5e990fb2a None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:04.036010 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2992fa-0a97-44af-9856-04b5e990fb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:04.083698 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fb2992fa-0a97-44af-9856-04b5e990fb2a None None] MFA Rules not processed for user `b41502578d184157b02a8db3e85c29f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:04.085089 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fb2992fa-0a97-44af-9856-04b5e990fb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:04.166742 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1294/2606] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:04 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:04.171159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e74757-f466-4c1c-831a-1b0aa9141e7a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:04.233289 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:04.237338 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e74757-f466-4c1c-831a-1b0aa9141e7a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:04.243714 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225bc5a-22b3-41b7-bf82-1671e38d08e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:04.244451 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225bc5a-22b3-41b7-bf82-1671e38d08e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:04.244738 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225bc5a-22b3-41b7-bf82-1671e38d08e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:04.245003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e225bc5a-22b3-41b7-bf82-1671e38d08e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:04.245722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225bc5a-22b3-41b7-bf82-1671e38d08e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:04.247603 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e225bc5a-22b3-41b7-bf82-1671e38d08e6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:04.280393 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1313/2607] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:02:04 2022] POST /identity/v3/projects => generated 405 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:02:04.286099 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2992fa-0a97-44af-9856-04b5e990fb2a None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:04.298202 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2992fa-0a97-44af-9856-04b5e990fb2a None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:04.363831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86813f3e-cc3a-437f-9e8a-aadae3a2107a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:04.364478 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86813f3e-cc3a-437f-9e8a-aadae3a2107a admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:04.364840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86813f3e-cc3a-437f-9e8a-aadae3a2107a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:04.365145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86813f3e-cc3a-437f-9e8a-aadae3a2107a admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:04.365777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86813f3e-cc3a-437f-9e8a-aadae3a2107a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:04.374097 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86813f3e-cc3a-437f-9e8a-aadae3a2107a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:04.397443 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1295/2608] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:02:04 2022] POST /identity/v3/users => generated 309 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:02:04.398842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225bc5a-22b3-41b7-bf82-1671e38d08e6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:04.411026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e225bc5a-22b3-41b7-bf82-1671e38d08e6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:04.416362 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb69f9-16ec-4808-81d2-c3fd3a8eb6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:04.416969 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb69f9-16ec-4808-81d2-c3fd3a8eb6ee admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:04.417242 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb69f9-16ec-4808-81d2-c3fd3a8eb6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:04.417512 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb69f9-16ec-4808-81d2-c3fd3a8eb6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:04.418184 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb69f9-16ec-4808-81d2-c3fd3a8eb6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:04.419800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb69f9-16ec-4808-81d2-c3fd3a8eb6ee admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:04.440188 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1314/2609] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:04.440288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86813f3e-cc3a-437f-9e8a-aadae3a2107a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:04.445710 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86813f3e-cc3a-437f-9e8a-aadae3a2107a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:04.450496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7186d-4562-4346-b61e-706c41da71ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:04.451253 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7186d-4562-4346-b61e-706c41da71ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:04.451513 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7186d-4562-4346-b61e-706c41da71ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:04.451783 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7186d-4562-4346-b61e-706c41da71ab admin admin] PATH_INFO: `/v3/projects/83d0643cb8054c07b3ad2ed9416312f9/users/e91617a49c044e858d23f0478f250f02/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:04.469020 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7186d-4562-4346-b61e-706c41da71ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d0643cb8054c07b3ad2ed9416312f9, user_id=e91617a49c044e858d23f0478f250f02, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:04.471879 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7186d-4562-4346-b61e-706c41da71ab admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:04.487052 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1296/2610] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:04 2022] PUT /identity/v3/projects/83d0643cb8054c07b3ad2ed9416312f9/users/e91617a49c044e858d23f0478f250f02/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:04.491151 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb69f9-16ec-4808-81d2-c3fd3a8eb6ee admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:04.502105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb69f9-16ec-4808-81d2-c3fd3a8eb6ee admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:04.559519 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22b6a1-0acd-44bc-a3ad-b4ce14abf459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:04.560161 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22b6a1-0acd-44bc-a3ad-b4ce14abf459 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:04.560439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22b6a1-0acd-44bc-a3ad-b4ce14abf459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:04.560704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22b6a1-0acd-44bc-a3ad-b4ce14abf459 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:04.561392 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22b6a1-0acd-44bc-a3ad-b4ce14abf459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:04.562960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22b6a1-0acd-44bc-a3ad-b4ce14abf459 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:04.572802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1315/2611] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:04.576976 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7186d-4562-4346-b61e-706c41da71ab admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:04.582376 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:04.589316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7186d-4562-4346-b61e-706c41da71ab admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:04.594489 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda6a86-ce51-4ed6-bfbe-64b28e835420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:04.595134 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda6a86-ce51-4ed6-bfbe-64b28e835420 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:04.595408 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda6a86-ce51-4ed6-bfbe-64b28e835420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:04.595676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda6a86-ce51-4ed6-bfbe-64b28e835420 admin admin] PATH_INFO: `/v3/projects/83d0643cb8054c07b3ad2ed9416312f9/users/e91617a49c044e858d23f0478f250f02/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:04.597643 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda6a86-ce51-4ed6-bfbe-64b28e835420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83d0643cb8054c07b3ad2ed9416312f9, user_id=e91617a49c044e858d23f0478f250f02, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:04.600332 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda6a86-ce51-4ed6-bfbe-64b28e835420 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:04.610997 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1297/2612] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:04 2022] PUT /identity/v3/projects/83d0643cb8054c07b3ad2ed9416312f9/users/e91617a49c044e858d23f0478f250f02/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:04.622971 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9e122-7d09-46a1-9c46-10021ab2cde4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:04.623259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9e122-7d09-46a1-9c46-10021ab2cde4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:04.623538 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9e122-7d09-46a1-9c46-10021ab2cde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:04.651789 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9ff9e122-7d09-46a1-9c46-10021ab2cde4 None None] MFA Rules not processed for user `e91617a49c044e858d23f0478f250f02`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:04.653127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9ff9e122-7d09-46a1-9c46-10021ab2cde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:04.725181 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1316/2613] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:04 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:04.736243 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda6a86-ce51-4ed6-bfbe-64b28e835420 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:04.738037 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ddda6a86-ce51-4ed6-bfbe-64b28e835420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:04.795666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda6a86-ce51-4ed6-bfbe-64b28e835420 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:04.799379 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec686237-b724-427e-bfe1-c6051af5e5bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:04.799978 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec686237-b724-427e-bfe1-c6051af5e5bc service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:04.800286 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec686237-b724-427e-bfe1-c6051af5e5bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:04.800560 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec686237-b724-427e-bfe1-c6051af5e5bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:04.810153 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec686237-b724-427e-bfe1-c6051af5e5bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:04.811642 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec686237-b724-427e-bfe1-c6051af5e5bc service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:04.821611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1298/2614] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:04 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:04.956703 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9e122-7d09-46a1-9c46-10021ab2cde4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:05.007839 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:05.020974 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9e122-7d09-46a1-9c46-10021ab2cde4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:05.025919 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825ac40-66a2-42e4-8150-cbd4bf04398b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:05.026546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825ac40-66a2-42e4-8150-cbd4bf04398b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:05.026823 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825ac40-66a2-42e4-8150-cbd4bf04398b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:05.027094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825ac40-66a2-42e4-8150-cbd4bf04398b admin admin] PATH_INFO: `/v3/users/b41502578d184157b02a8db3e85c29f8` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:05.028247 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825ac40-66a2-42e4-8150-cbd4bf04398b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b41502578d184157b02a8db3e85c29f8)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:05.030169 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825ac40-66a2-42e4-8150-cbd4bf04398b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:05.076290 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0825ac40-66a2-42e4-8150-cbd4bf04398b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b41502578d184157b02a8db3e85c29f8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:05.083173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0825ac40-66a2-42e4-8150-cbd4bf04398b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b41502578d184157b02a8db3e85c29f8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:05.094809 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0825ac40-66a2-42e4-8150-cbd4bf04398b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b41502578d184157b02a8db3e85c29f8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:05.095439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0825ac40-66a2-42e4-8150-cbd4bf04398b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b41502578d184157b02a8db3e85c29f8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:05.096069 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0825ac40-66a2-42e4-8150-cbd4bf04398b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b41502578d184157b02a8db3e85c29f8'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:05.108423 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1317/2615] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:02:04 2022] DELETE /identity/v3/users/b41502578d184157b02a8db3e85c29f8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:05.113053 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923050fb-a115-4c7a-8c71-52b6a4de075e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:05.113358 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923050fb-a115-4c7a-8c71-52b6a4de075e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:05.113634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923050fb-a115-4c7a-8c71-52b6a4de075e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:05.133177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-923050fb-a115-4c7a-8c71-52b6a4de075e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:05.134777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-923050fb-a115-4c7a-8c71-52b6a4de075e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:05.193840 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1299/2616] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:05.203880 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825ac40-66a2-42e4-8150-cbd4bf04398b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:05.205531 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0825ac40-66a2-42e4-8150-cbd4bf04398b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:05.264264 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825ac40-66a2-42e4-8150-cbd4bf04398b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:05.267919 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb281fa7-b1f9-4d29-aa60-217e76b1b5f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:05.268550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb281fa7-b1f9-4d29-aa60-217e76b1b5f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:05.268828 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb281fa7-b1f9-4d29-aa60-217e76b1b5f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:05.269101 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb281fa7-b1f9-4d29-aa60-217e76b1b5f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:05.278313 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb281fa7-b1f9-4d29-aa60-217e76b1b5f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:05.279738 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb281fa7-b1f9-4d29-aa60-217e76b1b5f5 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:05.291056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1318/2617] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:05.565084 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923050fb-a115-4c7a-8c71-52b6a4de075e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:05.566725 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-923050fb-a115-4c7a-8c71-52b6a4de075e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:05.595189 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923050fb-a115-4c7a-8c71-52b6a4de075e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:05.600859 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47af87-efef-45b8-ba1b-18ad816a52a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:05.601601 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47af87-efef-45b8-ba1b-18ad816a52a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:05.601878 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47af87-efef-45b8-ba1b-18ad816a52a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:05.602893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47af87-efef-45b8-ba1b-18ad816a52a2 admin admin] PATH_INFO: `/v3/projects/8d7c23c0bf704488be6766f0f6d33094` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:05.604083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47af87-efef-45b8-ba1b-18ad816a52a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d7c23c0bf704488be6766f0f6d33094)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:05.605986 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47af87-efef-45b8-ba1b-18ad816a52a2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:05.658724 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9e47af87-efef-45b8-ba1b-18ad816a52a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d7c23c0bf704488be6766f0f6d33094', 'request_id': 'req-9e47af87-efef-45b8-ba1b-18ad816a52a2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:05.667791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9e47af87-efef-45b8-ba1b-18ad816a52a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d7c23c0bf704488be6766f0f6d33094', 'request_id': 'req-9e47af87-efef-45b8-ba1b-18ad816a52a2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:05.673702 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9e47af87-efef-45b8-ba1b-18ad816a52a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d7c23c0bf704488be6766f0f6d33094', 'request_id': 'req-9e47af87-efef-45b8-ba1b-18ad816a52a2'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:05.686004 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9e47af87-efef-45b8-ba1b-18ad816a52a2 admin admin] The token cache is being invalidate because project 8d7c23c0bf704488be6766f0f6d33094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:02:05.686295 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9e47af87-efef-45b8-ba1b-18ad816a52a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:05.686959 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-9e47af87-efef-45b8-ba1b-18ad816a52a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:05.688665 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1300/2618] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:02:05 2022] DELETE /identity/v3/projects/8d7c23c0bf704488be6766f0f6d33094 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:05.692945 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb281fa7-b1f9-4d29-aa60-217e76b1b5f5 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:05.703709 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb281fa7-b1f9-4d29-aa60-217e76b1b5f5 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:05.762801 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d650672-91c7-42e1-b7ae-ca3a97b5743f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:05.763435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d650672-91c7-42e1-b7ae-ca3a97b5743f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:05.763783 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d650672-91c7-42e1-b7ae-ca3a97b5743f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:05.764142 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d650672-91c7-42e1-b7ae-ca3a97b5743f admin admin] PATH_INFO: `/v3/users/e91617a49c044e858d23f0478f250f02` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:05.765407 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d650672-91c7-42e1-b7ae-ca3a97b5743f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e91617a49c044e858d23f0478f250f02)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:05.767383 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d650672-91c7-42e1-b7ae-ca3a97b5743f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:05.783034 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:05.814014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8d650672-91c7-42e1-b7ae-ca3a97b5743f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e91617a49c044e858d23f0478f250f02'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:05.821800 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8d650672-91c7-42e1-b7ae-ca3a97b5743f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e91617a49c044e858d23f0478f250f02'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:05.833661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8d650672-91c7-42e1-b7ae-ca3a97b5743f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e91617a49c044e858d23f0478f250f02'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:05.834300 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8d650672-91c7-42e1-b7ae-ca3a97b5743f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e91617a49c044e858d23f0478f250f02'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:05.834891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8d650672-91c7-42e1-b7ae-ca3a97b5743f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e91617a49c044e858d23f0478f250f02'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:05.846957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1319/2619] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:02:05 2022] DELETE /identity/v3/users/e91617a49c044e858d23f0478f250f02 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:06.124199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47af87-efef-45b8-ba1b-18ad816a52a2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:06.125648 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-9e47af87-efef-45b8-ba1b-18ad816a52a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:06.140025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47af87-efef-45b8-ba1b-18ad816a52a2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:06.152834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:06.200890 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df592b-a3c4-425e-a5e5-227e39342b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:06.201435 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df592b-a3c4-425e-a5e5-227e39342b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:06.201713 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df592b-a3c4-425e-a5e5-227e39342b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:06.201985 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df592b-a3c4-425e-a5e5-227e39342b9f admin admin] PATH_INFO: `/v3/projects/83d0643cb8054c07b3ad2ed9416312f9` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:06.203082 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df592b-a3c4-425e-a5e5-227e39342b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=83d0643cb8054c07b3ad2ed9416312f9)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:06.205163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df592b-a3c4-425e-a5e5-227e39342b9f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:06.251307 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d5df592b-a3c4-425e-a5e5-227e39342b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83d0643cb8054c07b3ad2ed9416312f9', 'request_id': 'req-d5df592b-a3c4-425e-a5e5-227e39342b9f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:06.257964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d5df592b-a3c4-425e-a5e5-227e39342b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83d0643cb8054c07b3ad2ed9416312f9', 'request_id': 'req-d5df592b-a3c4-425e-a5e5-227e39342b9f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:06.263641 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d5df592b-a3c4-425e-a5e5-227e39342b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83d0643cb8054c07b3ad2ed9416312f9', 'request_id': 'req-d5df592b-a3c4-425e-a5e5-227e39342b9f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:06.274985 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d5df592b-a3c4-425e-a5e5-227e39342b9f admin admin] The token cache is being invalidate because project 83d0643cb8054c07b3ad2ed9416312f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:02:06.275275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d5df592b-a3c4-425e-a5e5-227e39342b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:06.275940 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d5df592b-a3c4-425e-a5e5-227e39342b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:06.277443 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1301/2620] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:02:06 2022] DELETE /identity/v3/projects/83d0643cb8054c07b3ad2ed9416312f9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:06.282347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9fe6f-e3d1-4dbf-83c7-e7c324615fba None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:06.282820 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9fe6f-e3d1-4dbf-83c7-e7c324615fba None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:06.282916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9fe6f-e3d1-4dbf-83c7-e7c324615fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:06.303317 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d5b9fe6f-e3d1-4dbf-83c7-e7c324615fba None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:06.304553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d5b9fe6f-e3d1-4dbf-83c7-e7c324615fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:06.362830 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1320/2621] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:06.370587 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcfd5c-522d-4d5d-ad07-21d11adc1c72 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:06.370871 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcfd5c-522d-4d5d-ad07-21d11adc1c72 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:06.371146 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dcfd5c-522d-4d5d-ad07-21d11adc1c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:06.390868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-96dcfd5c-522d-4d5d-ad07-21d11adc1c72 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:06.392101 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-96dcfd5c-522d-4d5d-ad07-21d11adc1c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:06.400549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1302/2622] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:06.404680 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9fe6f-e3d1-4dbf-83c7-e7c324615fba None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:06.414330 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9fe6f-e3d1-4dbf-83c7-e7c324615fba None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:06.419475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2a6a6-967d-40be-9dc4-e7406cdd287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:06.420097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2a6a6-967d-40be-9dc4-e7406cdd287a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:06.420369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2a6a6-967d-40be-9dc4-e7406cdd287a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:06.420635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2a6a6-967d-40be-9dc4-e7406cdd287a admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:06.421286 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2a6a6-967d-40be-9dc4-e7406cdd287a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:02:06.421567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2a6a6-967d-40be-9dc4-e7406cdd287a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:06.423144 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2a6a6-967d-40be-9dc4-e7406cdd287a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:06.434344 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1321/2623] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:02:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:02:06.438434 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcfd5c-522d-4d5d-ad07-21d11adc1c72 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:06.448041 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dcfd5c-522d-4d5d-ad07-21d11adc1c72 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:06.452647 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32463f-63ff-4017-9eca-93bd4a03262f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:06.453171 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32463f-63ff-4017-9eca-93bd4a03262f admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:06.453445 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32463f-63ff-4017-9eca-93bd4a03262f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:06.453711 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32463f-63ff-4017-9eca-93bd4a03262f admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:06.454325 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32463f-63ff-4017-9eca-93bd4a03262f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:06.456251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32463f-63ff-4017-9eca-93bd4a03262f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:06.484491 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1303/2624] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:02:06 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:02:06.488651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2a6a6-967d-40be-9dc4-e7406cdd287a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:06.498655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2a6a6-967d-40be-9dc4-e7406cdd287a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:06.554664 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec0ea6-5759-4e0d-bb79-38a488ccd97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:06.555648 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec0ea6-5759-4e0d-bb79-38a488ccd97d admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:06.555792 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec0ea6-5759-4e0d-bb79-38a488ccd97d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:06.555971 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fec0ea6-5759-4e0d-bb79-38a488ccd97d admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:06.556641 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec0ea6-5759-4e0d-bb79-38a488ccd97d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:06.558553 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fec0ea6-5759-4e0d-bb79-38a488ccd97d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:06.579172 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1322/2625] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:02:06 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:02:06.583311 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32463f-63ff-4017-9eca-93bd4a03262f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:06.594280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32463f-63ff-4017-9eca-93bd4a03262f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:06.598979 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a4fb4-fcec-46aa-9947-140ba225e999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:06.599574 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a4fb4-fcec-46aa-9947-140ba225e999 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:06.599857 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a4fb4-fcec-46aa-9947-140ba225e999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:06.600172 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a4fb4-fcec-46aa-9947-140ba225e999 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:06.600813 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a4fb4-fcec-46aa-9947-140ba225e999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:06.602518 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a4fb4-fcec-46aa-9947-140ba225e999 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:06.612418 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1304/2626] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:06.616237 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec0ea6-5759-4e0d-bb79-38a488ccd97d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:06.626165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fec0ea6-5759-4e0d-bb79-38a488ccd97d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:06.630744 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0f68c-a313-474c-9a2c-f4177d3f08f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:06.631336 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0f68c-a313-474c-9a2c-f4177d3f08f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:06.631616 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0f68c-a313-474c-9a2c-f4177d3f08f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:06.631891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0f68c-a313-474c-9a2c-f4177d3f08f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:06.632582 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0f68c-a313-474c-9a2c-f4177d3f08f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:06.634768 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0f68c-a313-474c-9a2c-f4177d3f08f8 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:06.639942 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:06.649729 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1323/2627] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:06.650908 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a4fb4-fcec-46aa-9947-140ba225e999 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:06.661132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a4fb4-fcec-46aa-9947-140ba225e999 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:06.666307 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0feaa-bdd7-4ded-81bc-a6363b2a89ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:06.666966 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0feaa-bdd7-4ded-81bc-a6363b2a89ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:06.667251 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0feaa-bdd7-4ded-81bc-a6363b2a89ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:06.667529 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0feaa-bdd7-4ded-81bc-a6363b2a89ac admin admin] PATH_INFO: `/v3/projects/f79a257561dd4b9899c46d1b0effe510/users/79f5f48ae208485b88d15a69178fb66b/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:06.682012 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0feaa-bdd7-4ded-81bc-a6363b2a89ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79a257561dd4b9899c46d1b0effe510, user_id=79f5f48ae208485b88d15a69178fb66b, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:06.684731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0feaa-bdd7-4ded-81bc-a6363b2a89ac admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:06.697586 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1305/2628] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:06 2022] PUT /identity/v3/projects/f79a257561dd4b9899c46d1b0effe510/users/79f5f48ae208485b88d15a69178fb66b/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:06.707799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc32d06-f372-470e-b7eb-aa06886708aa None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:06.708105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc32d06-f372-470e-b7eb-aa06886708aa None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:06.708434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc32d06-f372-470e-b7eb-aa06886708aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:06.736980 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5cc32d06-f372-470e-b7eb-aa06886708aa None None] MFA Rules not processed for user `79f5f48ae208485b88d15a69178fb66b`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:06.738202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5cc32d06-f372-470e-b7eb-aa06886708aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:06.806117 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1324/2629] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:06.810208 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0feaa-bdd7-4ded-81bc-a6363b2a89ac admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:06.860702 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:06.884014 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0feaa-bdd7-4ded-81bc-a6363b2a89ac admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:06.888744 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d117d-5661-493e-b61a-a6e40a9d2547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:06.889380 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d117d-5661-493e-b61a-a6e40a9d2547 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:06.889664 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d117d-5661-493e-b61a-a6e40a9d2547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:06.889969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d117d-5661-493e-b61a-a6e40a9d2547 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:06.890601 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d117d-5661-493e-b61a-a6e40a9d2547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:06.892560 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d117d-5661-493e-b61a-a6e40a9d2547 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:06.921715 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1306/2630] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:02:06 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:02:06.925822 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc32d06-f372-470e-b7eb-aa06886708aa None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:06.937386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc32d06-f372-470e-b7eb-aa06886708aa None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:07.000401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9781b9-47cb-42b0-816d-b6f3c263685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:07.000900 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9781b9-47cb-42b0-816d-b6f3c263685d admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:07.001275 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9781b9-47cb-42b0-816d-b6f3c263685d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:07.001464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9781b9-47cb-42b0-816d-b6f3c263685d admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:07.002071 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9781b9-47cb-42b0-816d-b6f3c263685d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:07.003982 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9781b9-47cb-42b0-816d-b6f3c263685d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:07.027040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1325/2631] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:02:06 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:02:07.031176 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d117d-5661-493e-b61a-a6e40a9d2547 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:07.041568 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d117d-5661-493e-b61a-a6e40a9d2547 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:07.046284 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90255537-0c70-4f39-99c6-891fdb1cfe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:07.046877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90255537-0c70-4f39-99c6-891fdb1cfe8a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:07.047152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90255537-0c70-4f39-99c6-891fdb1cfe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:07.047419 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90255537-0c70-4f39-99c6-891fdb1cfe8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:07.048074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90255537-0c70-4f39-99c6-891fdb1cfe8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:07.049666 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90255537-0c70-4f39-99c6-891fdb1cfe8a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:07.061602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1307/2632] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:07.065716 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9781b9-47cb-42b0-816d-b6f3c263685d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:07.076202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9781b9-47cb-42b0-816d-b6f3c263685d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:07.080777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3edf0-b11c-424d-b4aa-8d65c9bc8fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:07.081417 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3edf0-b11c-424d-b4aa-8d65c9bc8fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:07.081696 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3edf0-b11c-424d-b4aa-8d65c9bc8fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:07.081969 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3edf0-b11c-424d-b4aa-8d65c9bc8fe5 admin admin] PATH_INFO: `/v3/projects/185f3b1cdeaf462983feb397dd01f841/users/8351e324398e45cfb1ee91d4cb85437a/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:07.096517 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3edf0-b11c-424d-b4aa-8d65c9bc8fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=185f3b1cdeaf462983feb397dd01f841, user_id=8351e324398e45cfb1ee91d4cb85437a, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:07.099148 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3edf0-b11c-424d-b4aa-8d65c9bc8fe5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:07.111948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1326/2633] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:07 2022] PUT /identity/v3/projects/185f3b1cdeaf462983feb397dd01f841/users/8351e324398e45cfb1ee91d4cb85437a/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:07.115842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90255537-0c70-4f39-99c6-891fdb1cfe8a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:07.126760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90255537-0c70-4f39-99c6-891fdb1cfe8a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:07.311535 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc57e5-1d3f-4ac8-8d52-da1f51a184b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:07.312342 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc57e5-1d3f-4ac8-8d52-da1f51a184b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:07.312626 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc57e5-1d3f-4ac8-8d52-da1f51a184b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:07.312899 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc57e5-1d3f-4ac8-8d52-da1f51a184b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:07.313563 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc57e5-1d3f-4ac8-8d52-da1f51a184b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:07.315182 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc57e5-1d3f-4ac8-8d52-da1f51a184b4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:07.325783 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1308/2634] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:07.329910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3edf0-b11c-424d-b4aa-8d65c9bc8fe5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:07.340129 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3edf0-b11c-424d-b4aa-8d65c9bc8fe5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:07.344569 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5e2fd-095e-4794-aced-9f1ff06d24a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:07.345207 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5e2fd-095e-4794-aced-9f1ff06d24a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:07.345484 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5e2fd-095e-4794-aced-9f1ff06d24a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:07.345757 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5e2fd-095e-4794-aced-9f1ff06d24a7 admin admin] PATH_INFO: `/v3/projects/185f3b1cdeaf462983feb397dd01f841/users/8351e324398e45cfb1ee91d4cb85437a/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:07.347624 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5e2fd-095e-4794-aced-9f1ff06d24a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=185f3b1cdeaf462983feb397dd01f841, user_id=8351e324398e45cfb1ee91d4cb85437a, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:07.350313 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5e2fd-095e-4794-aced-9f1ff06d24a7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:07.361066 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1327/2635] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:07 2022] PUT /identity/v3/projects/185f3b1cdeaf462983feb397dd01f841/users/8351e324398e45cfb1ee91d4cb85437a/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:07.373224 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34db1b5-8e85-4142-a648-8dc3e41a0593 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:07.373514 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34db1b5-8e85-4142-a648-8dc3e41a0593 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:07.373790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34db1b5-8e85-4142-a648-8dc3e41a0593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:07.401045 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e34db1b5-8e85-4142-a648-8dc3e41a0593 None None] MFA Rules not processed for user `8351e324398e45cfb1ee91d4cb85437a`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:07.402263 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e34db1b5-8e85-4142-a648-8dc3e41a0593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:07.470231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1309/2636] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:07.482222 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5e2fd-095e-4794-aced-9f1ff06d24a7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:07.483914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-50f5e2fd-095e-4794-aced-9f1ff06d24a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:07.529026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:07.542211 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5e2fd-095e-4794-aced-9f1ff06d24a7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:07.545816 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeaf392-63fa-4a94-84d1-b0570109edc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:07.546405 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaf392-63fa-4a94-84d1-b0570109edc0 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:07.546678 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaf392-63fa-4a94-84d1-b0570109edc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:07.546947 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaf392-63fa-4a94-84d1-b0570109edc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:07.556353 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeaf392-63fa-4a94-84d1-b0570109edc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:07.557769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeaf392-63fa-4a94-84d1-b0570109edc0 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:07.567012 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1328/2637] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:07.642491 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34db1b5-8e85-4142-a648-8dc3e41a0593 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:07.652118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34db1b5-8e85-4142-a648-8dc3e41a0593 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:07.655710 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768a941-78a6-4548-af1d-2c2db614c008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:07.656337 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768a941-78a6-4548-af1d-2c2db614c008 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:07.656612 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768a941-78a6-4548-af1d-2c2db614c008 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:07.656883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768a941-78a6-4548-af1d-2c2db614c008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:07.690701 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:07.714613 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768a941-78a6-4548-af1d-2c2db614c008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:07.716080 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768a941-78a6-4548-af1d-2c2db614c008 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:07.724859 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1310/2638] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:09.042413 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeaf392-63fa-4a94-84d1-b0570109edc0 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:09.044000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bdeaf392-63fa-4a94-84d1-b0570109edc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:09.114359 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeaf392-63fa-4a94-84d1-b0570109edc0 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:09.119732 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0eb34-2b11-47d9-88ac-ed4671cb4f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:09.120466 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0eb34-2b11-47d9-88ac-ed4671cb4f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:09.120810 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0eb34-2b11-47d9-88ac-ed4671cb4f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:09.121161 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0eb34-2b11-47d9-88ac-ed4671cb4f53 admin admin] PATH_INFO: `/v3/users/aa6a199d453e465f8da37502610ca706` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:09.122624 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0eb34-2b11-47d9-88ac-ed4671cb4f53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa6a199d453e465f8da37502610ca706)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:09.124226 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0eb34-2b11-47d9-88ac-ed4671cb4f53 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:09.187003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dda0eb34-2b11-47d9-88ac-ed4671cb4f53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa6a199d453e465f8da37502610ca706'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:09.196157 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dda0eb34-2b11-47d9-88ac-ed4671cb4f53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa6a199d453e465f8da37502610ca706'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:09.212086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dda0eb34-2b11-47d9-88ac-ed4671cb4f53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa6a199d453e465f8da37502610ca706'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:09.212893 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dda0eb34-2b11-47d9-88ac-ed4671cb4f53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa6a199d453e465f8da37502610ca706'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:09.213558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-dda0eb34-2b11-47d9-88ac-ed4671cb4f53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa6a199d453e465f8da37502610ca706'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:09.229329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1329/2639] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:02:09 2022] DELETE /identity/v3/users/aa6a199d453e465f8da37502610ca706 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:09.233787 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc536f0-5fac-4052-a75f-172c980e483b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:09.234254 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc536f0-5fac-4052-a75f-172c980e483b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:09.234338 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc536f0-5fac-4052-a75f-172c980e483b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:09.254670 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-7cc536f0-5fac-4052-a75f-172c980e483b None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:09.255954 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7cc536f0-5fac-4052-a75f-172c980e483b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:09.322589 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1311/2640] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:09.332336 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0eb34-2b11-47d9-88ac-ed4671cb4f53 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:09.333769 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dda0eb34-2b11-47d9-88ac-ed4671cb4f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:09.391739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0eb34-2b11-47d9-88ac-ed4671cb4f53 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:09.395278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a686439-45d5-4877-b87b-7dad9a919dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:09.395882 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a686439-45d5-4877-b87b-7dad9a919dce service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:09.396185 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a686439-45d5-4877-b87b-7dad9a919dce service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:09.396462 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a686439-45d5-4877-b87b-7dad9a919dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:09.406241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a686439-45d5-4877-b87b-7dad9a919dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:09.407665 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a686439-45d5-4877-b87b-7dad9a919dce service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:09.418931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1330/2641] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:09.685238 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc536f0-5fac-4052-a75f-172c980e483b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:09.686750 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-7cc536f0-5fac-4052-a75f-172c980e483b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:09.699369 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc536f0-5fac-4052-a75f-172c980e483b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:09.703888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248240bf-9e5c-4d99-95c7-c03d0bec1c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:09.704627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248240bf-9e5c-4d99-95c7-c03d0bec1c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:09.704901 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248240bf-9e5c-4d99-95c7-c03d0bec1c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:09.705323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248240bf-9e5c-4d99-95c7-c03d0bec1c16 admin admin] PATH_INFO: `/v3/projects/f50d9fb2b1984d3c9ec7987136052d7c` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:09.706567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248240bf-9e5c-4d99-95c7-c03d0bec1c16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f50d9fb2b1984d3c9ec7987136052d7c)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:09.708526 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248240bf-9e5c-4d99-95c7-c03d0bec1c16 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:09.754218 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-248240bf-9e5c-4d99-95c7-c03d0bec1c16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f50d9fb2b1984d3c9ec7987136052d7c', 'request_id': 'req-248240bf-9e5c-4d99-95c7-c03d0bec1c16'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:09.762214 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-248240bf-9e5c-4d99-95c7-c03d0bec1c16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f50d9fb2b1984d3c9ec7987136052d7c', 'request_id': 'req-248240bf-9e5c-4d99-95c7-c03d0bec1c16'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:09.767854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-248240bf-9e5c-4d99-95c7-c03d0bec1c16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f50d9fb2b1984d3c9ec7987136052d7c', 'request_id': 'req-248240bf-9e5c-4d99-95c7-c03d0bec1c16'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:09.779699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-248240bf-9e5c-4d99-95c7-c03d0bec1c16 admin admin] The token cache is being invalidate because project f50d9fb2b1984d3c9ec7987136052d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:02:09.779981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-248240bf-9e5c-4d99-95c7-c03d0bec1c16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:09.780625 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-248240bf-9e5c-4d99-95c7-c03d0bec1c16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:09.782060 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1312/2642] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:02:09 2022] DELETE /identity/v3/projects/f50d9fb2b1984d3c9ec7987136052d7c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:09.787661 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867dc43-c695-4fd5-992c-4c21f4e03f4e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:09.787956 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867dc43-c695-4fd5-992c-4c21f4e03f4e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:09.788271 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867dc43-c695-4fd5-992c-4c21f4e03f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:09.801660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:09.807887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2867dc43-c695-4fd5-992c-4c21f4e03f4e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:09.809614 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2867dc43-c695-4fd5-992c-4c21f4e03f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:09.867132 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1331/2643] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:02:09.875809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a3411-9f5f-4da4-9d5b-1c630ddc3068 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:09.876158 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a3411-9f5f-4da4-9d5b-1c630ddc3068 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:09.876409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a3411-9f5f-4da4-9d5b-1c630ddc3068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:09.896235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-d90a3411-9f5f-4da4-9d5b-1c630ddc3068 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:09.897571 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d90a3411-9f5f-4da4-9d5b-1c630ddc3068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:09.906246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1313/2644] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:09.910433 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867dc43-c695-4fd5-992c-4c21f4e03f4e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:09.920448 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867dc43-c695-4fd5-992c-4c21f4e03f4e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:09.925027 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f18143-58f2-46c6-8088-fcefcf890f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:09.925622 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f18143-58f2-46c6-8088-fcefcf890f7e admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:09.925896 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f18143-58f2-46c6-8088-fcefcf890f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:09.926163 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f18143-58f2-46c6-8088-fcefcf890f7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:09.926803 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f18143-58f2-46c6-8088-fcefcf890f7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:02:09.927100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f18143-58f2-46c6-8088-fcefcf890f7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:09.928845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f18143-58f2-46c6-8088-fcefcf890f7e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:09.940667 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1332/2645] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:02:09.944888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a3411-9f5f-4da4-9d5b-1c630ddc3068 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:09.955050 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a3411-9f5f-4da4-9d5b-1c630ddc3068 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:09.959736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa58952-2f36-4fba-9c44-a25aab6a3414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:09.960366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa58952-2f36-4fba-9c44-a25aab6a3414 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:09.960650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa58952-2f36-4fba-9c44-a25aab6a3414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:09.960926 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa58952-2f36-4fba-9c44-a25aab6a3414 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:09.961776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa58952-2f36-4fba-9c44-a25aab6a3414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:09.963700 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa58952-2f36-4fba-9c44-a25aab6a3414 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:09.990184 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1314/2646] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:02:09 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:02:09.994858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f18143-58f2-46c6-8088-fcefcf890f7e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:10.004910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f18143-58f2-46c6-8088-fcefcf890f7e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:10.060872 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacbc9a-39e8-4d68-92fd-d4cc7882b11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:10.061467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacbc9a-39e8-4d68-92fd-d4cc7882b11d admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:10.061746 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacbc9a-39e8-4d68-92fd-d4cc7882b11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:10.062018 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacbc9a-39e8-4d68-92fd-d4cc7882b11d admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:10.062654 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacbc9a-39e8-4d68-92fd-d4cc7882b11d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:10.064598 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacbc9a-39e8-4d68-92fd-d4cc7882b11d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:10.085615 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1333/2647] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:02:09 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:02:10.091513 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa58952-2f36-4fba-9c44-a25aab6a3414 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:10.101750 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa58952-2f36-4fba-9c44-a25aab6a3414 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:10.106317 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74fee0-4769-41b5-a67d-51d464fcbc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:10.106904 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74fee0-4769-41b5-a67d-51d464fcbc72 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:10.107181 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74fee0-4769-41b5-a67d-51d464fcbc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:10.107447 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74fee0-4769-41b5-a67d-51d464fcbc72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:10.108117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74fee0-4769-41b5-a67d-51d464fcbc72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:10.109699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74fee0-4769-41b5-a67d-51d464fcbc72 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:10.120168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1315/2648] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:10.124040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacbc9a-39e8-4d68-92fd-d4cc7882b11d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:10.134556 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacbc9a-39e8-4d68-92fd-d4cc7882b11d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:10.139155 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74037b5-0020-44ea-a667-743b51548615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:10.139731 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74037b5-0020-44ea-a667-743b51548615 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:10.140037 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74037b5-0020-44ea-a667-743b51548615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:10.140313 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74037b5-0020-44ea-a667-743b51548615 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:10.140980 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74037b5-0020-44ea-a667-743b51548615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:10.142546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74037b5-0020-44ea-a667-743b51548615 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:10.153182 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1334/2649] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:10.156953 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74fee0-4769-41b5-a67d-51d464fcbc72 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:10.166896 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74fee0-4769-41b5-a67d-51d464fcbc72 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:10.171405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c5e50-dfa2-4490-be11-8eca6d2c22fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:10.172230 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c5e50-dfa2-4490-be11-8eca6d2c22fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:10.172627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c5e50-dfa2-4490-be11-8eca6d2c22fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:10.173025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c5e50-dfa2-4490-be11-8eca6d2c22fb admin admin] PATH_INFO: `/v3/projects/635e766a8c754ae09a1f248d901c7582/users/1e65692e4d7b40b7b75c15d7b681cf44/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:10.188522 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c5e50-dfa2-4490-be11-8eca6d2c22fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=635e766a8c754ae09a1f248d901c7582, user_id=1e65692e4d7b40b7b75c15d7b681cf44, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:10.191094 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c5e50-dfa2-4490-be11-8eca6d2c22fb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:10.194024 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:10.207370 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1316/2650] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:10 2022] PUT /identity/v3/projects/635e766a8c754ae09a1f248d901c7582/users/1e65692e4d7b40b7b75c15d7b681cf44/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:10.212704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c939d03-1cb3-4366-9004-47bd2f1085be None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:10.212991 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c939d03-1cb3-4366-9004-47bd2f1085be None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:10.213268 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c939d03-1cb3-4366-9004-47bd2f1085be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:10.232548 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-5c939d03-1cb3-4366-9004-47bd2f1085be None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:10.233755 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5c939d03-1cb3-4366-9004-47bd2f1085be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:10.294569 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1335/2651] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:10.309401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c5e50-dfa2-4490-be11-8eca6d2c22fb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:10.311706 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a75c5e50-dfa2-4490-be11-8eca6d2c22fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:10.372302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c5e50-dfa2-4490-be11-8eca6d2c22fb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:10.375976 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625eee27-4912-464b-9263-69fc8b219230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:10.376610 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625eee27-4912-464b-9263-69fc8b219230 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:10.376888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625eee27-4912-464b-9263-69fc8b219230 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:10.377167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625eee27-4912-464b-9263-69fc8b219230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:10.386805 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625eee27-4912-464b-9263-69fc8b219230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:10.388269 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625eee27-4912-464b-9263-69fc8b219230 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:10.397892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1317/2652] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:14.796655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c939d03-1cb3-4366-9004-47bd2f1085be None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:14.799669 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-5c939d03-1cb3-4366-9004-47bd2f1085be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:14.813006 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c939d03-1cb3-4366-9004-47bd2f1085be None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:14.823625 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d637c-68f5-4783-8d64-12db4abffcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:14.824442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d637c-68f5-4783-8d64-12db4abffcf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:14.824717 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d637c-68f5-4783-8d64-12db4abffcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:14.824986 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d637c-68f5-4783-8d64-12db4abffcf0 admin admin] PATH_INFO: `/v3/users/79f5f48ae208485b88d15a69178fb66b` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:14.826603 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d637c-68f5-4783-8d64-12db4abffcf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79f5f48ae208485b88d15a69178fb66b)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:14.829389 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915df0f-6e73-427b-ba9d-cdb783dca47e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:14.829868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915df0f-6e73-427b-ba9d-cdb783dca47e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:14.829964 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f915df0f-6e73-427b-ba9d-cdb783dca47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:14.835190 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d637c-68f5-4783-8d64-12db4abffcf0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:14.850335 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:14.864032 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-f915df0f-6e73-427b-ba9d-cdb783dca47e None None] MFA Rules not processed for user `1e65692e4d7b40b7b75c15d7b681cf44`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:14.865448 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-f915df0f-6e73-427b-ba9d-cdb783dca47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:14.902820 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-324d637c-68f5-4783-8d64-12db4abffcf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79f5f48ae208485b88d15a69178fb66b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:14.911306 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-324d637c-68f5-4783-8d64-12db4abffcf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79f5f48ae208485b88d15a69178fb66b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:14.925755 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-324d637c-68f5-4783-8d64-12db4abffcf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79f5f48ae208485b88d15a69178fb66b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:14.926544 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-324d637c-68f5-4783-8d64-12db4abffcf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79f5f48ae208485b88d15a69178fb66b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:14.927163 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-324d637c-68f5-4783-8d64-12db4abffcf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79f5f48ae208485b88d15a69178fb66b'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:14.940401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1336/2653] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:02:14 2022] DELETE /identity/v3/users/79f5f48ae208485b88d15a69178fb66b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:14.940746 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1318/2654] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:02:14.944643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f74126-90e4-47c1-a2f9-08001fd0fdc2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:14.944923 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f74126-90e4-47c1-a2f9-08001fd0fdc2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:14.945193 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f74126-90e4-47c1-a2f9-08001fd0fdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:14.947735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915df0f-6e73-427b-ba9d-cdb783dca47e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:14.959187 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f915df0f-6e73-427b-ba9d-cdb783dca47e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:14.967966 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-d5f74126-90e4-47c1-a2f9-08001fd0fdc2 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:14.969202 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d5f74126-90e4-47c1-a2f9-08001fd0fdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:15.024924 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09481d-37ff-4747-819f-ebb8d1bd58a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:15.025652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09481d-37ff-4747-819f-ebb8d1bd58a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:15.025937 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09481d-37ff-4747-819f-ebb8d1bd58a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:15.026213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f09481d-37ff-4747-819f-ebb8d1bd58a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:15.026854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09481d-37ff-4747-819f-ebb8d1bd58a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:15.028893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f09481d-37ff-4747-819f-ebb8d1bd58a5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:15.050899 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1337/2655] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:02:15.061313 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f74126-90e4-47c1-a2f9-08001fd0fdc2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:15.062716 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d5f74126-90e4-47c1-a2f9-08001fd0fdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:15.066077 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1319/2656] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:02:14 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:02:15.067096 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09481d-37ff-4747-819f-ebb8d1bd58a5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:15.068810 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4f09481d-37ff-4747-819f-ebb8d1bd58a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:15.083735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:15.127016 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f74126-90e4-47c1-a2f9-08001fd0fdc2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:15.148096 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f09481d-37ff-4747-819f-ebb8d1bd58a5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:15.153822 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68daf9d-76e3-4163-b2e6-0d0412a3c431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:15.154369 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68daf9d-76e3-4163-b2e6-0d0412a3c431 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:15.154649 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68daf9d-76e3-4163-b2e6-0d0412a3c431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:15.154920 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68daf9d-76e3-4163-b2e6-0d0412a3c431 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:15.155549 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68daf9d-76e3-4163-b2e6-0d0412a3c431 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:15.157625 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68daf9d-76e3-4163-b2e6-0d0412a3c431 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:15.170397 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:15.181949 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1fb7a-dbf3-4cc9-83ca-ec18737f44ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:15.182148 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1320/2657] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:02:15 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:02:15.182574 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1fb7a-dbf3-4cc9-83ca-ec18737f44ff service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:15.182915 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1fb7a-dbf3-4cc9-83ca-ec18737f44ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:15.183435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1fb7a-dbf3-4cc9-83ca-ec18737f44ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:15.185843 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68daf9d-76e3-4163-b2e6-0d0412a3c431 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:15.193246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1fb7a-dbf3-4cc9-83ca-ec18737f44ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:15.194678 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1fb7a-dbf3-4cc9-83ca-ec18737f44ff service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:15.196560 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68daf9d-76e3-4163-b2e6-0d0412a3c431 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:15.201620 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba959ee-7d3e-4441-8745-af3a4a1aafcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:15.202236 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba959ee-7d3e-4441-8745-af3a4a1aafcd admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:15.202510 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba959ee-7d3e-4441-8745-af3a4a1aafcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:15.202781 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba959ee-7d3e-4441-8745-af3a4a1aafcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:15.203413 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba959ee-7d3e-4441-8745-af3a4a1aafcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:15.205209 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba959ee-7d3e-4441-8745-af3a4a1aafcd admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:15.206232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1338/2658] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:02:15.216551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1321/2659] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:02:15.220896 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1fb7a-dbf3-4cc9-83ca-ec18737f44ff service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:15.230844 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1fb7a-dbf3-4cc9-83ca-ec18737f44ff service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:15.235613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6a5d8-0f4b-4a47-87fd-b62165451307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:15.236394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6a5d8-0f4b-4a47-87fd-b62165451307 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:15.236586 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6a5d8-0f4b-4a47-87fd-b62165451307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:15.236848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6a5d8-0f4b-4a47-87fd-b62165451307 admin admin] PATH_INFO: `/v3/projects/7228fa77a84f4a1a9a79b1627eff49ce/users/2f62a3f5525f4cff9bddd8f28554dd3f/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:15.254185 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6a5d8-0f4b-4a47-87fd-b62165451307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7228fa77a84f4a1a9a79b1627eff49ce, user_id=2f62a3f5525f4cff9bddd8f28554dd3f, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:15.257067 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6a5d8-0f4b-4a47-87fd-b62165451307 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:15.271746 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1339/2660] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:15 2022] PUT /identity/v3/projects/7228fa77a84f4a1a9a79b1627eff49ce/users/2f62a3f5525f4cff9bddd8f28554dd3f/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:15.276676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba959ee-7d3e-4441-8745-af3a4a1aafcd admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:15.287680 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba959ee-7d3e-4441-8745-af3a4a1aafcd admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:15.349444 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c98b5-3628-49c4-895a-a61d38c97420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:15.350406 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c98b5-3628-49c4-895a-a61d38c97420 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:15.350641 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c98b5-3628-49c4-895a-a61d38c97420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:15.351129 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c98b5-3628-49c4-895a-a61d38c97420 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:15.352546 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c98b5-3628-49c4-895a-a61d38c97420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:15.354706 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c98b5-3628-49c4-895a-a61d38c97420 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:15.370555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1322/2661] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:15.375094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6a5d8-0f4b-4a47-87fd-b62165451307 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:15.387822 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6a5d8-0f4b-4a47-87fd-b62165451307 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:15.392990 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382207c9-9167-429d-9cce-974818e4112f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:15.393654 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382207c9-9167-429d-9cce-974818e4112f admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:15.393940 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382207c9-9167-429d-9cce-974818e4112f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:15.394216 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382207c9-9167-429d-9cce-974818e4112f admin admin] PATH_INFO: `/v3/projects/7228fa77a84f4a1a9a79b1627eff49ce/users/2f62a3f5525f4cff9bddd8f28554dd3f/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:15.396775 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382207c9-9167-429d-9cce-974818e4112f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7228fa77a84f4a1a9a79b1627eff49ce, user_id=2f62a3f5525f4cff9bddd8f28554dd3f, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:15.400158 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382207c9-9167-429d-9cce-974818e4112f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:15.412088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1340/2662] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:15 2022] PUT /identity/v3/projects/7228fa77a84f4a1a9a79b1627eff49ce/users/2f62a3f5525f4cff9bddd8f28554dd3f/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:15.547888 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c98b5-3628-49c4-895a-a61d38c97420 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:15.549777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a20c98b5-3628-49c4-895a-a61d38c97420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:15.563466 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c98b5-3628-49c4-895a-a61d38c97420 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:15.642457 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc00cf-f6b2-4ef6-aaa0-3360dc342f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:15.643098 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc00cf-f6b2-4ef6-aaa0-3360dc342f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:15.643375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc00cf-f6b2-4ef6-aaa0-3360dc342f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:15.643732 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc00cf-f6b2-4ef6-aaa0-3360dc342f68 admin admin] PATH_INFO: `/v3/projects/f79a257561dd4b9899c46d1b0effe510` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:15.645067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc00cf-f6b2-4ef6-aaa0-3360dc342f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f79a257561dd4b9899c46d1b0effe510)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:15.647272 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc00cf-f6b2-4ef6-aaa0-3360dc342f68 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:15.685385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:15.701744 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-92dc00cf-f6b2-4ef6-aaa0-3360dc342f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f79a257561dd4b9899c46d1b0effe510', 'request_id': 'req-92dc00cf-f6b2-4ef6-aaa0-3360dc342f68'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:15.709130 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-92dc00cf-f6b2-4ef6-aaa0-3360dc342f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f79a257561dd4b9899c46d1b0effe510', 'request_id': 'req-92dc00cf-f6b2-4ef6-aaa0-3360dc342f68'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:15.717960 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-92dc00cf-f6b2-4ef6-aaa0-3360dc342f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f79a257561dd4b9899c46d1b0effe510', 'request_id': 'req-92dc00cf-f6b2-4ef6-aaa0-3360dc342f68'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:15.732912 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-92dc00cf-f6b2-4ef6-aaa0-3360dc342f68 admin admin] The token cache is being invalidate because project f79a257561dd4b9899c46d1b0effe510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:02:15.733647 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-92dc00cf-f6b2-4ef6-aaa0-3360dc342f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:15.733974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-92dc00cf-f6b2-4ef6-aaa0-3360dc342f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:15.735652 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1323/2663] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:02:15 2022] DELETE /identity/v3/projects/f79a257561dd4b9899c46d1b0effe510 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:15.739670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382207c9-9167-429d-9cce-974818e4112f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:15.741609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-382207c9-9167-429d-9cce-974818e4112f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:15.755158 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382207c9-9167-429d-9cce-974818e4112f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:15.825938 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1b5ee-9532-4210-a1a3-a4434503b8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:15.826632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1b5ee-9532-4210-a1a3-a4434503b8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:15.826879 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1b5ee-9532-4210-a1a3-a4434503b8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:15.827152 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1b5ee-9532-4210-a1a3-a4434503b8a3 admin admin] PATH_INFO: `/v3/users/8351e324398e45cfb1ee91d4cb85437a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:15.829428 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1b5ee-9532-4210-a1a3-a4434503b8a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8351e324398e45cfb1ee91d4cb85437a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:15.831500 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1b5ee-9532-4210-a1a3-a4434503b8a3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:15.900370 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4bc1b5ee-9532-4210-a1a3-a4434503b8a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8351e324398e45cfb1ee91d4cb85437a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:15.910201 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4bc1b5ee-9532-4210-a1a3-a4434503b8a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8351e324398e45cfb1ee91d4cb85437a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:15.926444 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4bc1b5ee-9532-4210-a1a3-a4434503b8a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8351e324398e45cfb1ee91d4cb85437a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:15.927176 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4bc1b5ee-9532-4210-a1a3-a4434503b8a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8351e324398e45cfb1ee91d4cb85437a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:15.927760 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4bc1b5ee-9532-4210-a1a3-a4434503b8a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8351e324398e45cfb1ee91d4cb85437a'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:15.943662 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1341/2664] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:02:15 2022] DELETE /identity/v3/users/8351e324398e45cfb1ee91d4cb85437a => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:16.290522 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc00cf-f6b2-4ef6-aaa0-3360dc342f68 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:16.308303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc00cf-f6b2-4ef6-aaa0-3360dc342f68 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:16.379717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e38994-3e79-411b-bedc-bbe882886ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:16.380443 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e38994-3e79-411b-bedc-bbe882886ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:16.380728 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e38994-3e79-411b-bedc-bbe882886ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:16.381008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e38994-3e79-411b-bedc-bbe882886ad6 admin admin] PATH_INFO: `/v3/projects/185f3b1cdeaf462983feb397dd01f841` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:16.382192 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e38994-3e79-411b-bedc-bbe882886ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=185f3b1cdeaf462983feb397dd01f841)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:16.384197 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e38994-3e79-411b-bedc-bbe882886ad6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:16.442180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-03e38994-3e79-411b-bedc-bbe882886ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '185f3b1cdeaf462983feb397dd01f841', 'request_id': 'req-03e38994-3e79-411b-bedc-bbe882886ad6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:16.452055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-03e38994-3e79-411b-bedc-bbe882886ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '185f3b1cdeaf462983feb397dd01f841', 'request_id': 'req-03e38994-3e79-411b-bedc-bbe882886ad6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:16.459808 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-03e38994-3e79-411b-bedc-bbe882886ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '185f3b1cdeaf462983feb397dd01f841', 'request_id': 'req-03e38994-3e79-411b-bedc-bbe882886ad6'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:16.474719 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-03e38994-3e79-411b-bedc-bbe882886ad6 admin admin] The token cache is being invalidate because project 185f3b1cdeaf462983feb397dd01f841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:02:16.475199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-03e38994-3e79-411b-bedc-bbe882886ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:16.476156 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-03e38994-3e79-411b-bedc-bbe882886ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:16.481747 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1324/2665] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:02:16 2022] DELETE /identity/v3/projects/185f3b1cdeaf462983feb397dd01f841 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:16.483526 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6298e0-04a7-46be-8a34-aa6f0b1c9463 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:16.483810 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6298e0-04a7-46be-8a34-aa6f0b1c9463 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:16.484110 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6298e0-04a7-46be-8a34-aa6f0b1c9463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:16.518900 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-bb6298e0-04a7-46be-8a34-aa6f0b1c9463 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:16.520204 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bb6298e0-04a7-46be-8a34-aa6f0b1c9463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:16.550135 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:16.593315 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1342/2666] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:16.602186 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2e355-5f4a-4308-ba41-833fec6ba487 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:16.602671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2e355-5f4a-4308-ba41-833fec6ba487 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:16.603043 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2e355-5f4a-4308-ba41-833fec6ba487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:16.626596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-1bf2e355-5f4a-4308-ba41-833fec6ba487 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:16.628346 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1bf2e355-5f4a-4308-ba41-833fec6ba487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:16.640918 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1325/2667] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:16.641643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6298e0-04a7-46be-8a34-aa6f0b1c9463 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:16.653103 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6298e0-04a7-46be-8a34-aa6f0b1c9463 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:16.658679 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246ece5-1b5a-4956-a020-c9dbcc66aad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:16.659512 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246ece5-1b5a-4956-a020-c9dbcc66aad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:16.659793 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246ece5-1b5a-4956-a020-c9dbcc66aad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:16.660098 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246ece5-1b5a-4956-a020-c9dbcc66aad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:16.661012 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246ece5-1b5a-4956-a020-c9dbcc66aad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:02:16.661465 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246ece5-1b5a-4956-a020-c9dbcc66aad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:16.663284 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246ece5-1b5a-4956-a020-c9dbcc66aad5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:16.683062 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1343/2668] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:02:16.684396 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf2e355-5f4a-4308-ba41-833fec6ba487 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:16.694553 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf2e355-5f4a-4308-ba41-833fec6ba487 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:16.702010 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b20f65-36f3-4b6f-ad68-28580cd30600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:16.702626 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b20f65-36f3-4b6f-ad68-28580cd30600 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:16.702999 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b20f65-36f3-4b6f-ad68-28580cd30600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:16.703280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b20f65-36f3-4b6f-ad68-28580cd30600 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:16.703923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b20f65-36f3-4b6f-ad68-28580cd30600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:16.706453 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b20f65-36f3-4b6f-ad68-28580cd30600 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:16.744358 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1326/2669] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:02:16 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:02:16.747953 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246ece5-1b5a-4956-a020-c9dbcc66aad5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:16.759910 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246ece5-1b5a-4956-a020-c9dbcc66aad5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:16.828814 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171ec3f-f14f-420d-8517-36154630ca21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:16.829483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171ec3f-f14f-420d-8517-36154630ca21 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:16.829855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171ec3f-f14f-420d-8517-36154630ca21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:16.830635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171ec3f-f14f-420d-8517-36154630ca21 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:16.831295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171ec3f-f14f-420d-8517-36154630ca21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:16.833446 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171ec3f-f14f-420d-8517-36154630ca21 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:16.860936 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1344/2670] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:02:16 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:02:16.864893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b20f65-36f3-4b6f-ad68-28580cd30600 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:16.876437 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b20f65-36f3-4b6f-ad68-28580cd30600 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:16.881326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a8930-39c0-4b18-82d2-1645d31da375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:16.882016 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a8930-39c0-4b18-82d2-1645d31da375 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:16.882369 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a8930-39c0-4b18-82d2-1645d31da375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:16.882715 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a8930-39c0-4b18-82d2-1645d31da375 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:16.883581 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a8930-39c0-4b18-82d2-1645d31da375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:16.885329 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a8930-39c0-4b18-82d2-1645d31da375 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:16.901168 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1327/2671] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:16.905119 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171ec3f-f14f-420d-8517-36154630ca21 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:16.916210 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171ec3f-f14f-420d-8517-36154630ca21 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:16.922030 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d3c2f-c790-4459-bf3a-ebec487a6b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:16.922740 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d3c2f-c790-4459-bf3a-ebec487a6b64 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:16.923117 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d3c2f-c790-4459-bf3a-ebec487a6b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:16.923527 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d3c2f-c790-4459-bf3a-ebec487a6b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:16.924406 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d3c2f-c790-4459-bf3a-ebec487a6b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:16.926143 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d3c2f-c790-4459-bf3a-ebec487a6b64 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:16.941284 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1345/2672] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:16.945345 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a8930-39c0-4b18-82d2-1645d31da375 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:16.956656 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a8930-39c0-4b18-82d2-1645d31da375 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:16.962541 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f672356-48a0-44f4-a47e-a9abc25bfb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:16.963472 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f672356-48a0-44f4-a47e-a9abc25bfb27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:16.963804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f672356-48a0-44f4-a47e-a9abc25bfb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:16.964263 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f672356-48a0-44f4-a47e-a9abc25bfb27 admin admin] PATH_INFO: `/v3/projects/668f70e2c329447ea14f5f6df6fbec8d/users/f4a7e91293f84c16b8840ad663680ead/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:16.970693 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:16.987858 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f672356-48a0-44f4-a47e-a9abc25bfb27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=668f70e2c329447ea14f5f6df6fbec8d, user_id=f4a7e91293f84c16b8840ad663680ead, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:16.991521 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f672356-48a0-44f4-a47e-a9abc25bfb27 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:17.010789 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1328/2673] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:16 2022] PUT /identity/v3/projects/668f70e2c329447ea14f5f6df6fbec8d/users/f4a7e91293f84c16b8840ad663680ead/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:02:17.022944 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed46d8-7367-4118-ad9e-1516cec04c35 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:17.023691 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed46d8-7367-4118-ad9e-1516cec04c35 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:17.023956 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed46d8-7367-4118-ad9e-1516cec04c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:17.059362 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-20ed46d8-7367-4118-ad9e-1516cec04c35 None None] MFA Rules not processed for user `f4a7e91293f84c16b8840ad663680ead`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:17.061036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-20ed46d8-7367-4118-ad9e-1516cec04c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:17.135502 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1346/2674] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:02:17.140595 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f672356-48a0-44f4-a47e-a9abc25bfb27 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:17.221682 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f672356-48a0-44f4-a47e-a9abc25bfb27 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:17.227521 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f732cb-6fbd-4785-a140-b420525578a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:17.228744 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f732cb-6fbd-4785-a140-b420525578a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:17.228744 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f732cb-6fbd-4785-a140-b420525578a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:17.228992 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f732cb-6fbd-4785-a140-b420525578a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:17.229790 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f732cb-6fbd-4785-a140-b420525578a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:17.231952 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f732cb-6fbd-4785-a140-b420525578a3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:17.264219 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1329/2675] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:02:17 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:02:17.268314 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed46d8-7367-4118-ad9e-1516cec04c35 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:17.280957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed46d8-7367-4118-ad9e-1516cec04c35 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:17.313118 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:17.367146 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989d0d7-ca99-40fa-b91d-bacb6f51bc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:17.368517 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989d0d7-ca99-40fa-b91d-bacb6f51bc3f admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:17.368794 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989d0d7-ca99-40fa-b91d-bacb6f51bc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:17.369068 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989d0d7-ca99-40fa-b91d-bacb6f51bc3f admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:17.369740 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989d0d7-ca99-40fa-b91d-bacb6f51bc3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:17.371681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989d0d7-ca99-40fa-b91d-bacb6f51bc3f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:17.399145 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1347/2676] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:02:17 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:02:17.400533 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f732cb-6fbd-4785-a140-b420525578a3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:17.413216 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f732cb-6fbd-4785-a140-b420525578a3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:17.418555 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48a173-ac8d-4e91-90a1-ccb8a02b86de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:17.419172 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48a173-ac8d-4e91-90a1-ccb8a02b86de admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:17.419453 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48a173-ac8d-4e91-90a1-ccb8a02b86de admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:17.419729 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48a173-ac8d-4e91-90a1-ccb8a02b86de admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:17.420492 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48a173-ac8d-4e91-90a1-ccb8a02b86de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:17.422061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48a173-ac8d-4e91-90a1-ccb8a02b86de admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:17.437915 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1330/2677] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:17.439511 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989d0d7-ca99-40fa-b91d-bacb6f51bc3f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:17.450600 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989d0d7-ca99-40fa-b91d-bacb6f51bc3f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:17.456506 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98f09a-a396-4756-831a-6d42aa226e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:17.457354 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98f09a-a396-4756-831a-6d42aa226e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:17.457638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98f09a-a396-4756-831a-6d42aa226e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:17.458207 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98f09a-a396-4756-831a-6d42aa226e92 admin admin] PATH_INFO: `/v3/projects/ae2714932e1742449a7acc81536569d6/users/a6e2d4471d7549a2b2a971ea7a7acfe9/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:17.475810 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98f09a-a396-4756-831a-6d42aa226e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae2714932e1742449a7acc81536569d6, user_id=a6e2d4471d7549a2b2a971ea7a7acfe9, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:17.480043 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f98f09a-a396-4756-831a-6d42aa226e92 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:17.500247 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1348/2678] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:17 2022] PUT /identity/v3/projects/ae2714932e1742449a7acc81536569d6/users/a6e2d4471d7549a2b2a971ea7a7acfe9/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:17.501835 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48a173-ac8d-4e91-90a1-ccb8a02b86de admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:17.514725 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48a173-ac8d-4e91-90a1-ccb8a02b86de admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:17.588280 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7044a170-4acb-4df4-aef4-9df834b1d479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:17.589242 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044a170-4acb-4df4-aef4-9df834b1d479 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:17.589242 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044a170-4acb-4df4-aef4-9df834b1d479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:17.589429 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044a170-4acb-4df4-aef4-9df834b1d479 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:17.591075 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044a170-4acb-4df4-aef4-9df834b1d479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:17.592338 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7044a170-4acb-4df4-aef4-9df834b1d479 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:17.608870 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1331/2679] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:17.611164 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98f09a-a396-4756-831a-6d42aa226e92 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:17.622781 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98f09a-a396-4756-831a-6d42aa226e92 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:17.628012 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934b7b9-626a-4522-8020-0b0df195b27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:17.628706 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934b7b9-626a-4522-8020-0b0df195b27f admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:17.628966 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934b7b9-626a-4522-8020-0b0df195b27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:17.629241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4934b7b9-626a-4522-8020-0b0df195b27f admin admin] PATH_INFO: `/v3/projects/ae2714932e1742449a7acc81536569d6/users/a6e2d4471d7549a2b2a971ea7a7acfe9/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:17.632038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934b7b9-626a-4522-8020-0b0df195b27f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae2714932e1742449a7acc81536569d6, user_id=a6e2d4471d7549a2b2a971ea7a7acfe9, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:17.635160 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4934b7b9-626a-4522-8020-0b0df195b27f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:17.646680 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1349/2680] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:17 2022] PUT /identity/v3/projects/ae2714932e1742449a7acc81536569d6/users/a6e2d4471d7549a2b2a971ea7a7acfe9/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:17.657981 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25670e-92b1-4de2-9213-c5edbaa5b78d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:17.658656 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25670e-92b1-4de2-9213-c5edbaa5b78d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:17.658656 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25670e-92b1-4de2-9213-c5edbaa5b78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:17.691974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ca25670e-92b1-4de2-9213-c5edbaa5b78d None None] MFA Rules not processed for user `a6e2d4471d7549a2b2a971ea7a7acfe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:17.693662 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ca25670e-92b1-4de2-9213-c5edbaa5b78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:17.755853 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:17.804708 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1332/2681] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:17.821249 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934b7b9-626a-4522-8020-0b0df195b27f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:17.825935 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4934b7b9-626a-4522-8020-0b0df195b27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:17.939265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4934b7b9-626a-4522-8020-0b0df195b27f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:17.943467 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1d461e-a51f-454e-b26b-c9db8662e011 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:17.944143 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d461e-a51f-454e-b26b-c9db8662e011 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:17.944425 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d461e-a51f-454e-b26b-c9db8662e011 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:17.944701 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1d461e-a51f-454e-b26b-c9db8662e011 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:17.958976 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d461e-a51f-454e-b26b-c9db8662e011 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:17.960635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1d461e-a51f-454e-b26b-c9db8662e011 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:17.996134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1350/2682] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:18.638595 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25670e-92b1-4de2-9213-c5edbaa5b78d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:18.788815 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25670e-92b1-4de2-9213-c5edbaa5b78d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:18.802093 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b870ba-f272-4579-9d97-d1cc9f1ac40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:18.803779 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b870ba-f272-4579-9d97-d1cc9f1ac40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:18.804310 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b870ba-f272-4579-9d97-d1cc9f1ac40c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:18.805335 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b870ba-f272-4579-9d97-d1cc9f1ac40c admin admin] PATH_INFO: `/v3/users/f4a7e91293f84c16b8840ad663680ead` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:18.809325 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b870ba-f272-4579-9d97-d1cc9f1ac40c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a7e91293f84c16b8840ad663680ead)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:18.812930 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b870ba-f272-4579-9d97-d1cc9f1ac40c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:18.906876 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-45b870ba-f272-4579-9d97-d1cc9f1ac40c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a7e91293f84c16b8840ad663680ead'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:18.927377 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-45b870ba-f272-4579-9d97-d1cc9f1ac40c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a7e91293f84c16b8840ad663680ead'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:18.930965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-45b870ba-f272-4579-9d97-d1cc9f1ac40c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a7e91293f84c16b8840ad663680ead'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:18.931560 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-45b870ba-f272-4579-9d97-d1cc9f1ac40c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a7e91293f84c16b8840ad663680ead'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:18.952145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-45b870ba-f272-4579-9d97-d1cc9f1ac40c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a7e91293f84c16b8840ad663680ead'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:19.028325 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1333/2683] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:02:18 2022] DELETE /identity/v3/users/f4a7e91293f84c16b8840ad663680ead => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:19.033261 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1e1f0-d095-4de7-920e-fd7afc60be6c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:19.033752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1e1f0-d095-4de7-920e-fd7afc60be6c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:19.033905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1e1f0-d095-4de7-920e-fd7afc60be6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:19.058914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-01b1e1f0-d095-4de7-920e-fd7afc60be6c None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:19.060229 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-01b1e1f0-d095-4de7-920e-fd7afc60be6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:19.206095 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1351/2684] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:19.212263 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b870ba-f272-4579-9d97-d1cc9f1ac40c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:19.213830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-45b870ba-f272-4579-9d97-d1cc9f1ac40c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:19.325558 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b870ba-f272-4579-9d97-d1cc9f1ac40c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:19.330244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c02a4-7dd2-4b0a-bc2c-23e88aca058c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:19.330978 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c02a4-7dd2-4b0a-bc2c-23e88aca058c service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:19.331324 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c02a4-7dd2-4b0a-bc2c-23e88aca058c service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:19.331667 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c02a4-7dd2-4b0a-bc2c-23e88aca058c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:19.347502 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c02a4-7dd2-4b0a-bc2c-23e88aca058c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:19.353501 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c02a4-7dd2-4b0a-bc2c-23e88aca058c service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:19.364708 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1334/2685] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:19.834826 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1e1f0-d095-4de7-920e-fd7afc60be6c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:19.837087 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-01b1e1f0-d095-4de7-920e-fd7afc60be6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:19.870547 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1e1f0-d095-4de7-920e-fd7afc60be6c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:19.884498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534030e8-e0b5-42df-8c25-d11237f0b38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:19.891891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534030e8-e0b5-42df-8c25-d11237f0b38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:19.892217 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534030e8-e0b5-42df-8c25-d11237f0b38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:19.892550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534030e8-e0b5-42df-8c25-d11237f0b38c admin admin] PATH_INFO: `/v3/projects/668f70e2c329447ea14f5f6df6fbec8d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:19.894084 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534030e8-e0b5-42df-8c25-d11237f0b38c admin admin] RBAC: Authorizing `identity:delete_project(project_id=668f70e2c329447ea14f5f6df6fbec8d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:19.896265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534030e8-e0b5-42df-8c25-d11237f0b38c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:19.922594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:19.989596 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-534030e8-e0b5-42df-8c25-d11237f0b38c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '668f70e2c329447ea14f5f6df6fbec8d', 'request_id': 'req-534030e8-e0b5-42df-8c25-d11237f0b38c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:20.006077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-534030e8-e0b5-42df-8c25-d11237f0b38c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '668f70e2c329447ea14f5f6df6fbec8d', 'request_id': 'req-534030e8-e0b5-42df-8c25-d11237f0b38c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:20.014994 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-534030e8-e0b5-42df-8c25-d11237f0b38c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '668f70e2c329447ea14f5f6df6fbec8d', 'request_id': 'req-534030e8-e0b5-42df-8c25-d11237f0b38c'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:20.034878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-534030e8-e0b5-42df-8c25-d11237f0b38c admin admin] The token cache is being invalidate because project 668f70e2c329447ea14f5f6df6fbec8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:02:20.036168 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-534030e8-e0b5-42df-8c25-d11237f0b38c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:20.037150 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-534030e8-e0b5-42df-8c25-d11237f0b38c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:20.053378 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1352/2686] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:02:19 2022] DELETE /identity/v3/projects/668f70e2c329447ea14f5f6df6fbec8d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:20.057717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c02a4-7dd2-4b0a-bc2c-23e88aca058c service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:20.064365 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:20.072249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c02a4-7dd2-4b0a-bc2c-23e88aca058c service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:20.208701 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c2f1d-7efd-4bad-9fe9-36345e77e68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:20.209358 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c2f1d-7efd-4bad-9fe9-36345e77e68e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:20.209646 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c2f1d-7efd-4bad-9fe9-36345e77e68e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:20.209921 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c2f1d-7efd-4bad-9fe9-36345e77e68e admin admin] PATH_INFO: `/v3/users/a6e2d4471d7549a2b2a971ea7a7acfe9` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:20.213254 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c2f1d-7efd-4bad-9fe9-36345e77e68e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e2d4471d7549a2b2a971ea7a7acfe9)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:20.215878 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c2f1d-7efd-4bad-9fe9-36345e77e68e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:20.339536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b77c2f1d-7efd-4bad-9fe9-36345e77e68e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e2d4471d7549a2b2a971ea7a7acfe9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:20.354433 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b77c2f1d-7efd-4bad-9fe9-36345e77e68e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e2d4471d7549a2b2a971ea7a7acfe9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:20.355542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b77c2f1d-7efd-4bad-9fe9-36345e77e68e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e2d4471d7549a2b2a971ea7a7acfe9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:20.357035 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b77c2f1d-7efd-4bad-9fe9-36345e77e68e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e2d4471d7549a2b2a971ea7a7acfe9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:20.368709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b77c2f1d-7efd-4bad-9fe9-36345e77e68e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e2d4471d7549a2b2a971ea7a7acfe9'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:20.437246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1335/2687] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:02:20 2022] DELETE /identity/v3/users/a6e2d4471d7549a2b2a971ea7a7acfe9 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:20.600286 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535888a-1ec8-4a7c-a132-1101b1145b6c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:20.602698 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535888a-1ec8-4a7c-a132-1101b1145b6c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:20.603254 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2535888a-1ec8-4a7c-a132-1101b1145b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:20.649824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-2535888a-1ec8-4a7c-a132-1101b1145b6c None None] MFA Rules not processed for user `2f62a3f5525f4cff9bddd8f28554dd3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:20.651893 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2535888a-1ec8-4a7c-a132-1101b1145b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:20.772230 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1353/2688] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:20.783636 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c2f1d-7efd-4bad-9fe9-36345e77e68e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:20.786241 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b77c2f1d-7efd-4bad-9fe9-36345e77e68e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:20.850810 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535888a-1ec8-4a7c-a132-1101b1145b6c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:20.853149 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-2535888a-1ec8-4a7c-a132-1101b1145b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:20.922030 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c2f1d-7efd-4bad-9fe9-36345e77e68e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:20.931548 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655da88-dd6d-447c-b6c3-88a14ff6a028 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:20.932220 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655da88-dd6d-447c-b6c3-88a14ff6a028 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:20.932493 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655da88-dd6d-447c-b6c3-88a14ff6a028 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:20.932768 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655da88-dd6d-447c-b6c3-88a14ff6a028 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:20.934528 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e655da88-dd6d-447c-b6c3-88a14ff6a028 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:20.944896 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2535888a-1ec8-4a7c-a132-1101b1145b6c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:20.949788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c6265-3601-4b19-9d82-5e80ab613db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:20.950427 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c6265-3601-4b19-9d82-5e80ab613db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:20.950702 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c6265-3601-4b19-9d82-5e80ab613db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:20.950972 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c6265-3601-4b19-9d82-5e80ab613db6 admin admin] PATH_INFO: `/v3/projects/ae2714932e1742449a7acc81536569d6` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:20.952154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c6265-3601-4b19-9d82-5e80ab613db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae2714932e1742449a7acc81536569d6)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:20.954723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c6265-3601-4b19-9d82-5e80ab613db6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:20.959786 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:21.010711 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:21.014225 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655da88-dd6d-447c-b6c3-88a14ff6a028 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:21.015871 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655da88-dd6d-447c-b6c3-88a14ff6a028 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:21.027120 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1336/2689] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:21.032929 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-876c6265-3601-4b19-9d82-5e80ab613db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae2714932e1742449a7acc81536569d6', 'request_id': 'req-876c6265-3601-4b19-9d82-5e80ab613db6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:21.044801 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-876c6265-3601-4b19-9d82-5e80ab613db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae2714932e1742449a7acc81536569d6', 'request_id': 'req-876c6265-3601-4b19-9d82-5e80ab613db6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:21.051399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-876c6265-3601-4b19-9d82-5e80ab613db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae2714932e1742449a7acc81536569d6', 'request_id': 'req-876c6265-3601-4b19-9d82-5e80ab613db6'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:21.064727 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-876c6265-3601-4b19-9d82-5e80ab613db6 admin admin] The token cache is being invalidate because project ae2714932e1742449a7acc81536569d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:02:21.065044 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-876c6265-3601-4b19-9d82-5e80ab613db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:21.065690 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-876c6265-3601-4b19-9d82-5e80ab613db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:21.069331 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1354/2690] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:02:20 2022] DELETE /identity/v3/projects/ae2714932e1742449a7acc81536569d6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:21.074483 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37a422-e417-471a-a6a5-ede705a121b2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:21.075040 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37a422-e417-471a-a6a5-ede705a121b2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:21.075295 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37a422-e417-471a-a6a5-ede705a121b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:21.109629 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-cc37a422-e417-471a-a6a5-ede705a121b2 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:21.111000 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cc37a422-e417-471a-a6a5-ede705a121b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:21.184154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1337/2691] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:21.188558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c523ce-039c-469f-9275-e8186bf68d39 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:21.188873 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c523ce-039c-469f-9275-e8186bf68d39 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:21.189194 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c523ce-039c-469f-9275-e8186bf68d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:21.212483 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f3c523ce-039c-469f-9275-e8186bf68d39 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:21.213842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f3c523ce-039c-469f-9275-e8186bf68d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:21.223369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1355/2692] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:02:21.227941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37a422-e417-471a-a6a5-ede705a121b2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:21.238679 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37a422-e417-471a-a6a5-ede705a121b2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:21.243980 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e782a-c500-4d98-8ff6-509fb282c596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:21.244882 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e782a-c500-4d98-8ff6-509fb282c596 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:21.245249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e782a-c500-4d98-8ff6-509fb282c596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:21.245613 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e782a-c500-4d98-8ff6-509fb282c596 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:21.247074 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e782a-c500-4d98-8ff6-509fb282c596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:02:21.247658 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e782a-c500-4d98-8ff6-509fb282c596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:21.249306 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e782a-c500-4d98-8ff6-509fb282c596 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:21.265394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1338/2693] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:02:21.266926 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c523ce-039c-469f-9275-e8186bf68d39 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:21.278369 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c523ce-039c-469f-9275-e8186bf68d39 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:21.286196 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e1a3d-3e84-4d09-ba4a-f1e3fdb9ef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:21.286867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e1a3d-3e84-4d09-ba4a-f1e3fdb9ef5d admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:21.287185 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e1a3d-3e84-4d09-ba4a-f1e3fdb9ef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:21.287471 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e1a3d-3e84-4d09-ba4a-f1e3fdb9ef5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:21.288201 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e1a3d-3e84-4d09-ba4a-f1e3fdb9ef5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:21.290395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e1a3d-3e84-4d09-ba4a-f1e3fdb9ef5d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:21.322109 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1356/2694] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:02:21 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:02:21.326460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e782a-c500-4d98-8ff6-509fb282c596 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:21.338444 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e782a-c500-4d98-8ff6-509fb282c596 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:21.403832 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c65bd-ab06-4110-b4f2-0ec91d5f26e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:21.404562 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c65bd-ab06-4110-b4f2-0ec91d5f26e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:21.404836 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c65bd-ab06-4110-b4f2-0ec91d5f26e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:21.405131 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c65bd-ab06-4110-b4f2-0ec91d5f26e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:21.405832 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c65bd-ab06-4110-b4f2-0ec91d5f26e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:21.408093 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c65bd-ab06-4110-b4f2-0ec91d5f26e4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:21.432825 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1339/2695] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:02:21 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:02:21.436865 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e1a3d-3e84-4d09-ba4a-f1e3fdb9ef5d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:21.448094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e1a3d-3e84-4d09-ba4a-f1e3fdb9ef5d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:21.452748 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e026215-fa9c-4692-b4de-d07b2b15cb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:21.453349 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e026215-fa9c-4692-b4de-d07b2b15cb8d admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:21.453622 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e026215-fa9c-4692-b4de-d07b2b15cb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:21.453895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e026215-fa9c-4692-b4de-d07b2b15cb8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:21.454534 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e026215-fa9c-4692-b4de-d07b2b15cb8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:21.456153 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e026215-fa9c-4692-b4de-d07b2b15cb8d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:21.466713 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1357/2696] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:02:21.470796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c65bd-ab06-4110-b4f2-0ec91d5f26e4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:21.482004 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c65bd-ab06-4110-b4f2-0ec91d5f26e4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:21.487257 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cd777-bc5d-407a-a2a5-5a26fe8d40ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:21.487963 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cd777-bc5d-407a-a2a5-5a26fe8d40ae admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:21.488340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cd777-bc5d-407a-a2a5-5a26fe8d40ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:21.488678 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cd777-bc5d-407a-a2a5-5a26fe8d40ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:21.489384 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cd777-bc5d-407a-a2a5-5a26fe8d40ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:21.491140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cd777-bc5d-407a-a2a5-5a26fe8d40ae admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:21.507030 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1340/2697] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:21.508962 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e026215-fa9c-4692-b4de-d07b2b15cb8d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:21.519575 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e026215-fa9c-4692-b4de-d07b2b15cb8d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:21.534388 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12957af6-d2db-49f6-ae36-3e035aea02bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:21.535083 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12957af6-d2db-49f6-ae36-3e035aea02bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:21.535362 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12957af6-d2db-49f6-ae36-3e035aea02bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:21.535636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12957af6-d2db-49f6-ae36-3e035aea02bb admin admin] PATH_INFO: `/v3/projects/7221cbb6b62b4544b355555659e93029/users/bc868a7dbb9e44468d6b6627f136d501/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:21.555977 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12957af6-d2db-49f6-ae36-3e035aea02bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7221cbb6b62b4544b355555659e93029, user_id=bc868a7dbb9e44468d6b6627f136d501, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:21.558668 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12957af6-d2db-49f6-ae36-3e035aea02bb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:21.574596 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1358/2698] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:21 2022] PUT /identity/v3/projects/7221cbb6b62b4544b355555659e93029/users/bc868a7dbb9e44468d6b6627f136d501/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:02:21.585810 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f836d-cf3d-4cc6-aa61-217136f8b2f1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:21.586120 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f836d-cf3d-4cc6-aa61-217136f8b2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:21.586389 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f836d-cf3d-4cc6-aa61-217136f8b2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:21.615794 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c06f836d-cf3d-4cc6-aa61-217136f8b2f1 None None] MFA Rules not processed for user `bc868a7dbb9e44468d6b6627f136d501`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:21.618510 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c06f836d-cf3d-4cc6-aa61-217136f8b2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:21.633766 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:21.699139 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1341/2699] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:21.703640 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12957af6-d2db-49f6-ae36-3e035aea02bb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:21.768550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12957af6-d2db-49f6-ae36-3e035aea02bb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:21.774502 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb04b17-f44d-49ce-b930-05d0d31633a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:21.775137 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb04b17-f44d-49ce-b930-05d0d31633a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:21.775407 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb04b17-f44d-49ce-b930-05d0d31633a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:21.775677 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb04b17-f44d-49ce-b930-05d0d31633a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:21.776346 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb04b17-f44d-49ce-b930-05d0d31633a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:21.778256 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb04b17-f44d-49ce-b930-05d0d31633a7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:21.810692 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1359/2700] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:02:21 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:02:21.812298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f836d-cf3d-4cc6-aa61-217136f8b2f1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:21.825073 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f836d-cf3d-4cc6-aa61-217136f8b2f1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:21.889049 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f245c1a-7c5b-4b06-a640-f78bfce1f6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:21.890220 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f245c1a-7c5b-4b06-a640-f78bfce1f6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:21.890536 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f245c1a-7c5b-4b06-a640-f78bfce1f6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:21.891216 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f245c1a-7c5b-4b06-a640-f78bfce1f6c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:21.891899 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f245c1a-7c5b-4b06-a640-f78bfce1f6c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:21.893892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f245c1a-7c5b-4b06-a640-f78bfce1f6c7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:21.924612 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1342/2701] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:02:21 2022] POST /identity/v3/users => generated 290 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:02:21.928633 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb04b17-f44d-49ce-b930-05d0d31633a7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:21.942894 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb04b17-f44d-49ce-b930-05d0d31633a7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:21.948650 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b0f2c-a70a-4431-8a64-dff72760ef1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:21.949401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b0f2c-a70a-4431-8a64-dff72760ef1d admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:21.949772 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b0f2c-a70a-4431-8a64-dff72760ef1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:21.950070 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b0f2c-a70a-4431-8a64-dff72760ef1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:21.950780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b0f2c-a70a-4431-8a64-dff72760ef1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:21.952454 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b0f2c-a70a-4431-8a64-dff72760ef1d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:21.965028 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1360/2702] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:21.969740 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f245c1a-7c5b-4b06-a640-f78bfce1f6c7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:21.985147 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f245c1a-7c5b-4b06-a640-f78bfce1f6c7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:21.990076 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d6fd9-56b3-4cfb-8d46-b173ad1e1b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:21.990784 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d6fd9-56b3-4cfb-8d46-b173ad1e1b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:21.991071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d6fd9-56b3-4cfb-8d46-b173ad1e1b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:21.991351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d6fd9-56b3-4cfb-8d46-b173ad1e1b8d admin admin] PATH_INFO: `/v3/projects/89ba6ff76a244080a30ad8accea9bb17/users/b151f6028a0b4fdf92d428aa66750097/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:22.007860 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d6fd9-56b3-4cfb-8d46-b173ad1e1b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ba6ff76a244080a30ad8accea9bb17, user_id=b151f6028a0b4fdf92d428aa66750097, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:22.011475 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d6fd9-56b3-4cfb-8d46-b173ad1e1b8d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:22.026781 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1343/2703] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:21 2022] PUT /identity/v3/projects/89ba6ff76a244080a30ad8accea9bb17/users/b151f6028a0b4fdf92d428aa66750097/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:02:22.030955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b0f2c-a70a-4431-8a64-dff72760ef1d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:22.043903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b0f2c-a70a-4431-8a64-dff72760ef1d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:22.074339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:22.102623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567503e1-87a2-486a-a769-2e61e80d7c04 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:22.103165 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567503e1-87a2-486a-a769-2e61e80d7c04 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:22.103165 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567503e1-87a2-486a-a769-2e61e80d7c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:22.129421 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-567503e1-87a2-486a-a769-2e61e80d7c04 None None] MFA Rules not processed for user `1e65692e4d7b40b7b75c15d7b681cf44`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:22.130650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-567503e1-87a2-486a-a769-2e61e80d7c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:22.137610 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53e01f-d662-4c6b-ab12-8fc37cdb7e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:22.138244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53e01f-d662-4c6b-ab12-8fc37cdb7e9a admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:22.138532 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53e01f-d662-4c6b-ab12-8fc37cdb7e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:22.138814 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53e01f-d662-4c6b-ab12-8fc37cdb7e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:22.139465 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53e01f-d662-4c6b-ab12-8fc37cdb7e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:22.141485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53e01f-d662-4c6b-ab12-8fc37cdb7e9a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:22.152839 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1361/2704] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:02:22.157801 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53e01f-d662-4c6b-ab12-8fc37cdb7e9a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:22.172197 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53e01f-d662-4c6b-ab12-8fc37cdb7e9a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:22.178697 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2efdd2-ecd7-4d7c-a7cf-00c2a32a11fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:22.179360 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2efdd2-ecd7-4d7c-a7cf-00c2a32a11fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:22.180229 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2efdd2-ecd7-4d7c-a7cf-00c2a32a11fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:22.180642 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2efdd2-ecd7-4d7c-a7cf-00c2a32a11fc admin admin] PATH_INFO: `/v3/projects/89ba6ff76a244080a30ad8accea9bb17/users/b151f6028a0b4fdf92d428aa66750097/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:22.182854 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2efdd2-ecd7-4d7c-a7cf-00c2a32a11fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=89ba6ff76a244080a30ad8accea9bb17, user_id=b151f6028a0b4fdf92d428aa66750097, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:22.186286 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2efdd2-ecd7-4d7c-a7cf-00c2a32a11fc admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:22.209971 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1362/2705] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:22 2022] PUT /identity/v3/projects/89ba6ff76a244080a30ad8accea9bb17/users/b151f6028a0b4fdf92d428aa66750097/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:22.222020 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c97b2e-a56a-405d-9684-0acdf07029cc None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:22.222572 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c97b2e-a56a-405d-9684-0acdf07029cc None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:22.222818 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c97b2e-a56a-405d-9684-0acdf07029cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:22.222921 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1344/2706] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:22.272782 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-81c97b2e-a56a-405d-9684-0acdf07029cc None None] MFA Rules not processed for user `b151f6028a0b4fdf92d428aa66750097`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:22.274076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-81c97b2e-a56a-405d-9684-0acdf07029cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:22.362687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1363/2707] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:22.375300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567503e1-87a2-486a-a769-2e61e80d7c04 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:22.379329 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-567503e1-87a2-486a-a769-2e61e80d7c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:22.411612 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:22.446484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567503e1-87a2-486a-a769-2e61e80d7c04 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:22.507689 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faade1f9-15e3-43c5-b8b9-f364d7063c9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:22.508440 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faade1f9-15e3-43c5-b8b9-f364d7063c9b service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:22.508883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faade1f9-15e3-43c5-b8b9-f364d7063c9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:22.509171 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faade1f9-15e3-43c5-b8b9-f364d7063c9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:22.519401 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faade1f9-15e3-43c5-b8b9-f364d7063c9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:22.520926 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faade1f9-15e3-43c5-b8b9-f364d7063c9b service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:22.532202 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1345/2708] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:22 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:24.117001 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c97b2e-a56a-405d-9684-0acdf07029cc None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:24.204103 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c97b2e-a56a-405d-9684-0acdf07029cc None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:24.208839 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8773d62-e351-4d7b-b634-5a2c1ccc3ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:24.209744 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8773d62-e351-4d7b-b634-5a2c1ccc3ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:24.210024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8773d62-e351-4d7b-b634-5a2c1ccc3ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:24.210299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8773d62-e351-4d7b-b634-5a2c1ccc3ba2 admin admin] PATH_INFO: `/v3/users/bc868a7dbb9e44468d6b6627f136d501` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:24.211555 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8773d62-e351-4d7b-b634-5a2c1ccc3ba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc868a7dbb9e44468d6b6627f136d501)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:24.213798 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8773d62-e351-4d7b-b634-5a2c1ccc3ba2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:24.263711 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:24.280740 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d8773d62-e351-4d7b-b634-5a2c1ccc3ba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc868a7dbb9e44468d6b6627f136d501'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:24.293260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d8773d62-e351-4d7b-b634-5a2c1ccc3ba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc868a7dbb9e44468d6b6627f136d501'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:24.318808 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d8773d62-e351-4d7b-b634-5a2c1ccc3ba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc868a7dbb9e44468d6b6627f136d501'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:24.320263 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d8773d62-e351-4d7b-b634-5a2c1ccc3ba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc868a7dbb9e44468d6b6627f136d501'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:24.321619 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d8773d62-e351-4d7b-b634-5a2c1ccc3ba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc868a7dbb9e44468d6b6627f136d501'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:24.337855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1364/2709] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:02:24 2022] DELETE /identity/v3/users/bc868a7dbb9e44468d6b6627f136d501 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:24.342398 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076772e-b3d2-456f-9d17-4eb81910c3a3 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:24.342893 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076772e-b3d2-456f-9d17-4eb81910c3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:24.343001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c076772e-b3d2-456f-9d17-4eb81910c3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:24.363211 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c076772e-b3d2-456f-9d17-4eb81910c3a3 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:24.364482 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c076772e-b3d2-456f-9d17-4eb81910c3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:24.430919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1346/2710] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:24.441108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8773d62-e351-4d7b-b634-5a2c1ccc3ba2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:24.442681 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d8773d62-e351-4d7b-b634-5a2c1ccc3ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:24.509446 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8773d62-e351-4d7b-b634-5a2c1ccc3ba2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:24.513232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f7c40-57b9-41b0-b889-9df1bb7b619a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:24.513853 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f7c40-57b9-41b0-b889-9df1bb7b619a service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:24.514275 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f7c40-57b9-41b0-b889-9df1bb7b619a service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:24.514472 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f7c40-57b9-41b0-b889-9df1bb7b619a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:24.526070 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f7c40-57b9-41b0-b889-9df1bb7b619a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:24.527201 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f7c40-57b9-41b0-b889-9df1bb7b619a service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:24.538042 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1365/2711] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:25.118427 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076772e-b3d2-456f-9d17-4eb81910c3a3 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:25.120081 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c076772e-b3d2-456f-9d17-4eb81910c3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:25.132884 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c076772e-b3d2-456f-9d17-4eb81910c3a3 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:25.137833 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e8bea-c5b1-431b-a9a9-91698a650d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:25.138478 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e8bea-c5b1-431b-a9a9-91698a650d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:25.138834 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e8bea-c5b1-431b-a9a9-91698a650d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:25.139044 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e8bea-c5b1-431b-a9a9-91698a650d03 admin admin] PATH_INFO: `/v3/projects/7221cbb6b62b4544b355555659e93029` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:25.142620 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e8bea-c5b1-431b-a9a9-91698a650d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7221cbb6b62b4544b355555659e93029)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:25.144717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e8bea-c5b1-431b-a9a9-91698a650d03 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:25.195378 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-436e8bea-c5b1-431b-a9a9-91698a650d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7221cbb6b62b4544b355555659e93029', 'request_id': 'req-436e8bea-c5b1-431b-a9a9-91698a650d03'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:25.203439 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-436e8bea-c5b1-431b-a9a9-91698a650d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7221cbb6b62b4544b355555659e93029', 'request_id': 'req-436e8bea-c5b1-431b-a9a9-91698a650d03'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:25.209589 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-436e8bea-c5b1-431b-a9a9-91698a650d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7221cbb6b62b4544b355555659e93029', 'request_id': 'req-436e8bea-c5b1-431b-a9a9-91698a650d03'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:25.222437 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-436e8bea-c5b1-431b-a9a9-91698a650d03 admin admin] The token cache is being invalidate because project 7221cbb6b62b4544b355555659e93029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:02:25.222725 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-436e8bea-c5b1-431b-a9a9-91698a650d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:25.223372 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-436e8bea-c5b1-431b-a9a9-91698a650d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:25.225018 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1347/2712] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:02:25 2022] DELETE /identity/v3/projects/7221cbb6b62b4544b355555659e93029 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:25.229688 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f7c40-57b9-41b0-b889-9df1bb7b619a service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:25.239807 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f7c40-57b9-41b0-b889-9df1bb7b619a service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:25.299014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264437b-08a4-484b-99da-98274340b957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:25.299654 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264437b-08a4-484b-99da-98274340b957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:25.299931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264437b-08a4-484b-99da-98274340b957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:25.300228 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264437b-08a4-484b-99da-98274340b957 admin admin] PATH_INFO: `/v3/users/b151f6028a0b4fdf92d428aa66750097` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:25.301351 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264437b-08a4-484b-99da-98274340b957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b151f6028a0b4fdf92d428aa66750097)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:25.303260 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264437b-08a4-484b-99da-98274340b957 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:25.352011 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6264437b-08a4-484b-99da-98274340b957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b151f6028a0b4fdf92d428aa66750097'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:25.360278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6264437b-08a4-484b-99da-98274340b957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b151f6028a0b4fdf92d428aa66750097'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:25.366070 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:25.378241 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6264437b-08a4-484b-99da-98274340b957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b151f6028a0b4fdf92d428aa66750097'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:25.379004 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6264437b-08a4-484b-99da-98274340b957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b151f6028a0b4fdf92d428aa66750097'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:25.379665 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6264437b-08a4-484b-99da-98274340b957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b151f6028a0b4fdf92d428aa66750097'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:25.393623 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1366/2713] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:02:25 2022] DELETE /identity/v3/users/b151f6028a0b4fdf92d428aa66750097 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:25.701229 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e8bea-c5b1-431b-a9a9-91698a650d03 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:25.703025 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-436e8bea-c5b1-431b-a9a9-91698a650d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:25.717951 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e8bea-c5b1-431b-a9a9-91698a650d03 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:25.721844 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:25.786749 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f045c-0d51-4d1f-86f5-7c004e463ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:25.787394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f045c-0d51-4d1f-86f5-7c004e463ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:25.787673 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f045c-0d51-4d1f-86f5-7c004e463ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:25.787947 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f045c-0d51-4d1f-86f5-7c004e463ec1 admin admin] PATH_INFO: `/v3/projects/89ba6ff76a244080a30ad8accea9bb17` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:25.789148 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f045c-0d51-4d1f-86f5-7c004e463ec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89ba6ff76a244080a30ad8accea9bb17)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:25.791448 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f045c-0d51-4d1f-86f5-7c004e463ec1 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:25.850040 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d28f045c-0d51-4d1f-86f5-7c004e463ec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89ba6ff76a244080a30ad8accea9bb17', 'request_id': 'req-d28f045c-0d51-4d1f-86f5-7c004e463ec1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:25.869148 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d28f045c-0d51-4d1f-86f5-7c004e463ec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89ba6ff76a244080a30ad8accea9bb17', 'request_id': 'req-d28f045c-0d51-4d1f-86f5-7c004e463ec1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:25.875801 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d28f045c-0d51-4d1f-86f5-7c004e463ec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89ba6ff76a244080a30ad8accea9bb17', 'request_id': 'req-d28f045c-0d51-4d1f-86f5-7c004e463ec1'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:25.911592 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d28f045c-0d51-4d1f-86f5-7c004e463ec1 admin admin] The token cache is being invalidate because project 89ba6ff76a244080a30ad8accea9bb17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:02:25.911885 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d28f045c-0d51-4d1f-86f5-7c004e463ec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:25.912584 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d28f045c-0d51-4d1f-86f5-7c004e463ec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:25.914844 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1348/2714] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:02:25 2022] DELETE /identity/v3/projects/89ba6ff76a244080a30ad8accea9bb17 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:25.920478 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153f94a-da54-480c-adce-189605df99d2 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:25.920883 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153f94a-da54-480c-adce-189605df99d2 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:25.921261 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153f94a-da54-480c-adce-189605df99d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:25.942975 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-7153f94a-da54-480c-adce-189605df99d2 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:25.946174 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-7153f94a-da54-480c-adce-189605df99d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:26.010295 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1367/2715] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:26.018421 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582356d0-cb22-4780-9a12-3ef50c875679 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:26.018786 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582356d0-cb22-4780-9a12-3ef50c875679 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:26.019147 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582356d0-cb22-4780-9a12-3ef50c875679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:26.042203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-582356d0-cb22-4780-9a12-3ef50c875679 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:26.043425 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-582356d0-cb22-4780-9a12-3ef50c875679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:26.051718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1349/2716] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:26.056578 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153f94a-da54-480c-adce-189605df99d2 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:26.066549 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153f94a-da54-480c-adce-189605df99d2 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:26.074630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c241de2-a0fa-4510-acc1-35f435b7205c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:26.075249 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c241de2-a0fa-4510-acc1-35f435b7205c admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:26.075509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c241de2-a0fa-4510-acc1-35f435b7205c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:26.075789 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c241de2-a0fa-4510-acc1-35f435b7205c admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:26.077960 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c241de2-a0fa-4510-acc1-35f435b7205c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:02:26.079362 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c241de2-a0fa-4510-acc1-35f435b7205c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:26.081096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c241de2-a0fa-4510-acc1-35f435b7205c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:26.095454 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1368/2717] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:02:26.099975 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582356d0-cb22-4780-9a12-3ef50c875679 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:26.109761 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582356d0-cb22-4780-9a12-3ef50c875679 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:26.114563 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed0890-f8a3-4eda-8bea-33bc7814d9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:26.115180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed0890-f8a3-4eda-8bea-33bc7814d9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:26.115460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed0890-f8a3-4eda-8bea-33bc7814d9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:26.115736 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed0890-f8a3-4eda-8bea-33bc7814d9f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:26.116415 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed0890-f8a3-4eda-8bea-33bc7814d9f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:26.118548 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed0890-f8a3-4eda-8bea-33bc7814d9f6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:26.148342 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1350/2718] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:02:26 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:02:26.153279 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c241de2-a0fa-4510-acc1-35f435b7205c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:26.163833 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c241de2-a0fa-4510-acc1-35f435b7205c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:26.231479 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0835d-db7f-444d-9997-3377c32535b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:26.232207 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0835d-db7f-444d-9997-3377c32535b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:26.232572 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0835d-db7f-444d-9997-3377c32535b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:26.232914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0835d-db7f-444d-9997-3377c32535b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:26.233708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0835d-db7f-444d-9997-3377c32535b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:26.235678 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0835d-db7f-444d-9997-3377c32535b4 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:26.259651 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1369/2719] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:02:26 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:02:26.263938 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed0890-f8a3-4eda-8bea-33bc7814d9f6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:26.275742 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed0890-f8a3-4eda-8bea-33bc7814d9f6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:26.280695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fd287-1f8f-427b-9147-fdfcf84bb091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:26.281322 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fd287-1f8f-427b-9147-fdfcf84bb091 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:26.281606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fd287-1f8f-427b-9147-fdfcf84bb091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:26.281889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fd287-1f8f-427b-9147-fdfcf84bb091 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:26.282545 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fd287-1f8f-427b-9147-fdfcf84bb091 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:26.288628 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fd287-1f8f-427b-9147-fdfcf84bb091 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:26.305382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1351/2720] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:26.307695 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0835d-db7f-444d-9997-3377c32535b4 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:26.319117 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0835d-db7f-444d-9997-3377c32535b4 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:26.324772 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320fabb-8206-426b-845b-6a21c5e73b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:26.325456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320fabb-8206-426b-845b-6a21c5e73b39 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:26.325912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320fabb-8206-426b-845b-6a21c5e73b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:26.326320 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320fabb-8206-426b-845b-6a21c5e73b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:26.327063 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320fabb-8206-426b-845b-6a21c5e73b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:26.328961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320fabb-8206-426b-845b-6a21c5e73b39 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:26.342242 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1370/2721] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:26.346324 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fd287-1f8f-427b-9147-fdfcf84bb091 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:26.358480 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fd287-1f8f-427b-9147-fdfcf84bb091 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:26.363003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be876b1a-435a-4742-9a54-1a831c034a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:26.363747 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be876b1a-435a-4742-9a54-1a831c034a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:26.364137 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be876b1a-435a-4742-9a54-1a831c034a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:26.364522 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be876b1a-435a-4742-9a54-1a831c034a66 admin admin] PATH_INFO: `/v3/projects/a01802e0d4fd4970bc3b9a7581176655/users/0c773afeb05748fba50515f2c8cd16bf/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:26.380471 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be876b1a-435a-4742-9a54-1a831c034a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a01802e0d4fd4970bc3b9a7581176655, user_id=0c773afeb05748fba50515f2c8cd16bf, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:26.384419 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be876b1a-435a-4742-9a54-1a831c034a66 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:26.398049 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1352/2722] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:26 2022] PUT /identity/v3/projects/a01802e0d4fd4970bc3b9a7581176655/users/0c773afeb05748fba50515f2c8cd16bf/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:26.410317 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96baa7ac-4c85-4200-9fe8-6f3a2f588cc1 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:26.410699 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96baa7ac-4c85-4200-9fe8-6f3a2f588cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:26.411296 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96baa7ac-4c85-4200-9fe8-6f3a2f588cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:26.441862 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-96baa7ac-4c85-4200-9fe8-6f3a2f588cc1 None None] MFA Rules not processed for user `0c773afeb05748fba50515f2c8cd16bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:26.443109 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-96baa7ac-4c85-4200-9fe8-6f3a2f588cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:26.474510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:26.523886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1371/2723] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:26.534571 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be876b1a-435a-4742-9a54-1a831c034a66 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:26.536616 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-be876b1a-435a-4742-9a54-1a831c034a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:26.577244 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:26.603622 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be876b1a-435a-4742-9a54-1a831c034a66 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:26.607303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b88a0-e417-442e-b601-32488ed6510c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d298efe48464956b7a03cba1001060b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:26.607912 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b88a0-e417-442e-b601-32488ed6510c service glance] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:26.608219 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b88a0-e417-442e-b601-32488ed6510c service glance] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:26.608492 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b88a0-e417-442e-b601-32488ed6510c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:26.617043 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b88a0-e417-442e-b601-32488ed6510c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:26.618820 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b88a0-e417-442e-b601-32488ed6510c service glance] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:26.628592 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1353/2724] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:36.509965 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=13 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:36.623663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=11 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:39.138420 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96baa7ac-4c85-4200-9fe8-6f3a2f588cc1 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:39.139898 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-96baa7ac-4c85-4200-9fe8-6f3a2f588cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:39.206827 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96baa7ac-4c85-4200-9fe8-6f3a2f588cc1 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:39.213103 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87fe94-499f-4c00-aaa3-c51c2ca99c5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:39.217515 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87fe94-499f-4c00-aaa3-c51c2ca99c5f service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:39.217515 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87fe94-499f-4c00-aaa3-c51c2ca99c5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:39.217515 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87fe94-499f-4c00-aaa3-c51c2ca99c5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:39.219109 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8a87fe94-499f-4c00-aaa3-c51c2ca99c5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:39.297595 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87fe94-499f-4c00-aaa3-c51c2ca99c5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:39.298862 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87fe94-499f-4c00-aaa3-c51c2ca99c5f service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:39.311649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1372/2725] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:43.019201 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b88a0-e417-442e-b601-32488ed6510c service glance] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:43.020852 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2f3b88a0-e417-442e-b601-32488ed6510c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:43.115490 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87fe94-499f-4c00-aaa3-c51c2ca99c5f service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:43.116957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8a87fe94-499f-4c00-aaa3-c51c2ca99c5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:43.123441 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b88a0-e417-442e-b601-32488ed6510c service glance] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:43.130286 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb6d32-36a4-405f-ab00-f5ec6bea316b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc28d9a1b3f4feca0deeb5f266f8b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:43.131356 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb6d32-36a4-405f-ab00-f5ec6bea316b service placement] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:43.132448 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb6d32-36a4-405f-ab00-f5ec6bea316b service placement] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:43.132731 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb6d32-36a4-405f-ab00-f5ec6bea316b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:43.135314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cffb6d32-36a4-405f-ab00-f5ec6bea316b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:43.140435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87fe94-499f-4c00-aaa3-c51c2ca99c5f service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:43.159704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb6d32-36a4-405f-ab00-f5ec6bea316b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:43.172084 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb6d32-36a4-405f-ab00-f5ec6bea316b service placement] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:43.175272 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1354/2726] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:43.181776 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd29bc8-2ee1-4222-bd64-29675bbbf291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:43.182537 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd29bc8-2ee1-4222-bd64-29675bbbf291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:43.182883 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd29bc8-2ee1-4222-bd64-29675bbbf291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:43.183226 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd29bc8-2ee1-4222-bd64-29675bbbf291 admin admin] PATH_INFO: `/v3/users/ef5e046f57cc4389818835ba68ad8157` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:43.184522 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd29bc8-2ee1-4222-bd64-29675bbbf291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef5e046f57cc4389818835ba68ad8157)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:43.187101 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd29bc8-2ee1-4222-bd64-29675bbbf291 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:43.242699 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8fd29bc8-2ee1-4222-bd64-29675bbbf291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef5e046f57cc4389818835ba68ad8157'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:43.252840 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8fd29bc8-2ee1-4222-bd64-29675bbbf291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef5e046f57cc4389818835ba68ad8157'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:43.278582 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8fd29bc8-2ee1-4222-bd64-29675bbbf291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef5e046f57cc4389818835ba68ad8157'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:43.279378 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8fd29bc8-2ee1-4222-bd64-29675bbbf291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef5e046f57cc4389818835ba68ad8157'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:43.280011 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-8fd29bc8-2ee1-4222-bd64-29675bbbf291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef5e046f57cc4389818835ba68ad8157'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:43.297948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1373/2727] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:02:43 2022] DELETE /identity/v3/users/ef5e046f57cc4389818835ba68ad8157 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:43.485180 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb6d32-36a4-405f-ab00-f5ec6bea316b service placement] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:43.502347 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb6d32-36a4-405f-ab00-f5ec6bea316b service placement] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:43.567402 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058f209-f94f-4a01-9e76-46b92dcf9fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:43.568071 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058f209-f94f-4a01-9e76-46b92dcf9fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:43.568361 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058f209-f94f-4a01-9e76-46b92dcf9fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:43.568635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058f209-f94f-4a01-9e76-46b92dcf9fc7 admin admin] PATH_INFO: `/v3/projects/a20f62de3f094d1e8a5b80dcb30a8e2f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:43.569749 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058f209-f94f-4a01-9e76-46b92dcf9fc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a20f62de3f094d1e8a5b80dcb30a8e2f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:43.572272 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058f209-f94f-4a01-9e76-46b92dcf9fc7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:43.617452 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a058f209-f94f-4a01-9e76-46b92dcf9fc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a20f62de3f094d1e8a5b80dcb30a8e2f', 'request_id': 'req-a058f209-f94f-4a01-9e76-46b92dcf9fc7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:43.625196 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a058f209-f94f-4a01-9e76-46b92dcf9fc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a20f62de3f094d1e8a5b80dcb30a8e2f', 'request_id': 'req-a058f209-f94f-4a01-9e76-46b92dcf9fc7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:43.630860 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a058f209-f94f-4a01-9e76-46b92dcf9fc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a20f62de3f094d1e8a5b80dcb30a8e2f', 'request_id': 'req-a058f209-f94f-4a01-9e76-46b92dcf9fc7'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:43.642172 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a058f209-f94f-4a01-9e76-46b92dcf9fc7 admin admin] The token cache is being invalidate because project a20f62de3f094d1e8a5b80dcb30a8e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:02:43.642463 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a058f209-f94f-4a01-9e76-46b92dcf9fc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:43.643089 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a058f209-f94f-4a01-9e76-46b92dcf9fc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:43.644571 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1355/2728] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:02:43 2022] DELETE /identity/v3/projects/a20f62de3f094d1e8a5b80dcb30a8e2f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:43.649498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b4200-2b4d-4b60-a950-b236f1171aac None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:43.651948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b4200-2b4d-4b60-a950-b236f1171aac None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:43.651948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b4200-2b4d-4b60-a950-b236f1171aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:43.671003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-286b4200-2b4d-4b60-a950-b236f1171aac None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:43.672168 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-286b4200-2b4d-4b60-a950-b236f1171aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:43.689119 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:43.732323 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1374/2729] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:02:43.740215 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cf905-ca9a-482b-8ea4-eb98fa242c76 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:43.740516 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cf905-ca9a-482b-8ea4-eb98fa242c76 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:43.740820 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993cf905-ca9a-482b-8ea4-eb98fa242c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:43.761754 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-993cf905-ca9a-482b-8ea4-eb98fa242c76 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:43.762968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-993cf905-ca9a-482b-8ea4-eb98fa242c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:43.770896 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1356/2730] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:43.775086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b4200-2b4d-4b60-a950-b236f1171aac None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:43.784713 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b4200-2b4d-4b60-a950-b236f1171aac None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:43.789591 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f848cf8-d33d-4bee-b3c6-b4d876939bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:43.790187 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f848cf8-d33d-4bee-b3c6-b4d876939bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:43.790548 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f848cf8-d33d-4bee-b3c6-b4d876939bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:43.790957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f848cf8-d33d-4bee-b3c6-b4d876939bd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:43.791683 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f848cf8-d33d-4bee-b3c6-b4d876939bd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:02:43.792015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f848cf8-d33d-4bee-b3c6-b4d876939bd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:43.793614 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f848cf8-d33d-4bee-b3c6-b4d876939bd1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:43.805118 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1375/2731] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:02:43.809941 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cf905-ca9a-482b-8ea4-eb98fa242c76 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:43.819060 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993cf905-ca9a-482b-8ea4-eb98fa242c76 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:43.824426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ed5e7-2809-4bd4-8b2a-043ed4cfdb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:43.825021 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ed5e7-2809-4bd4-8b2a-043ed4cfdb3e admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:43.825303 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ed5e7-2809-4bd4-8b2a-043ed4cfdb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:43.825576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ed5e7-2809-4bd4-8b2a-043ed4cfdb3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:43.826200 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ed5e7-2809-4bd4-8b2a-043ed4cfdb3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:43.828117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ed5e7-2809-4bd4-8b2a-043ed4cfdb3e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:43.839094 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:43.855850 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1357/2732] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:02:43 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:02:43.859700 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f848cf8-d33d-4bee-b3c6-b4d876939bd1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:43.870320 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f848cf8-d33d-4bee-b3c6-b4d876939bd1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:43.926788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093be01-5e38-4889-9cb9-f02eb2a9cdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:43.927307 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093be01-5e38-4889-9cb9-f02eb2a9cdb5 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:43.927584 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093be01-5e38-4889-9cb9-f02eb2a9cdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:43.927875 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093be01-5e38-4889-9cb9-f02eb2a9cdb5 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:43.928533 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093be01-5e38-4889-9cb9-f02eb2a9cdb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:43.930457 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093be01-5e38-4889-9cb9-f02eb2a9cdb5 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:43.954932 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1376/2733] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:02:43 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:02:43.956467 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ed5e7-2809-4bd4-8b2a-043ed4cfdb3e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:43.968258 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ed5e7-2809-4bd4-8b2a-043ed4cfdb3e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:43.972950 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dd588-3129-4e92-a98e-4cc2b0cd41df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:43.973551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dd588-3129-4e92-a98e-4cc2b0cd41df admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:43.973826 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dd588-3129-4e92-a98e-4cc2b0cd41df admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:43.974091 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dd588-3129-4e92-a98e-4cc2b0cd41df admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:43.974749 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dd588-3129-4e92-a98e-4cc2b0cd41df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:43.976384 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6dd588-3129-4e92-a98e-4cc2b0cd41df admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:43.986989 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1358/2734] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:43.991190 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093be01-5e38-4889-9cb9-f02eb2a9cdb5 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:44.002088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093be01-5e38-4889-9cb9-f02eb2a9cdb5 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:44.006918 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b33d4-79dc-40c0-a144-6baca37d05ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:44.007520 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b33d4-79dc-40c0-a144-6baca37d05ca admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:44.007803 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b33d4-79dc-40c0-a144-6baca37d05ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:44.008184 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b33d4-79dc-40c0-a144-6baca37d05ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:44.008858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b33d4-79dc-40c0-a144-6baca37d05ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:44.011031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b33d4-79dc-40c0-a144-6baca37d05ca admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:44.022281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1377/2735] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:02:44.026711 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dd588-3129-4e92-a98e-4cc2b0cd41df admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:44.037440 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dd588-3129-4e92-a98e-4cc2b0cd41df admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:44.042844 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66022ccf-d6c7-479c-97ec-852277b5f71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:44.043523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66022ccf-d6c7-479c-97ec-852277b5f71e admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:44.043781 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66022ccf-d6c7-479c-97ec-852277b5f71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:44.044231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66022ccf-d6c7-479c-97ec-852277b5f71e admin admin] PATH_INFO: `/v3/projects/222ae6fcd4734ebcabca53a0727675f5/users/71349196979d497cb9da0a3376a1f5eb/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:44.059544 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66022ccf-d6c7-479c-97ec-852277b5f71e admin admin] RBAC: Authorizing `identity:create_grant(project_id=222ae6fcd4734ebcabca53a0727675f5, user_id=71349196979d497cb9da0a3376a1f5eb, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:44.062366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66022ccf-d6c7-479c-97ec-852277b5f71e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:44.078712 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1359/2736] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:44 2022] PUT /identity/v3/projects/222ae6fcd4734ebcabca53a0727675f5/users/71349196979d497cb9da0a3376a1f5eb/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:44.083768 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddbc92-c315-496d-bc45-1c67bc4cf168 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:44.084096 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddbc92-c315-496d-bc45-1c67bc4cf168 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:44.084381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddbc92-c315-496d-bc45-1c67bc4cf168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:44.105151 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-acddbc92-c315-496d-bc45-1c67bc4cf168 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:44.106940 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-acddbc92-c315-496d-bc45-1c67bc4cf168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:44.175414 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1378/2737] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:02:44.190129 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66022ccf-d6c7-479c-97ec-852277b5f71e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:44.191982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-66022ccf-d6c7-479c-97ec-852277b5f71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:44.255687 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66022ccf-d6c7-479c-97ec-852277b5f71e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:44.259577 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79e7af-820a-4038-8850-a1d54ff31045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:44.260366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79e7af-820a-4038-8850-a1d54ff31045 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:44.260647 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79e7af-820a-4038-8850-a1d54ff31045 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:44.260923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79e7af-820a-4038-8850-a1d54ff31045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:44.270513 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79e7af-820a-4038-8850-a1d54ff31045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:44.272021 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79e7af-820a-4038-8850-a1d54ff31045 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:44.283083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1360/2738] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:44.456425 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddbc92-c315-496d-bc45-1c67bc4cf168 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:44.458282 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-acddbc92-c315-496d-bc45-1c67bc4cf168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:44.473494 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acddbc92-c315-496d-bc45-1c67bc4cf168 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:44.478991 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25677c81-6e88-4a8c-9e49-e59cca41bb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:44.479749 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25677c81-6e88-4a8c-9e49-e59cca41bb9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:44.480064 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25677c81-6e88-4a8c-9e49-e59cca41bb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:44.480333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25677c81-6e88-4a8c-9e49-e59cca41bb9a admin admin] PATH_INFO: `/v3/users/0c773afeb05748fba50515f2c8cd16bf` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:44.481520 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25677c81-6e88-4a8c-9e49-e59cca41bb9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c773afeb05748fba50515f2c8cd16bf)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:44.483833 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25677c81-6e88-4a8c-9e49-e59cca41bb9a admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:44.508740 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:44.537674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-25677c81-6e88-4a8c-9e49-e59cca41bb9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c773afeb05748fba50515f2c8cd16bf'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:44.545193 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-25677c81-6e88-4a8c-9e49-e59cca41bb9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c773afeb05748fba50515f2c8cd16bf'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:44.558917 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-25677c81-6e88-4a8c-9e49-e59cca41bb9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c773afeb05748fba50515f2c8cd16bf'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:44.559723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-25677c81-6e88-4a8c-9e49-e59cca41bb9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c773afeb05748fba50515f2c8cd16bf'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:44.560413 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-25677c81-6e88-4a8c-9e49-e59cca41bb9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c773afeb05748fba50515f2c8cd16bf'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:44.573785 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1379/2739] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:02:44 2022] DELETE /identity/v3/users/0c773afeb05748fba50515f2c8cd16bf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:44.578256 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d4828-ec9f-44cd-964d-99c689eb5424 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:44.578655 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d4828-ec9f-44cd-964d-99c689eb5424 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:44.579040 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d4828-ec9f-44cd-964d-99c689eb5424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:44.597884 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-978d4828-ec9f-44cd-964d-99c689eb5424 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:44.600165 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-978d4828-ec9f-44cd-964d-99c689eb5424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:44.668477 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1361/2740] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:44.682277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25677c81-6e88-4a8c-9e49-e59cca41bb9a admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:44.684040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-25677c81-6e88-4a8c-9e49-e59cca41bb9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:44.742635 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25677c81-6e88-4a8c-9e49-e59cca41bb9a admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:44.747093 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73208bf3-cbb3-4470-b0ed-ad6770d3806c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:44.747708 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73208bf3-cbb3-4470-b0ed-ad6770d3806c service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:44.748003 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73208bf3-cbb3-4470-b0ed-ad6770d3806c service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:44.748348 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73208bf3-cbb3-4470-b0ed-ad6770d3806c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:44.758240 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73208bf3-cbb3-4470-b0ed-ad6770d3806c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:44.760429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73208bf3-cbb3-4470-b0ed-ad6770d3806c service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:44.770456 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1380/2741] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:45.058952 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d4828-ec9f-44cd-964d-99c689eb5424 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:45.061198 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-978d4828-ec9f-44cd-964d-99c689eb5424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:45.081499 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d4828-ec9f-44cd-964d-99c689eb5424 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:45.087161 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86cbbc-0885-4d60-a9e6-d664b1d8eb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:45.087969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86cbbc-0885-4d60-a9e6-d664b1d8eb9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:45.088431 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86cbbc-0885-4d60-a9e6-d664b1d8eb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:45.088592 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86cbbc-0885-4d60-a9e6-d664b1d8eb9f admin admin] PATH_INFO: `/v3/projects/a01802e0d4fd4970bc3b9a7581176655` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:45.090225 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86cbbc-0885-4d60-a9e6-d664b1d8eb9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a01802e0d4fd4970bc3b9a7581176655)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:45.092354 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86cbbc-0885-4d60-a9e6-d664b1d8eb9f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:45.147690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ef86cbbc-0885-4d60-a9e6-d664b1d8eb9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a01802e0d4fd4970bc3b9a7581176655', 'request_id': 'req-ef86cbbc-0885-4d60-a9e6-d664b1d8eb9f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:45.152550 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:45.158908 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ef86cbbc-0885-4d60-a9e6-d664b1d8eb9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a01802e0d4fd4970bc3b9a7581176655', 'request_id': 'req-ef86cbbc-0885-4d60-a9e6-d664b1d8eb9f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:45.168798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ef86cbbc-0885-4d60-a9e6-d664b1d8eb9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a01802e0d4fd4970bc3b9a7581176655', 'request_id': 'req-ef86cbbc-0885-4d60-a9e6-d664b1d8eb9f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:45.186657 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ef86cbbc-0885-4d60-a9e6-d664b1d8eb9f admin admin] The token cache is being invalidate because project a01802e0d4fd4970bc3b9a7581176655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:02:45.186959 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ef86cbbc-0885-4d60-a9e6-d664b1d8eb9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:45.188378 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ef86cbbc-0885-4d60-a9e6-d664b1d8eb9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:45.190420 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1362/2742] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:02:45 2022] DELETE /identity/v3/projects/a01802e0d4fd4970bc3b9a7581176655 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:45.195618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f652925-3fbd-47af-b866-90f3eed0b999 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:45.196135 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f652925-3fbd-47af-b866-90f3eed0b999 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:45.196271 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f652925-3fbd-47af-b866-90f3eed0b999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:45.217886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-9f652925-3fbd-47af-b866-90f3eed0b999 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:45.219118 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9f652925-3fbd-47af-b866-90f3eed0b999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:45.293038 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1381/2743] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:45.300999 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f7faf-bab9-4c60-990e-ffae7c1b520e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:45.301305 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f7faf-bab9-4c60-990e-ffae7c1b520e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:45.302436 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f7faf-bab9-4c60-990e-ffae7c1b520e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:45.325785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a36f7faf-bab9-4c60-990e-ffae7c1b520e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:45.327053 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a36f7faf-bab9-4c60-990e-ffae7c1b520e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:45.339245 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1363/2744] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:45.340205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f652925-3fbd-47af-b866-90f3eed0b999 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:45.351686 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f652925-3fbd-47af-b866-90f3eed0b999 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:45.359358 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7a6fc-624f-497d-ad86-e6b1f4114cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:45.360448 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7a6fc-624f-497d-ad86-e6b1f4114cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:45.360741 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7a6fc-624f-497d-ad86-e6b1f4114cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:45.361024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7a6fc-624f-497d-ad86-e6b1f4114cc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:45.361732 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7a6fc-624f-497d-ad86-e6b1f4114cc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:02:45.362052 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7a6fc-624f-497d-ad86-e6b1f4114cc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:45.364365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7a6fc-624f-497d-ad86-e6b1f4114cc3 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:45.379629 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1382/2745] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:02:45.384927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f7faf-bab9-4c60-990e-ffae7c1b520e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:45.396946 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f7faf-bab9-4c60-990e-ffae7c1b520e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:45.402693 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affca26-16cf-4725-9907-e6ee96649a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:45.403392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affca26-16cf-4725-9907-e6ee96649a4c admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:45.403737 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affca26-16cf-4725-9907-e6ee96649a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:45.404114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affca26-16cf-4725-9907-e6ee96649a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:45.405510 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affca26-16cf-4725-9907-e6ee96649a4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:45.407210 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9affca26-16cf-4725-9907-e6ee96649a4c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:45.442412 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1364/2746] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:02:45 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:02:45.446108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7a6fc-624f-497d-ad86-e6b1f4114cc3 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:45.459828 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7a6fc-624f-497d-ad86-e6b1f4114cc3 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:45.494616 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:45.532298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebe035-c8f7-49e2-95a9-bfc4440dec0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:45.533232 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebe035-c8f7-49e2-95a9-bfc4440dec0d admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:45.533518 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebe035-c8f7-49e2-95a9-bfc4440dec0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:45.533788 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ebe035-c8f7-49e2-95a9-bfc4440dec0d admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:45.534481 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebe035-c8f7-49e2-95a9-bfc4440dec0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:45.536905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ebe035-c8f7-49e2-95a9-bfc4440dec0d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:45.567371 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1383/2747] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:02:45 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:02:45.571332 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affca26-16cf-4725-9907-e6ee96649a4c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:45.583884 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affca26-16cf-4725-9907-e6ee96649a4c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:45.590405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01554dfa-ba2b-48db-8206-6b438e388c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:45.591181 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01554dfa-ba2b-48db-8206-6b438e388c45 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:45.592050 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01554dfa-ba2b-48db-8206-6b438e388c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:45.592050 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01554dfa-ba2b-48db-8206-6b438e388c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:45.592707 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01554dfa-ba2b-48db-8206-6b438e388c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:45.594442 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01554dfa-ba2b-48db-8206-6b438e388c45 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:45.606266 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1365/2748] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:45.610528 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebe035-c8f7-49e2-95a9-bfc4440dec0d admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:45.622316 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ebe035-c8f7-49e2-95a9-bfc4440dec0d admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:45.627167 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e3777-8e23-4658-9ad0-978ed2373a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:45.628167 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e3777-8e23-4658-9ad0-978ed2373a0c admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:45.628606 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e3777-8e23-4658-9ad0-978ed2373a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:45.629033 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e3777-8e23-4658-9ad0-978ed2373a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:45.629893 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e3777-8e23-4658-9ad0-978ed2373a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:45.631693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e3777-8e23-4658-9ad0-978ed2373a0c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:45.643887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1384/2749] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:45.649426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01554dfa-ba2b-48db-8206-6b438e388c45 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:45.664011 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01554dfa-ba2b-48db-8206-6b438e388c45 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:45.671284 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c9189-2814-4dfe-88b8-00554daf5ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:45.672514 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c9189-2814-4dfe-88b8-00554daf5ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:45.673000 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c9189-2814-4dfe-88b8-00554daf5ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:45.673353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c9189-2814-4dfe-88b8-00554daf5ccb admin admin] PATH_INFO: `/v3/projects/7d7395aa4c194d36beebf9464aecfb94/users/878dbe65c4144e14abf1995dc06a433d/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:45.693077 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c9189-2814-4dfe-88b8-00554daf5ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d7395aa4c194d36beebf9464aecfb94, user_id=878dbe65c4144e14abf1995dc06a433d, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:45.696286 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c9189-2814-4dfe-88b8-00554daf5ccb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:45.716145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1366/2750] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:45 2022] PUT /identity/v3/projects/7d7395aa4c194d36beebf9464aecfb94/users/878dbe65c4144e14abf1995dc06a433d/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:45.786856 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3b0e9-3c41-4f02-b0fe-de554b352250 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:45.787142 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3b0e9-3c41-4f02-b0fe-de554b352250 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:45.787421 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3b0e9-3c41-4f02-b0fe-de554b352250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:45.818432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-aac3b0e9-3c41-4f02-b0fe-de554b352250 None None] MFA Rules not processed for user `878dbe65c4144e14abf1995dc06a433d`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:45.819669 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aac3b0e9-3c41-4f02-b0fe-de554b352250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:45.913000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1385/2751] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:45.914678 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c9189-2814-4dfe-88b8-00554daf5ccb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:45.996264 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c9189-2814-4dfe-88b8-00554daf5ccb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:46.000955 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93265f-1f56-4437-a9cc-031ef63df555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:46.001573 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93265f-1f56-4437-a9cc-031ef63df555 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:46.001852 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93265f-1f56-4437-a9cc-031ef63df555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:46.002125 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93265f-1f56-4437-a9cc-031ef63df555 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:46.002753 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93265f-1f56-4437-a9cc-031ef63df555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:46.004717 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93265f-1f56-4437-a9cc-031ef63df555 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:46.038062 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1367/2752] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:02:45 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:02:46.043315 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3b0e9-3c41-4f02-b0fe-de554b352250 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:46.053510 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3b0e9-3c41-4f02-b0fe-de554b352250 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:46.139323 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4286a9-a7df-4975-a2a2-baf707dff0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:46.140193 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4286a9-a7df-4975-a2a2-baf707dff0d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:46.140706 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4286a9-a7df-4975-a2a2-baf707dff0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:46.141058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4286a9-a7df-4975-a2a2-baf707dff0d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:46.142842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4286a9-a7df-4975-a2a2-baf707dff0d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:46.145125 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4286a9-a7df-4975-a2a2-baf707dff0d9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:46.172541 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1386/2753] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:02:46 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:02:46.173937 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93265f-1f56-4437-a9cc-031ef63df555 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:46.185854 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93265f-1f56-4437-a9cc-031ef63df555 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:46.192792 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ee232-ad57-4ab0-9247-83f5b735781d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:46.193573 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ee232-ad57-4ab0-9247-83f5b735781d admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:46.193954 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ee232-ad57-4ab0-9247-83f5b735781d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:46.194330 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ee232-ad57-4ab0-9247-83f5b735781d admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:46.195078 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ee232-ad57-4ab0-9247-83f5b735781d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:46.196898 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ee232-ad57-4ab0-9247-83f5b735781d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:46.217016 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1368/2754] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:46.221088 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4286a9-a7df-4975-a2a2-baf707dff0d9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:46.233828 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4286a9-a7df-4975-a2a2-baf707dff0d9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:46.238993 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a79ff-8f58-4f03-93bb-c36e1901c8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:46.239766 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a79ff-8f58-4f03-93bb-c36e1901c8ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:46.240209 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a79ff-8f58-4f03-93bb-c36e1901c8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:46.240588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a79ff-8f58-4f03-93bb-c36e1901c8ce admin admin] PATH_INFO: `/v3/projects/7b209315c5ec4fb1979cf171e202f710/users/10ccc7d73dcc4d46aad23d157b77a743/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:46.260057 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a79ff-8f58-4f03-93bb-c36e1901c8ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b209315c5ec4fb1979cf171e202f710, user_id=10ccc7d73dcc4d46aad23d157b77a743, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:46.263310 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a79ff-8f58-4f03-93bb-c36e1901c8ce admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:46.281932 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1387/2755] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:46 2022] PUT /identity/v3/projects/7b209315c5ec4fb1979cf171e202f710/users/10ccc7d73dcc4d46aad23d157b77a743/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:46.286934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ee232-ad57-4ab0-9247-83f5b735781d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:46.299065 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ee232-ad57-4ab0-9247-83f5b735781d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:46.362816 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:46.377282 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb809d8-2cd5-41f3-895b-45b64aed0b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:46.379224 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb809d8-2cd5-41f3-895b-45b64aed0b0e admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:46.379679 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb809d8-2cd5-41f3-895b-45b64aed0b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:46.380822 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb809d8-2cd5-41f3-895b-45b64aed0b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:46.381953 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb809d8-2cd5-41f3-895b-45b64aed0b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:46.385647 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb809d8-2cd5-41f3-895b-45b64aed0b0e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:46.398696 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1369/2756] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:46.403876 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a79ff-8f58-4f03-93bb-c36e1901c8ce admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:46.421380 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:46.429450 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a79ff-8f58-4f03-93bb-c36e1901c8ce admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:46.459751 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7b407-315a-4ac9-91ee-d38ba3c3d6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:46.460618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7b407-315a-4ac9-91ee-d38ba3c3d6c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:46.460891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7b407-315a-4ac9-91ee-d38ba3c3d6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:46.461326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b7b407-315a-4ac9-91ee-d38ba3c3d6c6 admin admin] PATH_INFO: `/v3/projects/7b209315c5ec4fb1979cf171e202f710/users/10ccc7d73dcc4d46aad23d157b77a743/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:46.463601 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7b407-315a-4ac9-91ee-d38ba3c3d6c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b209315c5ec4fb1979cf171e202f710, user_id=10ccc7d73dcc4d46aad23d157b77a743, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:46.466307 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b7b407-315a-4ac9-91ee-d38ba3c3d6c6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:46.481282 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1388/2757] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:46 2022] PUT /identity/v3/projects/7b209315c5ec4fb1979cf171e202f710/users/10ccc7d73dcc4d46aad23d157b77a743/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:46.493567 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ff23a-3961-4a44-ab73-3eff9d091fd1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:46.494762 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ff23a-3961-4a44-ab73-3eff9d091fd1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:46.495524 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ff23a-3961-4a44-ab73-3eff9d091fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:46.542365 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4f8ff23a-3961-4a44-ab73-3eff9d091fd1 None None] MFA Rules not processed for user `10ccc7d73dcc4d46aad23d157b77a743`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:46.543619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4f8ff23a-3961-4a44-ab73-3eff9d091fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:46.627336 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1370/2758] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:46.639126 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7b407-315a-4ac9-91ee-d38ba3c3d6c6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:46.641113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-50b7b407-315a-4ac9-91ee-d38ba3c3d6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:46.704732 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b7b407-315a-4ac9-91ee-d38ba3c3d6c6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:46.708407 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc18203-e5c1-4451-ac15-2d3f9f9c931b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:46.709036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc18203-e5c1-4451-ac15-2d3f9f9c931b service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:46.709331 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc18203-e5c1-4451-ac15-2d3f9f9c931b service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:46.709596 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc18203-e5c1-4451-ac15-2d3f9f9c931b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:46.767521 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc18203-e5c1-4451-ac15-2d3f9f9c931b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:46.769194 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc18203-e5c1-4451-ac15-2d3f9f9c931b service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:46.788169 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1389/2759] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:49.014062 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb719621-8df8-4f95-a8e5-e7434fd97d2c None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:49.014591 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb719621-8df8-4f95-a8e5-e7434fd97d2c None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:49.014785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb719621-8df8-4f95-a8e5-e7434fd97d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:49.045548 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-fb719621-8df8-4f95-a8e5-e7434fd97d2c None None] MFA Rules not processed for user `71349196979d497cb9da0a3376a1f5eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:49.046865 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-fb719621-8df8-4f95-a8e5-e7434fd97d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:49.114820 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1371/2760] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:49.129747 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc18203-e5c1-4451-ac15-2d3f9f9c931b service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:49.131174 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8fc18203-e5c1-4451-ac15-2d3f9f9c931b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:49.206645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc18203-e5c1-4451-ac15-2d3f9f9c931b service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:49.212720 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c834f62-43d2-4374-834a-8d6d62092bc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:49.213274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c834f62-43d2-4374-834a-8d6d62092bc2 service nova] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:49.213551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c834f62-43d2-4374-834a-8d6d62092bc2 service nova] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:49.213824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c834f62-43d2-4374-834a-8d6d62092bc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:49.221666 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c834f62-43d2-4374-834a-8d6d62092bc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:49.223256 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c834f62-43d2-4374-834a-8d6d62092bc2 service nova] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:49.233534 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1390/2761] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:49.559951 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb719621-8df8-4f95-a8e5-e7434fd97d2c None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:49.635892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb719621-8df8-4f95-a8e5-e7434fd97d2c None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:49.640760 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e65ea-6bb0-422a-b841-986fc196d769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:49.641644 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e65ea-6bb0-422a-b841-986fc196d769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:49.641766 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e65ea-6bb0-422a-b841-986fc196d769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:49.641971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e65ea-6bb0-422a-b841-986fc196d769 admin admin] PATH_INFO: `/v3/users/878dbe65c4144e14abf1995dc06a433d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:49.643816 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e65ea-6bb0-422a-b841-986fc196d769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=878dbe65c4144e14abf1995dc06a433d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:49.645960 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e65ea-6bb0-422a-b841-986fc196d769 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:49.652083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:49.767104 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d54e65ea-6bb0-422a-b841-986fc196d769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '878dbe65c4144e14abf1995dc06a433d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:49.776653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d54e65ea-6bb0-422a-b841-986fc196d769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '878dbe65c4144e14abf1995dc06a433d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:49.777907 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d54e65ea-6bb0-422a-b841-986fc196d769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '878dbe65c4144e14abf1995dc06a433d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:49.778771 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d54e65ea-6bb0-422a-b841-986fc196d769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '878dbe65c4144e14abf1995dc06a433d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:49.789610 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-d54e65ea-6bb0-422a-b841-986fc196d769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '878dbe65c4144e14abf1995dc06a433d'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:49.813566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1372/2762] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:02:49 2022] DELETE /identity/v3/users/878dbe65c4144e14abf1995dc06a433d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:49.817897 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4750a-dc37-4250-93ef-0091846b12ca None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:49.818478 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4750a-dc37-4250-93ef-0091846b12ca None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:49.818750 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4750a-dc37-4250-93ef-0091846b12ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:49.855824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-fef4750a-dc37-4250-93ef-0091846b12ca None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:49.860307 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fef4750a-dc37-4250-93ef-0091846b12ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:49.898252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:49.949659 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1391/2763] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:49.959370 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e65ea-6bb0-422a-b841-986fc196d769 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:49.960898 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-d54e65ea-6bb0-422a-b841-986fc196d769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:50.036921 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e65ea-6bb0-422a-b841-986fc196d769 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:50.042432 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e6e42-6c7c-47f1-a83d-6964c4658e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:50.043068 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e6e42-6c7c-47f1-a83d-6964c4658e09 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:50.043349 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e6e42-6c7c-47f1-a83d-6964c4658e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:50.043649 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e6e42-6c7c-47f1-a83d-6964c4658e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:50.054160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e6e42-6c7c-47f1-a83d-6964c4658e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:50.055632 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e6e42-6c7c-47f1-a83d-6964c4658e09 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:50.066609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1373/2764] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:50.435262 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4750a-dc37-4250-93ef-0091846b12ca None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:50.436937 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fef4750a-dc37-4250-93ef-0091846b12ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:50.453419 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4750a-dc37-4250-93ef-0091846b12ca None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:50.459234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75051270-b2f5-4ca4-8b30-454b6b1aa022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:50.460322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75051270-b2f5-4ca4-8b30-454b6b1aa022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:50.460838 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75051270-b2f5-4ca4-8b30-454b6b1aa022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:50.461327 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75051270-b2f5-4ca4-8b30-454b6b1aa022 admin admin] PATH_INFO: `/v3/projects/7d7395aa4c194d36beebf9464aecfb94` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:50.463666 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75051270-b2f5-4ca4-8b30-454b6b1aa022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d7395aa4c194d36beebf9464aecfb94)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:50.466033 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75051270-b2f5-4ca4-8b30-454b6b1aa022 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:50.537686 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-75051270-b2f5-4ca4-8b30-454b6b1aa022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d7395aa4c194d36beebf9464aecfb94', 'request_id': 'req-75051270-b2f5-4ca4-8b30-454b6b1aa022'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:50.549928 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-75051270-b2f5-4ca4-8b30-454b6b1aa022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d7395aa4c194d36beebf9464aecfb94', 'request_id': 'req-75051270-b2f5-4ca4-8b30-454b6b1aa022'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:50.560095 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-75051270-b2f5-4ca4-8b30-454b6b1aa022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d7395aa4c194d36beebf9464aecfb94', 'request_id': 'req-75051270-b2f5-4ca4-8b30-454b6b1aa022'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:50.580406 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-75051270-b2f5-4ca4-8b30-454b6b1aa022 admin admin] The token cache is being invalidate because project 7d7395aa4c194d36beebf9464aecfb94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:02:50.580862 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-75051270-b2f5-4ca4-8b30-454b6b1aa022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:50.581790 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-75051270-b2f5-4ca4-8b30-454b6b1aa022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:50.585916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1392/2765] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:02:50 2022] DELETE /identity/v3/projects/7d7395aa4c194d36beebf9464aecfb94 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:50.590282 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e6e42-6c7c-47f1-a83d-6964c4658e09 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:50.600638 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e6e42-6c7c-47f1-a83d-6964c4658e09 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:50.670767 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e3013-f02d-4b19-96af-a428c13cbd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:50.672385 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e3013-f02d-4b19-96af-a428c13cbd03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:50.672740 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e3013-f02d-4b19-96af-a428c13cbd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:50.673107 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e3013-f02d-4b19-96af-a428c13cbd03 admin admin] PATH_INFO: `/v3/users/10ccc7d73dcc4d46aad23d157b77a743` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:50.675196 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e3013-f02d-4b19-96af-a428c13cbd03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10ccc7d73dcc4d46aad23d157b77a743)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:50.677250 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e3013-f02d-4b19-96af-a428c13cbd03 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:50.710387 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:50.745314 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-457e3013-f02d-4b19-96af-a428c13cbd03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10ccc7d73dcc4d46aad23d157b77a743'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:50.761524 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-457e3013-f02d-4b19-96af-a428c13cbd03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10ccc7d73dcc4d46aad23d157b77a743'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:50.763535 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-457e3013-f02d-4b19-96af-a428c13cbd03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10ccc7d73dcc4d46aad23d157b77a743'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:50.764355 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-457e3013-f02d-4b19-96af-a428c13cbd03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10ccc7d73dcc4d46aad23d157b77a743'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:50.775670 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-457e3013-f02d-4b19-96af-a428c13cbd03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10ccc7d73dcc4d46aad23d157b77a743'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:50.802608 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1374/2766] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:02:50 2022] DELETE /identity/v3/users/10ccc7d73dcc4d46aad23d157b77a743 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:50.896443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255af9e-ffee-4ed7-a205-6c215b9504c6 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:50.897242 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255af9e-ffee-4ed7-a205-6c215b9504c6 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:50.897730 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255af9e-ffee-4ed7-a205-6c215b9504c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:50.933283 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-8255af9e-ffee-4ed7-a205-6c215b9504c6 None None] MFA Rules not processed for user `71349196979d497cb9da0a3376a1f5eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:50.934765 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-8255af9e-ffee-4ed7-a205-6c215b9504c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:51.028211 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1393/2767] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:51.292636 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e3013-f02d-4b19-96af-a428c13cbd03 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:51.294245 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-457e3013-f02d-4b19-96af-a428c13cbd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:51.367222 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e3013-f02d-4b19-96af-a428c13cbd03 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:51.376556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7850a1-bde6-4771-8ce9-e709ea62004a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:51.380796 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7850a1-bde6-4771-8ce9-e709ea62004a service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:51.381093 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7850a1-bde6-4771-8ce9-e709ea62004a service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:51.381380 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7850a1-bde6-4771-8ce9-e709ea62004a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:51.384151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3e7850a1-bde6-4771-8ce9-e709ea62004a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:51.384914 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255af9e-ffee-4ed7-a205-6c215b9504c6 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:51.397643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255af9e-ffee-4ed7-a205-6c215b9504c6 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:51.402225 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a2d00-0b9a-4441-a570-d514a33e5fc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:51.402854 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a2d00-0b9a-4441-a570-d514a33e5fc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:51.403135 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a2d00-0b9a-4441-a570-d514a33e5fc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:51.403410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a2d00-0b9a-4441-a570-d514a33e5fc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:51.405307 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4c8a2d00-0b9a-4441-a570-d514a33e5fc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:51.416709 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a2d00-0b9a-4441-a570-d514a33e5fc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:51.418282 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a2d00-0b9a-4441-a570-d514a33e5fc0 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:51.428279 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1394/2768] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:51.460191 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7850a1-bde6-4771-8ce9-e709ea62004a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:51.464948 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7850a1-bde6-4771-8ce9-e709ea62004a service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:51.477525 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1375/2769] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:02:51.487894 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a2d00-0b9a-4441-a570-d514a33e5fc0 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:51.490391 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4c8a2d00-0b9a-4441-a570-d514a33e5fc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:51.544443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:51.568582 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a2d00-0b9a-4441-a570-d514a33e5fc0 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:51.574812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec37ebf-3fa8-495e-bea3-d78c4b4e0ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:51.575834 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec37ebf-3fa8-495e-bea3-d78c4b4e0ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:51.576339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec37ebf-3fa8-495e-bea3-d78c4b4e0ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:51.576909 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec37ebf-3fa8-495e-bea3-d78c4b4e0ac9 admin admin] PATH_INFO: `/v3/projects/7b209315c5ec4fb1979cf171e202f710` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:51.578515 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec37ebf-3fa8-495e-bea3-d78c4b4e0ac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b209315c5ec4fb1979cf171e202f710)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:51.580685 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec37ebf-3fa8-495e-bea3-d78c4b4e0ac9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:51.644121 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3ec37ebf-3fa8-495e-bea3-d78c4b4e0ac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b209315c5ec4fb1979cf171e202f710', 'request_id': 'req-3ec37ebf-3fa8-495e-bea3-d78c4b4e0ac9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:51.654647 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3ec37ebf-3fa8-495e-bea3-d78c4b4e0ac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b209315c5ec4fb1979cf171e202f710', 'request_id': 'req-3ec37ebf-3fa8-495e-bea3-d78c4b4e0ac9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:51.664664 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3ec37ebf-3fa8-495e-bea3-d78c4b4e0ac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b209315c5ec4fb1979cf171e202f710', 'request_id': 'req-3ec37ebf-3fa8-495e-bea3-d78c4b4e0ac9'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:51.679248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3ec37ebf-3fa8-495e-bea3-d78c4b4e0ac9 admin admin] The token cache is being invalidate because project 7b209315c5ec4fb1979cf171e202f710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:02:51.679581 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3ec37ebf-3fa8-495e-bea3-d78c4b4e0ac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:51.680676 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-3ec37ebf-3fa8-495e-bea3-d78c4b4e0ac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:02:51.684086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1395/2770] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:02:51 2022] DELETE /identity/v3/projects/7b209315c5ec4fb1979cf171e202f710 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:02:51.688464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceb9fe-3ba5-4019-a75f-979a9551e0ff None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:51.688746 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceb9fe-3ba5-4019-a75f-979a9551e0ff None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:51.689111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceb9fe-3ba5-4019-a75f-979a9551e0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:51.710755 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-13ceb9fe-3ba5-4019-a75f-979a9551e0ff None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:51.712182 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-13ceb9fe-3ba5-4019-a75f-979a9551e0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:51.768114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:02:51.787829 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1376/2771] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:51.796090 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc5bc3-139a-4779-b373-1659d18205b3 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:51.796366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc5bc3-139a-4779-b373-1659d18205b3 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:51.796671 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc5bc3-139a-4779-b373-1659d18205b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:51.834668 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a8cc5bc3-139a-4779-b373-1659d18205b3 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:51.835887 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a8cc5bc3-139a-4779-b373-1659d18205b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:51.851371 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1396/2772] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:51.855880 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ceb9fe-3ba5-4019-a75f-979a9551e0ff None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:51.866003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ceb9fe-3ba5-4019-a75f-979a9551e0ff None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:51.872179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75481cbc-f332-4d65-9ace-d33e993fc5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:51.872880 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75481cbc-f332-4d65-9ace-d33e993fc5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:51.873722 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75481cbc-f332-4d65-9ace-d33e993fc5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:51.873998 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75481cbc-f332-4d65-9ace-d33e993fc5a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:51.874663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75481cbc-f332-4d65-9ace-d33e993fc5a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:02:51.874967 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75481cbc-f332-4d65-9ace-d33e993fc5a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:51.876635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75481cbc-f332-4d65-9ace-d33e993fc5a7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:51.896970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1377/2773] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:02:51.898079 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc5bc3-139a-4779-b373-1659d18205b3 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:51.908508 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc5bc3-139a-4779-b373-1659d18205b3 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:51.913576 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cc407-adf3-4375-b1b7-0299b429e6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:51.914187 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cc407-adf3-4375-b1b7-0299b429e6bc admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:51.914470 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cc407-adf3-4375-b1b7-0299b429e6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:51.914740 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cc407-adf3-4375-b1b7-0299b429e6bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:51.915429 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cc407-adf3-4375-b1b7-0299b429e6bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:51.917487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52cc407-adf3-4375-b1b7-0299b429e6bc admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:51.964581 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1397/2774] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:02:51 2022] POST /identity/v3/projects => generated 363 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:02:51.968914 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75481cbc-f332-4d65-9ace-d33e993fc5a7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:51.979776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75481cbc-f332-4d65-9ace-d33e993fc5a7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:52.063048 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c914b7-bb9f-4b04-b278-8f6952d9cd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:52.063823 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c914b7-bb9f-4b04-b278-8f6952d9cd4f admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:52.064152 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c914b7-bb9f-4b04-b278-8f6952d9cd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:52.064479 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c914b7-bb9f-4b04-b278-8f6952d9cd4f admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:52.065136 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c914b7-bb9f-4b04-b278-8f6952d9cd4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:52.067184 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c914b7-bb9f-4b04-b278-8f6952d9cd4f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:52.115766 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1378/2775] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:02:51 2022] POST /identity/v3/users => generated 282 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:02:52.120315 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cc407-adf3-4375-b1b7-0299b429e6bc admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:52.135054 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cc407-adf3-4375-b1b7-0299b429e6bc admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:52.145309 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a064fb6-9525-4d53-ad76-bb3cb94f2135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:52.146645 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a064fb6-9525-4d53-ad76-bb3cb94f2135 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:52.146931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a064fb6-9525-4d53-ad76-bb3cb94f2135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:52.147419 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a064fb6-9525-4d53-ad76-bb3cb94f2135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:52.148026 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a064fb6-9525-4d53-ad76-bb3cb94f2135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:52.149855 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a064fb6-9525-4d53-ad76-bb3cb94f2135 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:52.170154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1398/2776] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:02:52.170738 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c914b7-bb9f-4b04-b278-8f6952d9cd4f admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:52.183426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c914b7-bb9f-4b04-b278-8f6952d9cd4f admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:52.193098 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c2fa5-86c5-4196-b99a-fec17bf80476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:52.194210 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c2fa5-86c5-4196-b99a-fec17bf80476 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:52.194682 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c2fa5-86c5-4196-b99a-fec17bf80476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:52.195353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c2fa5-86c5-4196-b99a-fec17bf80476 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:52.196264 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c2fa5-86c5-4196-b99a-fec17bf80476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:52.199223 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c2fa5-86c5-4196-b99a-fec17bf80476 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:52.218354 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a064fb6-9525-4d53-ad76-bb3cb94f2135 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:52.219422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1379/2777] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:02:52.232378 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a064fb6-9525-4d53-ad76-bb3cb94f2135 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:52.239194 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70496478-e4c8-4007-bb58-f399b9b80ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:52.240092 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70496478-e4c8-4007-bb58-f399b9b80ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:52.240227 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70496478-e4c8-4007-bb58-f399b9b80ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:52.240458 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70496478-e4c8-4007-bb58-f399b9b80ea2 admin admin] PATH_INFO: `/v3/projects/de03f2ed905a4804bc616b2dd9de850d/users/154ca07080ef4b919c7e3ca032a19e64/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:52.266971 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70496478-e4c8-4007-bb58-f399b9b80ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de03f2ed905a4804bc616b2dd9de850d, user_id=154ca07080ef4b919c7e3ca032a19e64, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:52.270077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70496478-e4c8-4007-bb58-f399b9b80ea2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:52.308448 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1399/2778] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:02:52 2022] PUT /identity/v3/projects/de03f2ed905a4804bc616b2dd9de850d/users/154ca07080ef4b919c7e3ca032a19e64/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:02:52.311272 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990e512-f9a3-4b84-a44b-bef86b7f49a8 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:52.311732 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990e512-f9a3-4b84-a44b-bef86b7f49a8 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:52.311829 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990e512-f9a3-4b84-a44b-bef86b7f49a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:52.350566 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-e990e512-f9a3-4b84-a44b-bef86b7f49a8 None None] MFA Rules not processed for user `154ca07080ef4b919c7e3ca032a19e64`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:02:52.352055 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e990e512-f9a3-4b84-a44b-bef86b7f49a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:52.448844 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1380/2779] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:02:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:02:52.461130 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70496478-e4c8-4007-bb58-f399b9b80ea2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:02:52.463515 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-70496478-e4c8-4007-bb58-f399b9b80ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:02:52.605825 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70496478-e4c8-4007-bb58-f399b9b80ea2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:02:52.612066 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbd0c0-3352-4b1d-85b7-d1fe213b4fc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:02:52.612997 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbd0c0-3352-4b1d-85b7-d1fe213b4fc4 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:02:52.613638 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbd0c0-3352-4b1d-85b7-d1fe213b4fc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:02:52.614075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbd0c0-3352-4b1d-85b7-d1fe213b4fc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:02:52.638040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbd0c0-3352-4b1d-85b7-d1fe213b4fc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:02:52.642326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbd0c0-3352-4b1d-85b7-d1fe213b4fc4 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:02:52.657151 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1400/2780] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:02:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:03:02.444260 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=74,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:03:02.659447 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:03:23.079053 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990e512-f9a3-4b84-a44b-bef86b7f49a8 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:03:23.140779 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990e512-f9a3-4b84-a44b-bef86b7f49a8 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:03:23.145302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61ebce-9ee9-4ea2-beba-fa699169cdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:03:23.145928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61ebce-9ee9-4ea2-beba-fa699169cdcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:03:23.146212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61ebce-9ee9-4ea2-beba-fa699169cdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:03:23.146490 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61ebce-9ee9-4ea2-beba-fa699169cdcb admin admin] PATH_INFO: `/v3/users/154ca07080ef4b919c7e3ca032a19e64` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:03:23.147631 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61ebce-9ee9-4ea2-beba-fa699169cdcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=154ca07080ef4b919c7e3ca032a19e64)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:03:23.149598 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c61ebce-9ee9-4ea2-beba-fa699169cdcb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:03:23.195333 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c61ebce-9ee9-4ea2-beba-fa699169cdcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '154ca07080ef4b919c7e3ca032a19e64'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:03:23.202159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c61ebce-9ee9-4ea2-beba-fa699169cdcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '154ca07080ef4b919c7e3ca032a19e64'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:03:23.202889 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c61ebce-9ee9-4ea2-beba-fa699169cdcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '154ca07080ef4b919c7e3ca032a19e64'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:03:23.203504 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c61ebce-9ee9-4ea2-beba-fa699169cdcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '154ca07080ef4b919c7e3ca032a19e64'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:03:23.210464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-4c61ebce-9ee9-4ea2-beba-fa699169cdcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '154ca07080ef4b919c7e3ca032a19e64'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:03:23.227828 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1381/2781] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:03:23 2022] DELETE /identity/v3/users/154ca07080ef4b919c7e3ca032a19e64 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:03:23.232895 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe62338-d3a7-4426-af12-5244af87ddef None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:03:23.233383 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe62338-d3a7-4426-af12-5244af87ddef None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:03:23.233485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe62338-d3a7-4426-af12-5244af87ddef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:03:23.252129 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0fe62338-d3a7-4426-af12-5244af87ddef None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:03:23.253367 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0fe62338-d3a7-4426-af12-5244af87ddef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:03:23.313821 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1401/2782] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:03:23.323538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61ebce-9ee9-4ea2-beba-fa699169cdcb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:03:23.324959 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4c61ebce-9ee9-4ea2-beba-fa699169cdcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:03:23.387183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61ebce-9ee9-4ea2-beba-fa699169cdcb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:03:23.390913 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbc5b2-34c0-4a1f-b3d1-491b9faad663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:03:23.391523 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbc5b2-34c0-4a1f-b3d1-491b9faad663 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:03:23.391803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbc5b2-34c0-4a1f-b3d1-491b9faad663 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:03:23.392108 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbc5b2-34c0-4a1f-b3d1-491b9faad663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:03:23.401910 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbc5b2-34c0-4a1f-b3d1-491b9faad663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:03:23.403454 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbc5b2-34c0-4a1f-b3d1-491b9faad663 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:03:23.413080 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1382/2783] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:03:23.693802 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe62338-d3a7-4426-af12-5244af87ddef None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:03:23.695380 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0fe62338-d3a7-4426-af12-5244af87ddef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:03:23.709242 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe62338-d3a7-4426-af12-5244af87ddef None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:03:23.714381 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c91839-dfe9-409c-a83b-a150f6a72827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:03:23.715046 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c91839-dfe9-409c-a83b-a150f6a72827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:03:23.715326 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c91839-dfe9-409c-a83b-a150f6a72827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:03:23.715600 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c91839-dfe9-409c-a83b-a150f6a72827 admin admin] PATH_INFO: `/v3/projects/de03f2ed905a4804bc616b2dd9de850d` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:03:23.716767 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c91839-dfe9-409c-a83b-a150f6a72827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de03f2ed905a4804bc616b2dd9de850d)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:03:23.718726 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c91839-dfe9-409c-a83b-a150f6a72827 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:03:23.765106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a9c91839-dfe9-409c-a83b-a150f6a72827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de03f2ed905a4804bc616b2dd9de850d', 'request_id': 'req-a9c91839-dfe9-409c-a83b-a150f6a72827'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:03:23.772644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a9c91839-dfe9-409c-a83b-a150f6a72827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de03f2ed905a4804bc616b2dd9de850d', 'request_id': 'req-a9c91839-dfe9-409c-a83b-a150f6a72827'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:03:23.779059 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a9c91839-dfe9-409c-a83b-a150f6a72827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de03f2ed905a4804bc616b2dd9de850d', 'request_id': 'req-a9c91839-dfe9-409c-a83b-a150f6a72827'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:03:23.790540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a9c91839-dfe9-409c-a83b-a150f6a72827 admin admin] The token cache is being invalidate because project de03f2ed905a4804bc616b2dd9de850d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:03:23.790830 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a9c91839-dfe9-409c-a83b-a150f6a72827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:03:23.791468 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-a9c91839-dfe9-409c-a83b-a150f6a72827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:03:23.793528 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1402/2784] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:03:23 2022] DELETE /identity/v3/projects/de03f2ed905a4804bc616b2dd9de850d => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:03:33.408651 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:03:33.787554 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:04:13.232985 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbc5b2-34c0-4a1f-b3d1-491b9faad663 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:04:13.234404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-78cbc5b2-34c0-4a1f-b3d1-491b9faad663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:04:13.373925 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbc5b2-34c0-4a1f-b3d1-491b9faad663 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:04:13.434422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a98637-3a21-4033-9e93-b5ea23110b91 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc28d9a1b3f4feca0deeb5f266f8b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:04:13.435030 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a98637-3a21-4033-9e93-b5ea23110b91 service placement] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:04:13.435309 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a98637-3a21-4033-9e93-b5ea23110b91 service placement] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:04:13.435578 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a98637-3a21-4033-9e93-b5ea23110b91 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:04:13.437319 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-e3a98637-3a21-4033-9e93-b5ea23110b91 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:04:13.448231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a98637-3a21-4033-9e93-b5ea23110b91 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:04:13.449791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a98637-3a21-4033-9e93-b5ea23110b91 service placement] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:04:13.459751 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1383/2785] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:04:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:04:23.455618 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:05:05.201920 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c91839-dfe9-409c-a83b-a150f6a72827 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:05:05.204047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a9c91839-dfe9-409c-a83b-a150f6a72827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:05:05.290081 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c91839-dfe9-409c-a83b-a150f6a72827 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:05:05.293780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0300c27-1664-48c6-a5cf-803556c07a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:05:05.294374 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0300c27-1664-48c6-a5cf-803556c07a93 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:05:05.294648 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0300c27-1664-48c6-a5cf-803556c07a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:05:05.294921 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0300c27-1664-48c6-a5cf-803556c07a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:05:05.297224 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f0300c27-1664-48c6-a5cf-803556c07a93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:05:05.307367 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0300c27-1664-48c6-a5cf-803556c07a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:05:05.308892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0300c27-1664-48c6-a5cf-803556c07a93 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:05:05.317947 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1403/2786] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:05:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:05:05.392407 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a98637-3a21-4033-9e93-b5ea23110b91 service placement] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:05:05.401747 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a98637-3a21-4033-9e93-b5ea23110b91 service placement] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:05:05.405392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f8878-3738-4160-9610-b8a995df6cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:05:05.405987 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f8878-3738-4160-9610-b8a995df6cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:05:05.406407 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f8878-3738-4160-9610-b8a995df6cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:05:05.406687 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f8878-3738-4160-9610-b8a995df6cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:05:05.408455 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5a4f8878-3738-4160-9610-b8a995df6cc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:05:05.496974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f8878-3738-4160-9610-b8a995df6cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:05:05.498330 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f8878-3738-4160-9610-b8a995df6cc2 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:05:05.519121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1384/2787] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:05:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:05:15.314691 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=37 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:05:15.516460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=46 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:05:23.755762 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143df6ac-06df-4816-8b1d-c09376c48c5b None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:05:23.756292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143df6ac-06df-4816-8b1d-c09376c48c5b None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:05:23.756419 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143df6ac-06df-4816-8b1d-c09376c48c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:05:23.775976 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-143df6ac-06df-4816-8b1d-c09376c48c5b None None] MFA Rules not processed for user `71349196979d497cb9da0a3376a1f5eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:05:23.777201 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-143df6ac-06df-4816-8b1d-c09376c48c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:05:23.832244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1404/2788] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:05:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:05:33.824733 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=25 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:05:33.826125 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f8878-3738-4160-9610-b8a995df6cc2 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:05:33.827793 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-5a4f8878-3738-4160-9610-b8a995df6cc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:05:33.842409 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f8878-3738-4160-9610-b8a995df6cc2 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:05:33.849100 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ac2eb-7a18-4d79-b501-3ee8ddc446f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:05:33.849708 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ac2eb-7a18-4d79-b501-3ee8ddc446f8 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:05:33.849988 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ac2eb-7a18-4d79-b501-3ee8ddc446f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:05:33.850259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ac2eb-7a18-4d79-b501-3ee8ddc446f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:05:33.852006 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a80ac2eb-7a18-4d79-b501-3ee8ddc446f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:05:33.864462 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ac2eb-7a18-4d79-b501-3ee8ddc446f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:05:33.866047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80ac2eb-7a18-4d79-b501-3ee8ddc446f8 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:05:33.876799 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1385/2789] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:05:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:05:43.872107 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=6 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:10.378486 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143df6ac-06df-4816-8b1d-c09376c48c5b None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:10.379874 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-143df6ac-06df-4816-8b1d-c09376c48c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:10.457200 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143df6ac-06df-4816-8b1d-c09376c48c5b None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:10.460740 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74be3b-7046-436e-b0fc-964a4c9bbc47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:10.461333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74be3b-7046-436e-b0fc-964a4c9bbc47 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:10.461607 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74be3b-7046-436e-b0fc-964a4c9bbc47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:10.461876 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74be3b-7046-436e-b0fc-964a4c9bbc47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:10.463592 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-df74be3b-7046-436e-b0fc-964a4c9bbc47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:10.476679 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74be3b-7046-436e-b0fc-964a4c9bbc47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:10.478089 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74be3b-7046-436e-b0fc-964a4c9bbc47 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:10.488811 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1405/2790] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:06:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:06:13.354797 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ac2eb-7a18-4d79-b501-3ee8ddc446f8 service nova] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:13.363963 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80ac2eb-7a18-4d79-b501-3ee8ddc446f8 service nova] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:13.367511 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c13b1c-20ef-405f-aed7-9393f26434de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:13.368164 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c13b1c-20ef-405f-aed7-9393f26434de service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:13.368424 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c13b1c-20ef-405f-aed7-9393f26434de service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:13.368695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c13b1c-20ef-405f-aed7-9393f26434de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:13.370391 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-79c13b1c-20ef-405f-aed7-9393f26434de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:13.383937 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c13b1c-20ef-405f-aed7-9393f26434de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:13.385394 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c13b1c-20ef-405f-aed7-9393f26434de service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:13.396132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1386/2791] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:06:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:06:20.483979 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=35 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:23.391368 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=6 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:30.139607 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74be3b-7046-436e-b0fc-964a4c9bbc47 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:30.149050 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-df74be3b-7046-436e-b0fc-964a4c9bbc47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:30.251869 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74be3b-7046-436e-b0fc-964a4c9bbc47 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:30.256436 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4a965-9128-4679-b211-829a938474dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:30.257070 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4a965-9128-4679-b211-829a938474dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:30.257397 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4a965-9128-4679-b211-829a938474dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:30.257673 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4a965-9128-4679-b211-829a938474dc admin admin] PATH_INFO: `/v3/users/71349196979d497cb9da0a3376a1f5eb` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:30.259139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4a965-9128-4679-b211-829a938474dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=71349196979d497cb9da0a3376a1f5eb)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:30.261108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4a965-9128-4679-b211-829a938474dc admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:30.322137 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f0d4a965-9128-4679-b211-829a938474dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71349196979d497cb9da0a3376a1f5eb'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:30.330359 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f0d4a965-9128-4679-b211-829a938474dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71349196979d497cb9da0a3376a1f5eb'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:30.342303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f0d4a965-9128-4679-b211-829a938474dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71349196979d497cb9da0a3376a1f5eb'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:30.342951 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f0d4a965-9128-4679-b211-829a938474dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71349196979d497cb9da0a3376a1f5eb'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:30.343551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-f0d4a965-9128-4679-b211-829a938474dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71349196979d497cb9da0a3376a1f5eb'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:30.356394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1406/2792] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:06:30 2022] DELETE /identity/v3/users/71349196979d497cb9da0a3376a1f5eb => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:30.566906 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c13b1c-20ef-405f-aed7-9393f26434de service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:30.577883 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c13b1c-20ef-405f-aed7-9393f26434de service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:30.640014 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e79445-e070-4848-86b9-d97f27236a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:30.640675 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e79445-e070-4848-86b9-d97f27236a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:30.640956 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e79445-e070-4848-86b9-d97f27236a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:30.641233 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e79445-e070-4848-86b9-d97f27236a87 admin admin] PATH_INFO: `/v3/projects/222ae6fcd4734ebcabca53a0727675f5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:30.642489 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e79445-e070-4848-86b9-d97f27236a87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=222ae6fcd4734ebcabca53a0727675f5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:30.644725 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e79445-e070-4848-86b9-d97f27236a87 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:30.694140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b3e79445-e070-4848-86b9-d97f27236a87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '222ae6fcd4734ebcabca53a0727675f5', 'request_id': 'req-b3e79445-e070-4848-86b9-d97f27236a87'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:30.701993 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b3e79445-e070-4848-86b9-d97f27236a87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '222ae6fcd4734ebcabca53a0727675f5', 'request_id': 'req-b3e79445-e070-4848-86b9-d97f27236a87'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:30.707653 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b3e79445-e070-4848-86b9-d97f27236a87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '222ae6fcd4734ebcabca53a0727675f5', 'request_id': 'req-b3e79445-e070-4848-86b9-d97f27236a87'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:30.719175 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b3e79445-e070-4848-86b9-d97f27236a87 admin admin] The token cache is being invalidate because project 222ae6fcd4734ebcabca53a0727675f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:06:30.719464 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b3e79445-e070-4848-86b9-d97f27236a87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:30.720132 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-b3e79445-e070-4848-86b9-d97f27236a87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:30.721601 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1387/2793] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:06:30 2022] DELETE /identity/v3/projects/222ae6fcd4734ebcabca53a0727675f5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:06:30.726572 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702abd66-64ca-4277-bbbb-4ab51675fca5 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:30.726859 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702abd66-64ca-4277-bbbb-4ab51675fca5 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:30.727738 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702abd66-64ca-4277-bbbb-4ab51675fca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:30.786528 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-702abd66-64ca-4277-bbbb-4ab51675fca5 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:30.788023 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-702abd66-64ca-4277-bbbb-4ab51675fca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:30.800844 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:30.850093 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1407/2794] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:30.858679 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72241bdb-602e-4bb7-9a3f-58b89937c961 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:30.858891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72241bdb-602e-4bb7-9a3f-58b89937c961 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:30.859171 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72241bdb-602e-4bb7-9a3f-58b89937c961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:30.879397 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-72241bdb-602e-4bb7-9a3f-58b89937c961 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:30.880672 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-72241bdb-602e-4bb7-9a3f-58b89937c961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:30.888914 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1388/2795] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:30.893134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702abd66-64ca-4277-bbbb-4ab51675fca5 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:30.903105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702abd66-64ca-4277-bbbb-4ab51675fca5 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:30.907892 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9853f-9467-469a-ab58-24cbdb5be315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:30.908529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9853f-9467-469a-ab58-24cbdb5be315 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:30.908811 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9853f-9467-469a-ab58-24cbdb5be315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:30.909089 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9853f-9467-469a-ab58-24cbdb5be315 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:30.909733 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9853f-9467-469a-ab58-24cbdb5be315 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:06:30.910039 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9853f-9467-469a-ab58-24cbdb5be315 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:30.911822 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9853f-9467-469a-ab58-24cbdb5be315 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:30.925662 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1408/2796] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:06:30.930035 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72241bdb-602e-4bb7-9a3f-58b89937c961 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:30.940348 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72241bdb-602e-4bb7-9a3f-58b89937c961 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:30.945678 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ed0ca-0827-4ed1-a891-612e13345b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:30.946412 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ed0ca-0827-4ed1-a891-612e13345b20 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:30.946709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ed0ca-0827-4ed1-a891-612e13345b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:30.946982 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ed0ca-0827-4ed1-a891-612e13345b20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:30.947619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ed0ca-0827-4ed1-a891-612e13345b20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:30.949596 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ed0ca-0827-4ed1-a891-612e13345b20 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:30.990373 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1389/2797] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:06:30 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:06:30.995338 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9853f-9467-469a-ab58-24cbdb5be315 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:31.010740 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9853f-9467-469a-ab58-24cbdb5be315 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:31.068150 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d330df-b65f-4673-8fdf-6ca1501f501e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:31.068819 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d330df-b65f-4673-8fdf-6ca1501f501e admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:31.069104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d330df-b65f-4673-8fdf-6ca1501f501e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:31.069377 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d330df-b65f-4673-8fdf-6ca1501f501e admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:31.070005 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d330df-b65f-4673-8fdf-6ca1501f501e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:31.072718 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d330df-b65f-4673-8fdf-6ca1501f501e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:31.094454 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1409/2798] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:06:30 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:06:31.098617 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ed0ca-0827-4ed1-a891-612e13345b20 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:31.109274 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ed0ca-0827-4ed1-a891-612e13345b20 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:31.113916 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ecb76-dc99-47ac-9223-5040564107f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:31.114521 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ecb76-dc99-47ac-9223-5040564107f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:31.114804 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ecb76-dc99-47ac-9223-5040564107f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:31.115082 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ecb76-dc99-47ac-9223-5040564107f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:31.115718 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ecb76-dc99-47ac-9223-5040564107f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:31.117347 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ecb76-dc99-47ac-9223-5040564107f8 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:31.127900 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1390/2799] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:06:31.131869 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d330df-b65f-4673-8fdf-6ca1501f501e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:31.142333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d330df-b65f-4673-8fdf-6ca1501f501e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:31.146940 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9701fe-4570-4ecd-9125-4124465b3cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:31.147547 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9701fe-4570-4ecd-9125-4124465b3cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:31.147820 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9701fe-4570-4ecd-9125-4124465b3cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:31.148129 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9701fe-4570-4ecd-9125-4124465b3cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:31.148772 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9701fe-4570-4ecd-9125-4124465b3cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:31.151058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9701fe-4570-4ecd-9125-4124465b3cc7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:31.161944 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1410/2800] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:06:31.166753 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ecb76-dc99-47ac-9223-5040564107f8 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:31.176961 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ecb76-dc99-47ac-9223-5040564107f8 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:31.182134 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf74712-b228-496d-8295-0fc0a49979e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:31.182797 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf74712-b228-496d-8295-0fc0a49979e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:31.183069 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf74712-b228-496d-8295-0fc0a49979e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:31.183344 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf74712-b228-496d-8295-0fc0a49979e3 admin admin] PATH_INFO: `/v3/projects/d59bddfd00f9487a9b679dd3be32de36/users/946fb1b49aeb44f1b4cce897ed607344/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:31.198808 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf74712-b228-496d-8295-0fc0a49979e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d59bddfd00f9487a9b679dd3be32de36, user_id=946fb1b49aeb44f1b4cce897ed607344, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:31.201507 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf74712-b228-496d-8295-0fc0a49979e3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:31.214423 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1391/2801] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:06:31 2022] PUT /identity/v3/projects/d59bddfd00f9487a9b679dd3be32de36/users/946fb1b49aeb44f1b4cce897ed607344/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:06:31.226071 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a6eec-873f-4f01-af16-917026cf49ff None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:31.226356 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a6eec-873f-4f01-af16-917026cf49ff None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:31.226626 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a6eec-873f-4f01-af16-917026cf49ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:31.257888 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-152a6eec-873f-4f01-af16-917026cf49ff None None] MFA Rules not processed for user `946fb1b49aeb44f1b4cce897ed607344`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:31.259955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-152a6eec-873f-4f01-af16-917026cf49ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:31.327134 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1411/2802] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:31.338600 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf74712-b228-496d-8295-0fc0a49979e3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:31.340483 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-8cf74712-b228-496d-8295-0fc0a49979e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:31.360516 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:31.436226 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf74712-b228-496d-8295-0fc0a49979e3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:31.442183 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a29f9-04e6-42b9-9244-41e291365695 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc210376e57a41e6b3812110db249099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:31.442801 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a29f9-04e6-42b9-9244-41e291365695 service nova] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:31.443087 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a29f9-04e6-42b9-9244-41e291365695 service nova] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:31.443362 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a29f9-04e6-42b9-9244-41e291365695 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:31.452399 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a29f9-04e6-42b9-9244-41e291365695 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:31.453986 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a29f9-04e6-42b9-9244-41e291365695 service nova] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:31.464968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1392/2803] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:06:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:06:31.748386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a6eec-873f-4f01-af16-917026cf49ff None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:31.766525 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:31.813670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a6eec-873f-4f01-af16-917026cf49ff None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:31.818243 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d8fe9-1e5b-4bad-800a-c24edb78b7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:31.818873 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d8fe9-1e5b-4bad-800a-c24edb78b7b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:31.819150 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d8fe9-1e5b-4bad-800a-c24edb78b7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:31.819421 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d8fe9-1e5b-4bad-800a-c24edb78b7b0 admin admin] PATH_INFO: `/v3/users/946fb1b49aeb44f1b4cce897ed607344` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:31.820575 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d8fe9-1e5b-4bad-800a-c24edb78b7b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=946fb1b49aeb44f1b4cce897ed607344)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:31.823299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d8fe9-1e5b-4bad-800a-c24edb78b7b0 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:31.871672 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9e9d8fe9-1e5b-4bad-800a-c24edb78b7b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '946fb1b49aeb44f1b4cce897ed607344'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:31.879497 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9e9d8fe9-1e5b-4bad-800a-c24edb78b7b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '946fb1b49aeb44f1b4cce897ed607344'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:31.892530 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9e9d8fe9-1e5b-4bad-800a-c24edb78b7b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '946fb1b49aeb44f1b4cce897ed607344'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:31.893228 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9e9d8fe9-1e5b-4bad-800a-c24edb78b7b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '946fb1b49aeb44f1b4cce897ed607344'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:31.893848 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-9e9d8fe9-1e5b-4bad-800a-c24edb78b7b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '946fb1b49aeb44f1b4cce897ed607344'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:31.906564 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1412/2804] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:06:31 2022] DELETE /identity/v3/users/946fb1b49aeb44f1b4cce897ed607344 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:31.911002 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aaddc6-45db-4c6f-98ca-3fefc9dfbcc2 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:31.911455 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aaddc6-45db-4c6f-98ca-3fefc9dfbcc2 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:31.911565 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aaddc6-45db-4c6f-98ca-3fefc9dfbcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:31.931969 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-95aaddc6-45db-4c6f-98ca-3fefc9dfbcc2 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:31.933224 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-95aaddc6-45db-4c6f-98ca-3fefc9dfbcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:31.993083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1393/2805] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:32.003210 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d8fe9-1e5b-4bad-800a-c24edb78b7b0 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:32.004653 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-9e9d8fe9-1e5b-4bad-800a-c24edb78b7b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:32.063246 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d8fe9-1e5b-4bad-800a-c24edb78b7b0 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:32.066893 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccd5cb-8762-4d78-afce-363ef432d9b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:32.067487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccd5cb-8762-4d78-afce-363ef432d9b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:32.067791 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccd5cb-8762-4d78-afce-363ef432d9b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:32.068091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccd5cb-8762-4d78-afce-363ef432d9b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:32.078077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccd5cb-8762-4d78-afce-363ef432d9b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:32.079550 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccd5cb-8762-4d78-afce-363ef432d9b1 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:32.090728 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1413/2806] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:06:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:06:32.376042 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aaddc6-45db-4c6f-98ca-3fefc9dfbcc2 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:32.378976 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-95aaddc6-45db-4c6f-98ca-3fefc9dfbcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:32.392376 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aaddc6-45db-4c6f-98ca-3fefc9dfbcc2 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:32.398715 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a4799-1540-4ad0-86fd-6618ab48550a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:32.400957 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a4799-1540-4ad0-86fd-6618ab48550a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:32.401235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a4799-1540-4ad0-86fd-6618ab48550a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:32.401835 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a4799-1540-4ad0-86fd-6618ab48550a admin admin] PATH_INFO: `/v3/projects/d59bddfd00f9487a9b679dd3be32de36` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:32.402978 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a4799-1540-4ad0-86fd-6618ab48550a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d59bddfd00f9487a9b679dd3be32de36)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:32.404995 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a4799-1540-4ad0-86fd-6618ab48550a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:32.452696 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-092a4799-1540-4ad0-86fd-6618ab48550a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd59bddfd00f9487a9b679dd3be32de36', 'request_id': 'req-092a4799-1540-4ad0-86fd-6618ab48550a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:32.460155 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-092a4799-1540-4ad0-86fd-6618ab48550a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd59bddfd00f9487a9b679dd3be32de36', 'request_id': 'req-092a4799-1540-4ad0-86fd-6618ab48550a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:32.466960 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-092a4799-1540-4ad0-86fd-6618ab48550a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd59bddfd00f9487a9b679dd3be32de36', 'request_id': 'req-092a4799-1540-4ad0-86fd-6618ab48550a'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:32.478097 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-092a4799-1540-4ad0-86fd-6618ab48550a admin admin] The token cache is being invalidate because project d59bddfd00f9487a9b679dd3be32de36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:06:32.478379 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-092a4799-1540-4ad0-86fd-6618ab48550a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:32.479009 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-092a4799-1540-4ad0-86fd-6618ab48550a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:32.480501 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1394/2807] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:06:32 2022] DELETE /identity/v3/projects/d59bddfd00f9487a9b679dd3be32de36 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:32.485304 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac9feb-026c-4a06-9af6-37f8fed84c5f None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:32.485805 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac9feb-026c-4a06-9af6-37f8fed84c5f None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:32.485912 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac9feb-026c-4a06-9af6-37f8fed84c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:32.505070 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-cbac9feb-026c-4a06-9af6-37f8fed84c5f None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:32.506274 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cbac9feb-026c-4a06-9af6-37f8fed84c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:32.542031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:32.574502 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1414/2808] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:32.582669 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae3ea4-adf0-422c-b304-cd62bfe70eef None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:32.583027 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae3ea4-adf0-422c-b304-cd62bfe70eef None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:32.583304 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae3ea4-adf0-422c-b304-cd62bfe70eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:32.604468 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a3ae3ea4-adf0-422c-b304-cd62bfe70eef None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:32.605690 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a3ae3ea4-adf0-422c-b304-cd62bfe70eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:32.613833 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1395/2809] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:06:32.618592 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac9feb-026c-4a06-9af6-37f8fed84c5f None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:32.628408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac9feb-026c-4a06-9af6-37f8fed84c5f None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:32.633716 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001a14e-fc27-4438-bf3e-c720589c8f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:32.634867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001a14e-fc27-4438-bf3e-c720589c8f43 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:32.634867 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001a14e-fc27-4438-bf3e-c720589c8f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:32.635086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2001a14e-fc27-4438-bf3e-c720589c8f43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:32.635799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001a14e-fc27-4438-bf3e-c720589c8f43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:06:32.636214 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001a14e-fc27-4438-bf3e-c720589c8f43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:32.637871 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2001a14e-fc27-4438-bf3e-c720589c8f43 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:32.651115 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1415/2810] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:06:32.655381 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae3ea4-adf0-422c-b304-cd62bfe70eef None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:32.664943 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae3ea4-adf0-422c-b304-cd62bfe70eef None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:32.669721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1375a-e440-4923-9352-3efc48dbe542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:32.670319 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1375a-e440-4923-9352-3efc48dbe542 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:32.670611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1375a-e440-4923-9352-3efc48dbe542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:32.670876 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f1375a-e440-4923-9352-3efc48dbe542 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:32.671508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1375a-e440-4923-9352-3efc48dbe542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:32.673483 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f1375a-e440-4923-9352-3efc48dbe542 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:32.696644 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:32.705683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1396/2811] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:06:32 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:06:32.709745 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001a14e-fc27-4438-bf3e-c720589c8f43 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:32.720336 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2001a14e-fc27-4438-bf3e-c720589c8f43 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:32.783843 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaa2fd-fdc1-4708-bebe-83ce3f8ec74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:32.784761 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaa2fd-fdc1-4708-bebe-83ce3f8ec74c admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:32.785047 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaa2fd-fdc1-4708-bebe-83ce3f8ec74c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:32.785322 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaa2fd-fdc1-4708-bebe-83ce3f8ec74c admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:32.786169 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacaa2fd-fdc1-4708-bebe-83ce3f8ec74c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:32.790837 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacaa2fd-fdc1-4708-bebe-83ce3f8ec74c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:32.818445 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1416/2812] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:06:32 2022] POST /identity/v3/users => generated 282 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:06:32.823235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1375a-e440-4923-9352-3efc48dbe542 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:32.833922 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f1375a-e440-4923-9352-3efc48dbe542 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:32.840635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94d8de-0115-4097-9797-b03c7ebcf4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:32.841255 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94d8de-0115-4097-9797-b03c7ebcf4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:32.841529 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94d8de-0115-4097-9797-b03c7ebcf4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:32.841800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94d8de-0115-4097-9797-b03c7ebcf4f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:32.842443 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94d8de-0115-4097-9797-b03c7ebcf4f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:32.844167 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94d8de-0115-4097-9797-b03c7ebcf4f4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:32.863169 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1397/2813] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:06:32.865200 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaa2fd-fdc1-4708-bebe-83ce3f8ec74c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:32.876377 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaa2fd-fdc1-4708-bebe-83ce3f8ec74c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:32.882140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811ba4e-9635-4eb3-aef2-cb4ab123f471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:32.882976 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811ba4e-9635-4eb3-aef2-cb4ab123f471 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:32.883305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811ba4e-9635-4eb3-aef2-cb4ab123f471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:32.884291 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811ba4e-9635-4eb3-aef2-cb4ab123f471 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:32.884885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811ba4e-9635-4eb3-aef2-cb4ab123f471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:32.886834 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811ba4e-9635-4eb3-aef2-cb4ab123f471 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:32.899534 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1417/2814] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:06:32.903755 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94d8de-0115-4097-9797-b03c7ebcf4f4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:32.915506 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94d8de-0115-4097-9797-b03c7ebcf4f4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:32.922919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057a273-3b4e-4d0c-adb3-7d34d992f039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:32.923601 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057a273-3b4e-4d0c-adb3-7d34d992f039 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:32.923886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057a273-3b4e-4d0c-adb3-7d34d992f039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:32.924188 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057a273-3b4e-4d0c-adb3-7d34d992f039 admin admin] PATH_INFO: `/v3/projects/c56791e4e12d4915bdaab60ad42ea4c4/users/27cb563293814cf7846ef9c2f8278143/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:32.941787 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057a273-3b4e-4d0c-adb3-7d34d992f039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c56791e4e12d4915bdaab60ad42ea4c4, user_id=27cb563293814cf7846ef9c2f8278143, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:32.944520 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057a273-3b4e-4d0c-adb3-7d34d992f039 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:32.959928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1398/2815] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:06:32 2022] PUT /identity/v3/projects/c56791e4e12d4915bdaab60ad42ea4c4/users/27cb563293814cf7846ef9c2f8278143/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:06:32.970413 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822b814-19e6-4ffd-be71-0affb9d947ff None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:32.970845 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822b814-19e6-4ffd-be71-0affb9d947ff None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:32.971119 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822b814-19e6-4ffd-be71-0affb9d947ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:33.003552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4822b814-19e6-4ffd-be71-0affb9d947ff None None] MFA Rules not processed for user `27cb563293814cf7846ef9c2f8278143`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:33.005217 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4822b814-19e6-4ffd-be71-0affb9d947ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:33.081849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1418/2816] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:33.086076 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057a273-3b4e-4d0c-adb3-7d34d992f039 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:33.152430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057a273-3b4e-4d0c-adb3-7d34d992f039 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:33.157085 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08898b9a-22b8-4dac-b7f1-cd593f3f2af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:33.157846 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08898b9a-22b8-4dac-b7f1-cd593f3f2af2 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:33.158192 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08898b9a-22b8-4dac-b7f1-cd593f3f2af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:33.158529 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08898b9a-22b8-4dac-b7f1-cd593f3f2af2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:33.159275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08898b9a-22b8-4dac-b7f1-cd593f3f2af2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:33.161353 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08898b9a-22b8-4dac-b7f1-cd593f3f2af2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:33.189230 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1399/2817] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:06:33 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:06:33.193259 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822b814-19e6-4ffd-be71-0affb9d947ff None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:33.204513 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822b814-19e6-4ffd-be71-0affb9d947ff None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:33.235955 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:33.265487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63e726-11a2-4b9b-a143-726e2f2397d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:33.266242 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63e726-11a2-4b9b-a143-726e2f2397d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:33.266532 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63e726-11a2-4b9b-a143-726e2f2397d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:33.266951 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63e726-11a2-4b9b-a143-726e2f2397d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:33.267613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63e726-11a2-4b9b-a143-726e2f2397d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:33.269627 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63e726-11a2-4b9b-a143-726e2f2397d2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:33.295413 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1419/2818] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:06:33 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:06:33.296686 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08898b9a-22b8-4dac-b7f1-cd593f3f2af2 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:33.308604 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08898b9a-22b8-4dac-b7f1-cd593f3f2af2 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:33.313928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c91b4-b6fa-4355-8fd2-9d79312fce71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:33.314554 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c91b4-b6fa-4355-8fd2-9d79312fce71 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:33.314837 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c91b4-b6fa-4355-8fd2-9d79312fce71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:33.315115 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c91b4-b6fa-4355-8fd2-9d79312fce71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:33.315770 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c91b4-b6fa-4355-8fd2-9d79312fce71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:33.317457 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c91b4-b6fa-4355-8fd2-9d79312fce71 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:33.333615 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1400/2819] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:06:33.334498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63e726-11a2-4b9b-a143-726e2f2397d2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:33.345794 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63e726-11a2-4b9b-a143-726e2f2397d2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:33.350822 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0de63-1b90-4aa3-a73f-49b1b571c11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:33.351566 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0de63-1b90-4aa3-a73f-49b1b571c11f admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:33.351858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0de63-1b90-4aa3-a73f-49b1b571c11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:33.352822 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea0de63-1b90-4aa3-a73f-49b1b571c11f admin admin] PATH_INFO: `/v3/projects/1811600f7d43494ba32a940e4204108a/users/198e408d5a0348bb8cc6a3fe7ce3779c/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:33.371395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0de63-1b90-4aa3-a73f-49b1b571c11f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1811600f7d43494ba32a940e4204108a, user_id=198e408d5a0348bb8cc6a3fe7ce3779c, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:33.374292 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea0de63-1b90-4aa3-a73f-49b1b571c11f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:33.389128 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1420/2820] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:06:33 2022] PUT /identity/v3/projects/1811600f7d43494ba32a940e4204108a/users/198e408d5a0348bb8cc6a3fe7ce3779c/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:33.392999 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c91b4-b6fa-4355-8fd2-9d79312fce71 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:33.403707 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c91b4-b6fa-4355-8fd2-9d79312fce71 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:33.465333 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838ac78-36dd-445e-97f3-54248e8f2b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:33.466094 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838ac78-36dd-445e-97f3-54248e8f2b35 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:33.466384 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838ac78-36dd-445e-97f3-54248e8f2b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:33.466661 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838ac78-36dd-445e-97f3-54248e8f2b35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:33.467310 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838ac78-36dd-445e-97f3-54248e8f2b35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:33.468953 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838ac78-36dd-445e-97f3-54248e8f2b35 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:33.480246 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1401/2821] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:06:33.484594 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0de63-1b90-4aa3-a73f-49b1b571c11f admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:33.495589 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea0de63-1b90-4aa3-a73f-49b1b571c11f admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:33.500691 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa62da-818c-4a6b-affa-77d1535b9708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:33.501343 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa62da-818c-4a6b-affa-77d1535b9708 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:33.501643 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa62da-818c-4a6b-affa-77d1535b9708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:33.501973 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa62da-818c-4a6b-affa-77d1535b9708 admin admin] PATH_INFO: `/v3/projects/1811600f7d43494ba32a940e4204108a/users/198e408d5a0348bb8cc6a3fe7ce3779c/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:33.503924 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa62da-818c-4a6b-affa-77d1535b9708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1811600f7d43494ba32a940e4204108a, user_id=198e408d5a0348bb8cc6a3fe7ce3779c, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:33.506561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa62da-818c-4a6b-affa-77d1535b9708 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:33.517453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1421/2822] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:06:33 2022] PUT /identity/v3/projects/1811600f7d43494ba32a940e4204108a/users/198e408d5a0348bb8cc6a3fe7ce3779c/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:33.529721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f732f-4336-4be1-9df9-ad8d9cd59b6b None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:33.530073 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f732f-4336-4be1-9df9-ad8d9cd59b6b None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:33.530281 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f732f-4336-4be1-9df9-ad8d9cd59b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:33.563625 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-993f732f-4336-4be1-9df9-ad8d9cd59b6b None None] MFA Rules not processed for user `198e408d5a0348bb8cc6a3fe7ce3779c`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:33.564877 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-993f732f-4336-4be1-9df9-ad8d9cd59b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:33.591627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:33.650418 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1402/2823] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:33.663171 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa62da-818c-4a6b-affa-77d1535b9708 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:33.665485 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-cdaa62da-818c-4a6b-affa-77d1535b9708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:33.746008 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa62da-818c-4a6b-affa-77d1535b9708 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:33.750613 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c219d9e-0ad1-4488-a426-ef6a14eb6e7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:33.751370 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c219d9e-0ad1-4488-a426-ef6a14eb6e7a service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:33.751699 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c219d9e-0ad1-4488-a426-ef6a14eb6e7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:33.751977 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c219d9e-0ad1-4488-a426-ef6a14eb6e7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:33.762706 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c219d9e-0ad1-4488-a426-ef6a14eb6e7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:33.764197 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c219d9e-0ad1-4488-a426-ef6a14eb6e7a service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:33.774962 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1422/2824] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:06:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:06:33.853033 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f732f-4336-4be1-9df9-ad8d9cd59b6b None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:33.863050 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f732f-4336-4be1-9df9-ad8d9cd59b6b None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:33.866687 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9dd34-aa56-4b60-aedd-8ca95c389bdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:33.867285 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9dd34-aa56-4b60-aedd-8ca95c389bdb service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:33.867604 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9dd34-aa56-4b60-aedd-8ca95c389bdb service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:33.867978 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9dd34-aa56-4b60-aedd-8ca95c389bdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:33.927615 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9dd34-aa56-4b60-aedd-8ca95c389bdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:33.929103 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9dd34-aa56-4b60-aedd-8ca95c389bdb service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:33.938623 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1403/2825] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:06:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:06:36.755840 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c219d9e-0ad1-4488-a426-ef6a14eb6e7a service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:36.819288 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c219d9e-0ad1-4488-a426-ef6a14eb6e7a service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:36.825010 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4a5fc-fd3d-46ec-8ed0-29f77a81c4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:36.825696 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4a5fc-fd3d-46ec-8ed0-29f77a81c4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:36.825979 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4a5fc-fd3d-46ec-8ed0-29f77a81c4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:36.826256 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4a5fc-fd3d-46ec-8ed0-29f77a81c4ee admin admin] PATH_INFO: `/v3/users/27cb563293814cf7846ef9c2f8278143` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:36.827428 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4a5fc-fd3d-46ec-8ed0-29f77a81c4ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=27cb563293814cf7846ef9c2f8278143)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:36.829418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4a5fc-fd3d-46ec-8ed0-29f77a81c4ee admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:36.868759 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:36.886059 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-aff4a5fc-fd3d-46ec-8ed0-29f77a81c4ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27cb563293814cf7846ef9c2f8278143'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:36.894657 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-aff4a5fc-fd3d-46ec-8ed0-29f77a81c4ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27cb563293814cf7846ef9c2f8278143'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:36.908614 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-aff4a5fc-fd3d-46ec-8ed0-29f77a81c4ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27cb563293814cf7846ef9c2f8278143'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:36.909558 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-aff4a5fc-fd3d-46ec-8ed0-29f77a81c4ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27cb563293814cf7846ef9c2f8278143'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:36.910413 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-aff4a5fc-fd3d-46ec-8ed0-29f77a81c4ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27cb563293814cf7846ef9c2f8278143'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:36.925408 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1423/2826] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:06:36 2022] DELETE /identity/v3/users/27cb563293814cf7846ef9c2f8278143 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:36.930031 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692995b-f735-4a3a-95c1-6519f318b5ea None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:36.931543 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692995b-f735-4a3a-95c1-6519f318b5ea None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:36.932557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692995b-f735-4a3a-95c1-6519f318b5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:36.973454 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-3692995b-f735-4a3a-95c1-6519f318b5ea None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:36.974679 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3692995b-f735-4a3a-95c1-6519f318b5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:37.038060 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1404/2827] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:37.065609 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4a5fc-fd3d-46ec-8ed0-29f77a81c4ee admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:37.067692 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-aff4a5fc-fd3d-46ec-8ed0-29f77a81c4ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:37.132041 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4a5fc-fd3d-46ec-8ed0-29f77a81c4ee admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:37.136457 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3228c-98a7-46d0-bb2c-5b040cefee17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:37.137074 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3228c-98a7-46d0-bb2c-5b040cefee17 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:37.137353 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3228c-98a7-46d0-bb2c-5b040cefee17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:37.137625 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3228c-98a7-46d0-bb2c-5b040cefee17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:37.146940 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3228c-98a7-46d0-bb2c-5b040cefee17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:37.148399 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3228c-98a7-46d0-bb2c-5b040cefee17 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:37.159521 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1424/2828] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:06:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:06:37.570100 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692995b-f735-4a3a-95c1-6519f318b5ea None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:37.572411 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-3692995b-f735-4a3a-95c1-6519f318b5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:37.643636 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3228c-98a7-46d0-bb2c-5b040cefee17 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:37.645334 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-fba3228c-98a7-46d0-bb2c-5b040cefee17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:37.679298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=100 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:37.680644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3228c-98a7-46d0-bb2c-5b040cefee17 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:37.686817 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3c8ba-420e-4d70-a1b7-641aad14a785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:37.687599 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3c8ba-420e-4d70-a1b7-641aad14a785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:37.687907 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3c8ba-420e-4d70-a1b7-641aad14a785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:37.688214 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3c8ba-420e-4d70-a1b7-641aad14a785 admin admin] PATH_INFO: `/v3/projects/c56791e4e12d4915bdaab60ad42ea4c4` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:37.690018 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3c8ba-420e-4d70-a1b7-641aad14a785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c56791e4e12d4915bdaab60ad42ea4c4)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:37.703015 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3c8ba-420e-4d70-a1b7-641aad14a785 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:37.709519 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692995b-f735-4a3a-95c1-6519f318b5ea None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:37.716570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec2cc1-b6b5-4d04-a18b-f430ababeb14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc28d9a1b3f4feca0deeb5f266f8b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:37.717317 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec2cc1-b6b5-4d04-a18b-f430ababeb14 service placement] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:37.717600 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec2cc1-b6b5-4d04-a18b-f430ababeb14 service placement] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:37.717881 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec2cc1-b6b5-4d04-a18b-f430ababeb14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:37.720341 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-84ec2cc1-b6b5-4d04-a18b-f430ababeb14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:37.733227 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec2cc1-b6b5-4d04-a18b-f430ababeb14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:37.734839 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec2cc1-b6b5-4d04-a18b-f430ababeb14 service placement] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:37.747199 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1405/2829] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:06:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:06:37.771058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4ed3c8ba-420e-4d70-a1b7-641aad14a785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c56791e4e12d4915bdaab60ad42ea4c4', 'request_id': 'req-4ed3c8ba-420e-4d70-a1b7-641aad14a785'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:37.783506 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4ed3c8ba-420e-4d70-a1b7-641aad14a785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c56791e4e12d4915bdaab60ad42ea4c4', 'request_id': 'req-4ed3c8ba-420e-4d70-a1b7-641aad14a785'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:37.789774 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4ed3c8ba-420e-4d70-a1b7-641aad14a785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c56791e4e12d4915bdaab60ad42ea4c4', 'request_id': 'req-4ed3c8ba-420e-4d70-a1b7-641aad14a785'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:37.801106 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4ed3c8ba-420e-4d70-a1b7-641aad14a785 admin admin] The token cache is being invalidate because project c56791e4e12d4915bdaab60ad42ea4c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:06:37.801391 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4ed3c8ba-420e-4d70-a1b7-641aad14a785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:37.802033 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-4ed3c8ba-420e-4d70-a1b7-641aad14a785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:37.803499 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1425/2830] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:06:37 2022] DELETE /identity/v3/projects/c56791e4e12d4915bdaab60ad42ea4c4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:37.807545 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec2cc1-b6b5-4d04-a18b-f430ababeb14 service placement] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:37.818607 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec2cc1-b6b5-4d04-a18b-f430ababeb14 service placement] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:37.877365 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6d8cb-028c-4b67-ac22-a36e098e5720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:37.878123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6d8cb-028c-4b67-ac22-a36e098e5720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:37.879106 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6d8cb-028c-4b67-ac22-a36e098e5720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:37.879106 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6d8cb-028c-4b67-ac22-a36e098e5720 admin admin] PATH_INFO: `/v3/users/198e408d5a0348bb8cc6a3fe7ce3779c` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:37.881070 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6d8cb-028c-4b67-ac22-a36e098e5720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=198e408d5a0348bb8cc6a3fe7ce3779c)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:37.883001 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6d8cb-028c-4b67-ac22-a36e098e5720 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:37.936367 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-01d6d8cb-028c-4b67-ac22-a36e098e5720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '198e408d5a0348bb8cc6a3fe7ce3779c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:37.946649 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-01d6d8cb-028c-4b67-ac22-a36e098e5720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '198e408d5a0348bb8cc6a3fe7ce3779c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:37.947419 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-01d6d8cb-028c-4b67-ac22-a36e098e5720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '198e408d5a0348bb8cc6a3fe7ce3779c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:37.948160 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-01d6d8cb-028c-4b67-ac22-a36e098e5720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '198e408d5a0348bb8cc6a3fe7ce3779c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:37.957126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-01d6d8cb-028c-4b67-ac22-a36e098e5720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '198e408d5a0348bb8cc6a3fe7ce3779c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:37.978611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1406/2831] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:06:37 2022] DELETE /identity/v3/users/198e408d5a0348bb8cc6a3fe7ce3779c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:38.267364 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3c8ba-420e-4d70-a1b7-641aad14a785 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:38.268979 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4ed3c8ba-420e-4d70-a1b7-641aad14a785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:38.298036 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3c8ba-420e-4d70-a1b7-641aad14a785 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:38.356506 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:38.397898 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfaa48-820b-4606-abfa-cecacf37eb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:38.398554 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfaa48-820b-4606-abfa-cecacf37eb37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:38.398978 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfaa48-820b-4606-abfa-cecacf37eb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:38.399255 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfaa48-820b-4606-abfa-cecacf37eb37 admin admin] PATH_INFO: `/v3/projects/1811600f7d43494ba32a940e4204108a` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:38.400439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadfaa48-820b-4606-abfa-cecacf37eb37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1811600f7d43494ba32a940e4204108a)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:38.402361 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadfaa48-820b-4606-abfa-cecacf37eb37 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:38.453739 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-eadfaa48-820b-4606-abfa-cecacf37eb37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1811600f7d43494ba32a940e4204108a', 'request_id': 'req-eadfaa48-820b-4606-abfa-cecacf37eb37'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:38.461084 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-eadfaa48-820b-4606-abfa-cecacf37eb37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1811600f7d43494ba32a940e4204108a', 'request_id': 'req-eadfaa48-820b-4606-abfa-cecacf37eb37'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:38.467655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-eadfaa48-820b-4606-abfa-cecacf37eb37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1811600f7d43494ba32a940e4204108a', 'request_id': 'req-eadfaa48-820b-4606-abfa-cecacf37eb37'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:38.479926 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-eadfaa48-820b-4606-abfa-cecacf37eb37 admin admin] The token cache is being invalidate because project 1811600f7d43494ba32a940e4204108a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:06:38.480239 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-eadfaa48-820b-4606-abfa-cecacf37eb37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:38.480894 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-eadfaa48-820b-4606-abfa-cecacf37eb37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:38.482375 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1426/2832] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:06:38 2022] DELETE /identity/v3/projects/1811600f7d43494ba32a940e4204108a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:06:38.487174 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1ab6a-24f3-4915-bf71-b4fe33953fed None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:38.487540 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1ab6a-24f3-4915-bf71-b4fe33953fed None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:38.487892 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1ab6a-24f3-4915-bf71-b4fe33953fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:38.510357 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-b4f1ab6a-24f3-4915-bf71-b4fe33953fed None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:38.511949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-b4f1ab6a-24f3-4915-bf71-b4fe33953fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:38.577803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1407/2833] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:06:38.585265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8545b3d-c9a8-4c7f-8e9b-2059cb96f075 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:38.585552 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8545b3d-c9a8-4c7f-8e9b-2059cb96f075 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:38.585829 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8545b3d-c9a8-4c7f-8e9b-2059cb96f075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:38.607231 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-f8545b3d-c9a8-4c7f-8e9b-2059cb96f075 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:38.609060 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-f8545b3d-c9a8-4c7f-8e9b-2059cb96f075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:38.619031 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1427/2834] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:06:38.623007 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1ab6a-24f3-4915-bf71-b4fe33953fed None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:38.633684 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1ab6a-24f3-4915-bf71-b4fe33953fed None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:38.641440 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c0823-60ee-4499-a7b7-6132e506b14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:38.642084 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c0823-60ee-4499-a7b7-6132e506b14c admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:38.642365 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c0823-60ee-4499-a7b7-6132e506b14c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:38.642646 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c0823-60ee-4499-a7b7-6132e506b14c admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:38.643307 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c0823-60ee-4499-a7b7-6132e506b14c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:06:38.643615 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c0823-60ee-4499-a7b7-6132e506b14c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:38.645271 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c0823-60ee-4499-a7b7-6132e506b14c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:38.647008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:38.664088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1408/2835] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:06:38.669385 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8545b3d-c9a8-4c7f-8e9b-2059cb96f075 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:38.679551 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8545b3d-c9a8-4c7f-8e9b-2059cb96f075 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:38.686678 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472b459-9514-4e46-8e51-4c395fc45f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:38.687306 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472b459-9514-4e46-8e51-4c395fc45f38 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:38.687753 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472b459-9514-4e46-8e51-4c395fc45f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:38.688051 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472b459-9514-4e46-8e51-4c395fc45f38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:38.688703 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472b459-9514-4e46-8e51-4c395fc45f38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:38.690632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472b459-9514-4e46-8e51-4c395fc45f38 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:38.723736 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1428/2836] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:06:38 2022] POST /identity/v3/projects => generated 389 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:06:38.728537 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c0823-60ee-4499-a7b7-6132e506b14c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:38.738963 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c0823-60ee-4499-a7b7-6132e506b14c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:38.808256 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ce50e-412a-4e61-8045-560898a94838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:38.808949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ce50e-412a-4e61-8045-560898a94838 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:38.809300 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ce50e-412a-4e61-8045-560898a94838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:38.809677 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ce50e-412a-4e61-8045-560898a94838 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:38.810388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ce50e-412a-4e61-8045-560898a94838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:38.812421 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ce50e-412a-4e61-8045-560898a94838 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:38.835062 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1409/2837] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:06:38 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:06:38.839103 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472b459-9514-4e46-8e51-4c395fc45f38 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:38.849778 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472b459-9514-4e46-8e51-4c395fc45f38 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:38.854796 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b002b44-1ec3-434b-bf5c-6c310e485735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:38.855403 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b002b44-1ec3-434b-bf5c-6c310e485735 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:38.855803 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b002b44-1ec3-434b-bf5c-6c310e485735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:38.856124 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b002b44-1ec3-434b-bf5c-6c310e485735 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:38.856772 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b002b44-1ec3-434b-bf5c-6c310e485735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:38.858366 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b002b44-1ec3-434b-bf5c-6c310e485735 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:38.869310 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1429/2838] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:06:38.873447 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ce50e-412a-4e61-8045-560898a94838 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:38.884366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ce50e-412a-4e61-8045-560898a94838 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:38.890191 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ae53f-2d90-4df7-acd8-a9ea4aa6699e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:38.890792 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ae53f-2d90-4df7-acd8-a9ea4aa6699e admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:38.891067 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ae53f-2d90-4df7-acd8-a9ea4aa6699e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:38.891335 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ae53f-2d90-4df7-acd8-a9ea4aa6699e admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:38.891968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ae53f-2d90-4df7-acd8-a9ea4aa6699e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:38.894243 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ae53f-2d90-4df7-acd8-a9ea4aa6699e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:38.905307 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1410/2839] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:06:38.909458 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b002b44-1ec3-434b-bf5c-6c310e485735 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:38.920555 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b002b44-1ec3-434b-bf5c-6c310e485735 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:38.925159 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2e40b-7516-42b0-954f-cb93afcb41f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:38.925939 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2e40b-7516-42b0-954f-cb93afcb41f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:38.926211 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2e40b-7516-42b0-954f-cb93afcb41f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:38.926491 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2e40b-7516-42b0-954f-cb93afcb41f9 admin admin] PATH_INFO: `/v3/projects/b50b9d0660cd46f1833676d3f46ba589/users/389bf5b14b7744018d95257d530d6bce/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:38.942588 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2e40b-7516-42b0-954f-cb93afcb41f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b50b9d0660cd46f1833676d3f46ba589, user_id=389bf5b14b7744018d95257d530d6bce, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:38.945529 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2e40b-7516-42b0-954f-cb93afcb41f9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:38.959463 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1430/2840] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:06:38 2022] PUT /identity/v3/projects/b50b9d0660cd46f1833676d3f46ba589/users/389bf5b14b7744018d95257d530d6bce/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:06:38.970296 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84910c0e-3453-4276-8bf4-4d4572fad10e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:38.970783 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84910c0e-3453-4276-8bf4-4d4572fad10e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:38.971018 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84910c0e-3453-4276-8bf4-4d4572fad10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:39.000031 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-84910c0e-3453-4276-8bf4-4d4572fad10e None None] MFA Rules not processed for user `389bf5b14b7744018d95257d530d6bce`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:39.001269 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-84910c0e-3453-4276-8bf4-4d4572fad10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:39.067263 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1411/2841] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:39.072156 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2e40b-7516-42b0-954f-cb93afcb41f9 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:39.142153 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2e40b-7516-42b0-954f-cb93afcb41f9 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:39.146942 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70135d92-4f00-450f-9edc-572a3b4d01f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:39.147630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70135d92-4f00-450f-9edc-572a3b4d01f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:39.147980 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70135d92-4f00-450f-9edc-572a3b4d01f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:39.148445 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70135d92-4f00-450f-9edc-572a3b4d01f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:39.149092 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70135d92-4f00-450f-9edc-572a3b4d01f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:39.151012 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70135d92-4f00-450f-9edc-572a3b4d01f1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:39.156567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:39.187464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1431/2842] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:06:39 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:06:39.189657 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84910c0e-3453-4276-8bf4-4d4572fad10e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:39.202195 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84910c0e-3453-4276-8bf4-4d4572fad10e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:39.269795 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62534074-3717-4cf3-84ff-01dc6001d45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:39.270553 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62534074-3717-4cf3-84ff-01dc6001d45c admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:39.270905 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62534074-3717-4cf3-84ff-01dc6001d45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:39.271250 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62534074-3717-4cf3-84ff-01dc6001d45c admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:39.271965 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62534074-3717-4cf3-84ff-01dc6001d45c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:39.274268 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62534074-3717-4cf3-84ff-01dc6001d45c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:39.290825 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:39.312083 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1412/2843] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:06:39 2022] POST /identity/v3/users => generated 301 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:06:39.315894 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70135d92-4f00-450f-9edc-572a3b4d01f1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:39.327223 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70135d92-4f00-450f-9edc-572a3b4d01f1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:39.332251 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7400e-8698-419b-8bff-332558cfd361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:39.332986 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7400e-8698-419b-8bff-332558cfd361 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:39.333336 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7400e-8698-419b-8bff-332558cfd361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:39.333685 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7400e-8698-419b-8bff-332558cfd361 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:39.334410 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7400e-8698-419b-8bff-332558cfd361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:39.336167 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7400e-8698-419b-8bff-332558cfd361 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:39.348154 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1432/2844] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:06:39.353053 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62534074-3717-4cf3-84ff-01dc6001d45c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:39.363928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62534074-3717-4cf3-84ff-01dc6001d45c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:39.370012 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a35f49-0b92-4fc3-ad5e-a0454e369eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:39.370711 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35f49-0b92-4fc3-ad5e-a0454e369eea admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:39.370994 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35f49-0b92-4fc3-ad5e-a0454e369eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:39.371259 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35f49-0b92-4fc3-ad5e-a0454e369eea admin admin] PATH_INFO: `/v3/projects/f882af09d76142dfb1a7b44457898287/users/6a9012d0f3f9437a9d17c96665e5c377/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:39.387693 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a35f49-0b92-4fc3-ad5e-a0454e369eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f882af09d76142dfb1a7b44457898287, user_id=6a9012d0f3f9437a9d17c96665e5c377, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:39.390471 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a35f49-0b92-4fc3-ad5e-a0454e369eea admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:39.405857 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1413/2845] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:06:39 2022] PUT /identity/v3/projects/f882af09d76142dfb1a7b44457898287/users/6a9012d0f3f9437a9d17c96665e5c377/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:39.409758 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7400e-8698-419b-8bff-332558cfd361 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:39.420778 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7400e-8698-419b-8bff-332558cfd361 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:39.487060 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1292e6-0144-48df-88fa-e4e250375350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:39.487820 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1292e6-0144-48df-88fa-e4e250375350 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:39.488501 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1292e6-0144-48df-88fa-e4e250375350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:39.488712 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1292e6-0144-48df-88fa-e4e250375350 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:39.489541 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1292e6-0144-48df-88fa-e4e250375350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:39.491380 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1292e6-0144-48df-88fa-e4e250375350 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:39.504068 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1433/2846] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:06:39.507190 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a35f49-0b92-4fc3-ad5e-a0454e369eea admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:39.522008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a35f49-0b92-4fc3-ad5e-a0454e369eea admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:39.527532 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a9943-1fc2-4308-a182-824061d9aa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:39.528542 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a9943-1fc2-4308-a182-824061d9aa02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:39.529012 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a9943-1fc2-4308-a182-824061d9aa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:39.529461 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a9943-1fc2-4308-a182-824061d9aa02 admin admin] PATH_INFO: `/v3/projects/f882af09d76142dfb1a7b44457898287/users/6a9012d0f3f9437a9d17c96665e5c377/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:39.531568 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a9943-1fc2-4308-a182-824061d9aa02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f882af09d76142dfb1a7b44457898287, user_id=6a9012d0f3f9437a9d17c96665e5c377, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:39.534421 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a9943-1fc2-4308-a182-824061d9aa02 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:39.552476 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1414/2847] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:06:39 2022] PUT /identity/v3/projects/f882af09d76142dfb1a7b44457898287/users/6a9012d0f3f9437a9d17c96665e5c377/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:39.557961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b65880-0fbe-4bca-ad28-dfde93d8cacf None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:39.558252 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b65880-0fbe-4bca-ad28-dfde93d8cacf None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:39.558530 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b65880-0fbe-4bca-ad28-dfde93d8cacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:39.589984 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e4b65880-0fbe-4bca-ad28-dfde93d8cacf None None] MFA Rules not processed for user `6a9012d0f3f9437a9d17c96665e5c377`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:39.591228 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e4b65880-0fbe-4bca-ad28-dfde93d8cacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:39.682158 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1434/2848] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:39 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:39.692842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a9943-1fc2-4308-a182-824061d9aa02 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:39.694708 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-364a9943-1fc2-4308-a182-824061d9aa02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:39.766129 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a9943-1fc2-4308-a182-824061d9aa02 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:39.771313 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697c450-b5e7-46ad-ac4d-707af5c3f442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:39.772279 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697c450-b5e7-46ad-ac4d-707af5c3f442 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:39.772583 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697c450-b5e7-46ad-ac4d-707af5c3f442 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:39.772839 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697c450-b5e7-46ad-ac4d-707af5c3f442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:39.784926 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697c450-b5e7-46ad-ac4d-707af5c3f442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:39.786388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697c450-b5e7-46ad-ac4d-707af5c3f442 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:39.798819 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1415/2849] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:06:39 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:06:39.937457 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b65880-0fbe-4bca-ad28-dfde93d8cacf None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:39.995683 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:40.002291 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b65880-0fbe-4bca-ad28-dfde93d8cacf None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:40.007290 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe0121-2f58-49a7-b3ac-f882b60b08f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:40.007932 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe0121-2f58-49a7-b3ac-f882b60b08f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:40.008863 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe0121-2f58-49a7-b3ac-f882b60b08f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:40.009147 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe0121-2f58-49a7-b3ac-f882b60b08f6 admin admin] PATH_INFO: `/v3/users/389bf5b14b7744018d95257d530d6bce` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:40.010337 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe0121-2f58-49a7-b3ac-f882b60b08f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=389bf5b14b7744018d95257d530d6bce)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:40.012376 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe0121-2f58-49a7-b3ac-f882b60b08f6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:40.060236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bffe0121-2f58-49a7-b3ac-f882b60b08f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '389bf5b14b7744018d95257d530d6bce'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:40.067693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bffe0121-2f58-49a7-b3ac-f882b60b08f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '389bf5b14b7744018d95257d530d6bce'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:40.081086 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bffe0121-2f58-49a7-b3ac-f882b60b08f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '389bf5b14b7744018d95257d530d6bce'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:40.081859 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bffe0121-2f58-49a7-b3ac-f882b60b08f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '389bf5b14b7744018d95257d530d6bce'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:40.082547 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-bffe0121-2f58-49a7-b3ac-f882b60b08f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '389bf5b14b7744018d95257d530d6bce'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:40.095858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1435/2850] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:06:39 2022] DELETE /identity/v3/users/389bf5b14b7744018d95257d530d6bce => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:40.100488 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed80325-c739-487f-ac71-9e1dc282e63e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:40.100951 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed80325-c739-487f-ac71-9e1dc282e63e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:40.100951 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed80325-c739-487f-ac71-9e1dc282e63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:40.122073 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-0ed80325-c739-487f-ac71-9e1dc282e63e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:40.123412 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0ed80325-c739-487f-ac71-9e1dc282e63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:40.191603 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1416/2851] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:40.204111 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe0121-2f58-49a7-b3ac-f882b60b08f6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:40.209812 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-bffe0121-2f58-49a7-b3ac-f882b60b08f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:40.313675 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe0121-2f58-49a7-b3ac-f882b60b08f6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:40.317342 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7292a-3e1f-451c-8b95-6e26bf037ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:40.317957 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7292a-3e1f-451c-8b95-6e26bf037ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:40.318248 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7292a-3e1f-451c-8b95-6e26bf037ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:40.318516 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7292a-3e1f-451c-8b95-6e26bf037ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:40.332227 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7292a-3e1f-451c-8b95-6e26bf037ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:40.333684 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7292a-3e1f-451c-8b95-6e26bf037ea1 service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:40.345203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1436/2852] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:06:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:06:40.932061 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed80325-c739-487f-ac71-9e1dc282e63e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:40.933691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-0ed80325-c739-487f-ac71-9e1dc282e63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:40.951340 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed80325-c739-487f-ac71-9e1dc282e63e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:40.956425 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacb630-fa8b-4018-979e-b914e0d7495a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:40.957371 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacb630-fa8b-4018-979e-b914e0d7495a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:40.957658 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacb630-fa8b-4018-979e-b914e0d7495a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:40.957936 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacb630-fa8b-4018-979e-b914e0d7495a admin admin] PATH_INFO: `/v3/users/1e65692e4d7b40b7b75c15d7b681cf44` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:40.959304 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bacb630-fa8b-4018-979e-b914e0d7495a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e65692e4d7b40b7b75c15d7b681cf44)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:40.961870 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bacb630-fa8b-4018-979e-b914e0d7495a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:41.020545 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6bacb630-fa8b-4018-979e-b914e0d7495a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e65692e4d7b40b7b75c15d7b681cf44'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.024870 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:41.029777 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6bacb630-fa8b-4018-979e-b914e0d7495a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e65692e4d7b40b7b75c15d7b681cf44'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.030574 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6bacb630-fa8b-4018-979e-b914e0d7495a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e65692e4d7b40b7b75c15d7b681cf44'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.031226 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6bacb630-fa8b-4018-979e-b914e0d7495a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e65692e4d7b40b7b75c15d7b681cf44'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.041453 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-6bacb630-fa8b-4018-979e-b914e0d7495a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e65692e4d7b40b7b75c15d7b681cf44'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.059788 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1417/2853] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:06:40 2022] DELETE /identity/v3/users/1e65692e4d7b40b7b75c15d7b681cf44 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:41.095056 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7292a-3e1f-451c-8b95-6e26bf037ea1 service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:41.097173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ffc7292a-3e1f-451c-8b95-6e26bf037ea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:41.114180 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7292a-3e1f-451c-8b95-6e26bf037ea1 service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:41.178920 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ffe3b-e942-4140-bc49-5c7ca9e250e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:41.179554 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ffe3b-e942-4140-bc49-5c7ca9e250e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:41.179852 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ffe3b-e942-4140-bc49-5c7ca9e250e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:41.180937 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5ffe3b-e942-4140-bc49-5c7ca9e250e7 admin admin] PATH_INFO: `/v3/projects/b50b9d0660cd46f1833676d3f46ba589` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:41.182100 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ffe3b-e942-4140-bc49-5c7ca9e250e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b50b9d0660cd46f1833676d3f46ba589)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:41.184243 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5ffe3b-e942-4140-bc49-5c7ca9e250e7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:41.205929 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:41.236649 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0d5ffe3b-e942-4140-bc49-5c7ca9e250e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b50b9d0660cd46f1833676d3f46ba589', 'request_id': 'req-0d5ffe3b-e942-4140-bc49-5c7ca9e250e7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.244639 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0d5ffe3b-e942-4140-bc49-5c7ca9e250e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b50b9d0660cd46f1833676d3f46ba589', 'request_id': 'req-0d5ffe3b-e942-4140-bc49-5c7ca9e250e7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.247664 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacb630-fa8b-4018-979e-b914e0d7495a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:41.249225 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-6bacb630-fa8b-4018-979e-b914e0d7495a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:41.252359 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0d5ffe3b-e942-4140-bc49-5c7ca9e250e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b50b9d0660cd46f1833676d3f46ba589', 'request_id': 'req-0d5ffe3b-e942-4140-bc49-5c7ca9e250e7'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.265382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacb630-fa8b-4018-979e-b914e0d7495a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:41.266244 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0d5ffe3b-e942-4140-bc49-5c7ca9e250e7 admin admin] The token cache is being invalidate because project b50b9d0660cd46f1833676d3f46ba589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:06:41.266631 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0d5ffe3b-e942-4140-bc49-5c7ca9e250e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.267716 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0d5ffe3b-e942-4140-bc49-5c7ca9e250e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.272694 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1437/2854] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:06:41 2022] DELETE /identity/v3/projects/b50b9d0660cd46f1833676d3f46ba589 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:41.274359 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ffe3b-e942-4140-bc49-5c7ca9e250e7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:41.275918 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0d5ffe3b-e942-4140-bc49-5c7ca9e250e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:41.337017 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f9bd9-23c6-4e29-83de-5e57da1b7b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:41.338386 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f9bd9-23c6-4e29-83de-5e57da1b7b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:41.339268 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f9bd9-23c6-4e29-83de-5e57da1b7b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:41.339550 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f9bd9-23c6-4e29-83de-5e57da1b7b00 admin admin] PATH_INFO: `/v3/projects/635e766a8c754ae09a1f248d901c7582` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:41.340913 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f9bd9-23c6-4e29-83de-5e57da1b7b00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=635e766a8c754ae09a1f248d901c7582)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:41.342895 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f9bd9-23c6-4e29-83de-5e57da1b7b00 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:41.362622 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5ffe3b-e942-4140-bc49-5c7ca9e250e7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:41.367860 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd3c2c-efd6-46c7-a3f3-be32b03fa267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:41.368650 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd3c2c-efd6-46c7-a3f3-be32b03fa267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:41.369385 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd3c2c-efd6-46c7-a3f3-be32b03fa267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:41.369730 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd3c2c-efd6-46c7-a3f3-be32b03fa267 admin admin] PATH_INFO: `/v3/users/6a9012d0f3f9437a9d17c96665e5c377` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:41.371071 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd3c2c-efd6-46c7-a3f3-be32b03fa267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a9012d0f3f9437a9d17c96665e5c377)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:41.373465 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd3c2c-efd6-46c7-a3f3-be32b03fa267 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:41.398231 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-573f9bd9-23c6-4e29-83de-5e57da1b7b00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '635e766a8c754ae09a1f248d901c7582', 'request_id': 'req-573f9bd9-23c6-4e29-83de-5e57da1b7b00'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.406991 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-573f9bd9-23c6-4e29-83de-5e57da1b7b00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '635e766a8c754ae09a1f248d901c7582', 'request_id': 'req-573f9bd9-23c6-4e29-83de-5e57da1b7b00'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.414148 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-573f9bd9-23c6-4e29-83de-5e57da1b7b00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '635e766a8c754ae09a1f248d901c7582', 'request_id': 'req-573f9bd9-23c6-4e29-83de-5e57da1b7b00'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.427332 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-573f9bd9-23c6-4e29-83de-5e57da1b7b00 admin admin] The token cache is being invalidate because project 635e766a8c754ae09a1f248d901c7582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:06:41.427723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-573f9bd9-23c6-4e29-83de-5e57da1b7b00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.428496 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-573f9bd9-23c6-4e29-83de-5e57da1b7b00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.431177 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1418/2855] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:06:41 2022] DELETE /identity/v3/projects/635e766a8c754ae09a1f248d901c7582 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:06:41.435013 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f9bd9-23c6-4e29-83de-5e57da1b7b00 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:41.437319 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-573f9bd9-23c6-4e29-83de-5e57da1b7b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:41.440240 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0dbd3c2c-efd6-46c7-a3f3-be32b03fa267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a9012d0f3f9437a9d17c96665e5c377'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.449476 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0dbd3c2c-efd6-46c7-a3f3-be32b03fa267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a9012d0f3f9437a9d17c96665e5c377'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.463954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0dbd3c2c-efd6-46c7-a3f3-be32b03fa267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a9012d0f3f9437a9d17c96665e5c377'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.464781 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0dbd3c2c-efd6-46c7-a3f3-be32b03fa267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a9012d0f3f9437a9d17c96665e5c377'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.466019 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-0dbd3c2c-efd6-46c7-a3f3-be32b03fa267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a9012d0f3f9437a9d17c96665e5c377'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.479142 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1438/2856] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:06:41 2022] DELETE /identity/v3/users/6a9012d0f3f9437a9d17c96665e5c377 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:41.506602 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f9bd9-23c6-4e29-83de-5e57da1b7b00 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:41.510822 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:41.569809 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8669e-7873-40a9-99e6-1f90d459f8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:41.571003 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8669e-7873-40a9-99e6-1f90d459f8c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:41.571237 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8669e-7873-40a9-99e6-1f90d459f8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:41.571509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8669e-7873-40a9-99e6-1f90d459f8c4 admin admin] PATH_INFO: `/v3/users/2f62a3f5525f4cff9bddd8f28554dd3f` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:41.572699 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8669e-7873-40a9-99e6-1f90d459f8c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f62a3f5525f4cff9bddd8f28554dd3f)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:41.574627 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8669e-7873-40a9-99e6-1f90d459f8c4 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:41.623664 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cbf8669e-7873-40a9-99e6-1f90d459f8c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f62a3f5525f4cff9bddd8f28554dd3f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.633635 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cbf8669e-7873-40a9-99e6-1f90d459f8c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f62a3f5525f4cff9bddd8f28554dd3f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.634533 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cbf8669e-7873-40a9-99e6-1f90d459f8c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f62a3f5525f4cff9bddd8f28554dd3f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.635027 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cbf8669e-7873-40a9-99e6-1f90d459f8c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f62a3f5525f4cff9bddd8f28554dd3f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.642825 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-cbf8669e-7873-40a9-99e6-1f90d459f8c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f62a3f5525f4cff9bddd8f28554dd3f'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.661042 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1419/2857] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:06:41 2022] DELETE /identity/v3/users/2f62a3f5525f4cff9bddd8f28554dd3f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:41.757806 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd3c2c-efd6-46c7-a3f3-be32b03fa267 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:41.760075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0dbd3c2c-efd6-46c7-a3f3-be32b03fa267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:41.775817 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd3c2c-efd6-46c7-a3f3-be32b03fa267 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:41.802916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:41.841798 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be041de-dd49-4494-bc3b-d56a7d2d9f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:41.842516 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be041de-dd49-4494-bc3b-d56a7d2d9f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:41.842723 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8669e-7873-40a9-99e6-1f90d459f8c4 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:41.842944 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be041de-dd49-4494-bc3b-d56a7d2d9f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:41.843296 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be041de-dd49-4494-bc3b-d56a7d2d9f24 admin admin] PATH_INFO: `/v3/projects/f882af09d76142dfb1a7b44457898287` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:41.844396 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cbf8669e-7873-40a9-99e6-1f90d459f8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:41.844702 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be041de-dd49-4494-bc3b-d56a7d2d9f24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f882af09d76142dfb1a7b44457898287)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:41.846961 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be041de-dd49-4494-bc3b-d56a7d2d9f24 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:41.859012 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8669e-7873-40a9-99e6-1f90d459f8c4 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:41.864546 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92cc44-09bf-46a6-b87d-c8102b1d9650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:41.865370 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92cc44-09bf-46a6-b87d-c8102b1d9650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:41.865836 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92cc44-09bf-46a6-b87d-c8102b1d9650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:41.866178 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92cc44-09bf-46a6-b87d-c8102b1d9650 admin admin] PATH_INFO: `/v3/projects/7228fa77a84f4a1a9a79b1627eff49ce` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:41.868008 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92cc44-09bf-46a6-b87d-c8102b1d9650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7228fa77a84f4a1a9a79b1627eff49ce)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:41.870254 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92cc44-09bf-46a6-b87d-c8102b1d9650 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:41.907303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6be041de-dd49-4494-bc3b-d56a7d2d9f24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f882af09d76142dfb1a7b44457898287', 'request_id': 'req-6be041de-dd49-4494-bc3b-d56a7d2d9f24'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.915473 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6be041de-dd49-4494-bc3b-d56a7d2d9f24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f882af09d76142dfb1a7b44457898287', 'request_id': 'req-6be041de-dd49-4494-bc3b-d56a7d2d9f24'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.921959 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6be041de-dd49-4494-bc3b-d56a7d2d9f24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f882af09d76142dfb1a7b44457898287', 'request_id': 'req-6be041de-dd49-4494-bc3b-d56a7d2d9f24'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.922144 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2a92cc44-09bf-46a6-b87d-c8102b1d9650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7228fa77a84f4a1a9a79b1627eff49ce', 'request_id': 'req-2a92cc44-09bf-46a6-b87d-c8102b1d9650'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.929490 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2a92cc44-09bf-46a6-b87d-c8102b1d9650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7228fa77a84f4a1a9a79b1627eff49ce', 'request_id': 'req-2a92cc44-09bf-46a6-b87d-c8102b1d9650'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.934250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6be041de-dd49-4494-bc3b-d56a7d2d9f24 admin admin] The token cache is being invalidate because project f882af09d76142dfb1a7b44457898287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:06:41.934541 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6be041de-dd49-4494-bc3b-d56a7d2d9f24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.935185 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-6be041de-dd49-4494-bc3b-d56a7d2d9f24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.936155 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2a92cc44-09bf-46a6-b87d-c8102b1d9650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7228fa77a84f4a1a9a79b1627eff49ce', 'request_id': 'req-2a92cc44-09bf-46a6-b87d-c8102b1d9650'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.936903 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1439/2858] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:06:41 2022] DELETE /identity/v3/projects/f882af09d76142dfb1a7b44457898287 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:41.941447 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f0c69-e040-4cf7-b32e-9f598f12d39e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:41.941737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f0c69-e040-4cf7-b32e-9f598f12d39e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:41.942014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f0c69-e040-4cf7-b32e-9f598f12d39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:41.948815 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2a92cc44-09bf-46a6-b87d-c8102b1d9650 admin admin] The token cache is being invalidate because project 7228fa77a84f4a1a9a79b1627eff49ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:06:41.949109 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2a92cc44-09bf-46a6-b87d-c8102b1d9650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.949783 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-2a92cc44-09bf-46a6-b87d-c8102b1d9650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:41.951285 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1420/2859] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:06:41 2022] DELETE /identity/v3/projects/7228fa77a84f4a1a9a79b1627eff49ce => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:06:41.965315 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-0a8f0c69-e040-4cf7-b32e-9f598f12d39e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:41.966556 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-0a8f0c69-e040-4cf7-b32e-9f598f12d39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:42.031373 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1440/2860] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:06:42.039659 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbd4b1-310b-4249-a682-436330d4bc79 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:42.039926 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbd4b1-310b-4249-a682-436330d4bc79 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:42.040212 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdbd4b1-310b-4249-a682-436330d4bc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:42.061832 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-2cdbd4b1-310b-4249-a682-436330d4bc79 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:42.063145 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-2cdbd4b1-310b-4249-a682-436330d4bc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:42.072274 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1421/2861] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:42.076743 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f0c69-e040-4cf7-b32e-9f598f12d39e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:42.087111 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f0c69-e040-4cf7-b32e-9f598f12d39e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:42.092081 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7be394-8d0a-4802-833b-f2bf60c30cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:42.092709 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7be394-8d0a-4802-833b-f2bf60c30cdb admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:42.092986 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7be394-8d0a-4802-833b-f2bf60c30cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:42.093277 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7be394-8d0a-4802-833b-f2bf60c30cdb admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:42.093917 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7be394-8d0a-4802-833b-f2bf60c30cdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:06:42.094220 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7be394-8d0a-4802-833b-f2bf60c30cdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:42.095841 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7be394-8d0a-4802-833b-f2bf60c30cdb admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:42.112639 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1441/2862] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:06:42.113816 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbd4b1-310b-4249-a682-436330d4bc79 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:42.118961 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:42.126169 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdbd4b1-310b-4249-a682-436330d4bc79 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:42.132634 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb7d91-1bd6-44b4-a439-ec3639dfc5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:42.133399 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb7d91-1bd6-44b4-a439-ec3639dfc5df admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:42.133754 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb7d91-1bd6-44b4-a439-ec3639dfc5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:42.134102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb7d91-1bd6-44b4-a439-ec3639dfc5df admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:42.134831 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb7d91-1bd6-44b4-a439-ec3639dfc5df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:42.136925 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb7d91-1bd6-44b4-a439-ec3639dfc5df admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:42.171881 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1422/2863] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:06:42 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:06:42.173090 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7be394-8d0a-4802-833b-f2bf60c30cdb admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:42.184765 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7be394-8d0a-4802-833b-f2bf60c30cdb admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:42.238918 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:42.258908 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d2045-62c4-45ff-b110-ab13eace3c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:42.259628 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d2045-62c4-45ff-b110-ab13eace3c23 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:42.259973 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d2045-62c4-45ff-b110-ab13eace3c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:42.260347 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d2045-62c4-45ff-b110-ab13eace3c23 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:42.261058 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d2045-62c4-45ff-b110-ab13eace3c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:42.263084 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d2045-62c4-45ff-b110-ab13eace3c23 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:42.287663 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1442/2864] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:06:42 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:06:42.289791 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb7d91-1bd6-44b4-a439-ec3639dfc5df admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:42.301033 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb7d91-1bd6-44b4-a439-ec3639dfc5df admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:42.311640 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85fdd8-0a3f-430a-a002-f53ab9878aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:42.312282 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85fdd8-0a3f-430a-a002-f53ab9878aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:42.312560 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85fdd8-0a3f-430a-a002-f53ab9878aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:42.312830 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85fdd8-0a3f-430a-a002-f53ab9878aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:42.313469 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85fdd8-0a3f-430a-a002-f53ab9878aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:42.315063 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85fdd8-0a3f-430a-a002-f53ab9878aa3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:42.325606 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1423/2865] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:06:42.329614 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d2045-62c4-45ff-b110-ab13eace3c23 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:42.339428 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d2045-62c4-45ff-b110-ab13eace3c23 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:42.344074 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d06126-03f2-445a-8345-67d146a4724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:42.344614 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d06126-03f2-445a-8345-67d146a4724f admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:42.344891 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d06126-03f2-445a-8345-67d146a4724f admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:42.345163 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d06126-03f2-445a-8345-67d146a4724f admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:42.345799 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d06126-03f2-445a-8345-67d146a4724f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:42.347362 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d06126-03f2-445a-8345-67d146a4724f admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:42.358446 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1443/2866] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:06:42.362492 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85fdd8-0a3f-430a-a002-f53ab9878aa3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:42.373116 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85fdd8-0a3f-430a-a002-f53ab9878aa3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:42.377797 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03557f39-9c68-41c3-9da1-fbe2ec35c0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:42.378428 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03557f39-9c68-41c3-9da1-fbe2ec35c0b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:42.378709 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03557f39-9c68-41c3-9da1-fbe2ec35c0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:42.378984 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03557f39-9c68-41c3-9da1-fbe2ec35c0b6 admin admin] PATH_INFO: `/v3/projects/31136bff17584cc0a88f5c908e82ba57/users/d9beded37ae24c01b5eda0ceb8a2eafd/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:42.393509 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03557f39-9c68-41c3-9da1-fbe2ec35c0b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31136bff17584cc0a88f5c908e82ba57, user_id=d9beded37ae24c01b5eda0ceb8a2eafd, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:42.396216 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03557f39-9c68-41c3-9da1-fbe2ec35c0b6 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:42.409787 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1424/2867] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:06:42 2022] PUT /identity/v3/projects/31136bff17584cc0a88f5c908e82ba57/users/d9beded37ae24c01b5eda0ceb8a2eafd/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:06:42.421291 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295394f-9d9f-4922-98cb-d082009fcb5c None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:42.421573 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295394f-9d9f-4922-98cb-d082009fcb5c None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:42.421849 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295394f-9d9f-4922-98cb-d082009fcb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:42.449742 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-6295394f-9d9f-4922-98cb-d082009fcb5c None None] MFA Rules not processed for user `d9beded37ae24c01b5eda0ceb8a2eafd`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:42.450954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-6295394f-9d9f-4922-98cb-d082009fcb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:42.514211 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1444/2868] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:06:42.519103 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03557f39-9c68-41c3-9da1-fbe2ec35c0b6 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:42.581677 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03557f39-9c68-41c3-9da1-fbe2ec35c0b6 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:42.586891 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eea02f-3cec-4e28-801a-329868abeaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:42.587522 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eea02f-3cec-4e28-801a-329868abeaab admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:42.587803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eea02f-3cec-4e28-801a-329868abeaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:42.588106 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eea02f-3cec-4e28-801a-329868abeaab admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:42.588748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eea02f-3cec-4e28-801a-329868abeaab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:42.590691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eea02f-3cec-4e28-801a-329868abeaab admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:42.617012 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1425/2869] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:06:42 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:06:42.621325 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295394f-9d9f-4922-98cb-d082009fcb5c None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:42.631878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295394f-9d9f-4922-98cb-d082009fcb5c None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:42.687136 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde59c6b-7b02-487b-bce1-ffef062c135c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:42.687737 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde59c6b-7b02-487b-bce1-ffef062c135c admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:42.688040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde59c6b-7b02-487b-bce1-ffef062c135c admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:42.688318 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde59c6b-7b02-487b-bce1-ffef062c135c admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:42.688954 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde59c6b-7b02-487b-bce1-ffef062c135c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:42.690862 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde59c6b-7b02-487b-bce1-ffef062c135c admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:42.711932 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1445/2870] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:06:42 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:06:42.715942 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eea02f-3cec-4e28-801a-329868abeaab admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:42.726121 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eea02f-3cec-4e28-801a-329868abeaab admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:42.731278 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3336aa4-4cd2-45bb-9c8f-ec8d7141a4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:42.731871 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3336aa4-4cd2-45bb-9c8f-ec8d7141a4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:42.732194 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3336aa4-4cd2-45bb-9c8f-ec8d7141a4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:42.732471 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3336aa4-4cd2-45bb-9c8f-ec8d7141a4a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:42.733135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3336aa4-4cd2-45bb-9c8f-ec8d7141a4a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:42.734735 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3336aa4-4cd2-45bb-9c8f-ec8d7141a4a5 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:42.745140 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1426/2871] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:06:42.749094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde59c6b-7b02-487b-bce1-ffef062c135c admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:42.759666 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde59c6b-7b02-487b-bce1-ffef062c135c admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:42.764365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01c089-3911-4871-93e2-a1819b670d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:42.765018 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01c089-3911-4871-93e2-a1819b670d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:42.765425 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01c089-3911-4871-93e2-a1819b670d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:42.765705 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01c089-3911-4871-93e2-a1819b670d45 admin admin] PATH_INFO: `/v3/projects/e63120dd4611492fbb7d63b6de026842/users/7dd919f31b7847bf99a139b819deafd5/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:42.781097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01c089-3911-4871-93e2-a1819b670d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e63120dd4611492fbb7d63b6de026842, user_id=7dd919f31b7847bf99a139b819deafd5, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:42.783728 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01c089-3911-4871-93e2-a1819b670d45 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:42.796929 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1446/2872] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:06:42 2022] PUT /identity/v3/projects/e63120dd4611492fbb7d63b6de026842/users/7dd919f31b7847bf99a139b819deafd5/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:42.800908 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3336aa4-4cd2-45bb-9c8f-ec8d7141a4a5 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:42.811068 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3336aa4-4cd2-45bb-9c8f-ec8d7141a4a5 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:42.867363 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1fc906-ed34-4220-8dd9-e20393c4b78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:42.868090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fc906-ed34-4220-8dd9-e20393c4b78f admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:42.868412 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fc906-ed34-4220-8dd9-e20393c4b78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:42.868688 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1fc906-ed34-4220-8dd9-e20393c4b78f admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:42.869319 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1fc906-ed34-4220-8dd9-e20393c4b78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:42.870919 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1fc906-ed34-4220-8dd9-e20393c4b78f admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:42.880847 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1427/2873] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:06:42.885548 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01c089-3911-4871-93e2-a1819b670d45 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:42.895771 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01c089-3911-4871-93e2-a1819b670d45 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:42.901093 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab30bca-2545-4f1c-8511-28443f5a55b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:42.901732 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab30bca-2545-4f1c-8511-28443f5a55b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:42.902008 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab30bca-2545-4f1c-8511-28443f5a55b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:42.902281 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab30bca-2545-4f1c-8511-28443f5a55b1 admin admin] PATH_INFO: `/v3/projects/e63120dd4611492fbb7d63b6de026842/users/7dd919f31b7847bf99a139b819deafd5/roles/be620fc7968740269d233c5ace94a563` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:42.904236 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab30bca-2545-4f1c-8511-28443f5a55b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e63120dd4611492fbb7d63b6de026842, user_id=7dd919f31b7847bf99a139b819deafd5, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:42.906857 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab30bca-2545-4f1c-8511-28443f5a55b1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:42.918051 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1447/2874] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:06:42 2022] PUT /identity/v3/projects/e63120dd4611492fbb7d63b6de026842/users/7dd919f31b7847bf99a139b819deafd5/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:06:42.982426 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be64fb-d8c0-4546-978d-0feb3da98579 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:42.982741 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be64fb-d8c0-4546-978d-0feb3da98579 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:42.983018 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be64fb-d8c0-4546-978d-0feb3da98579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:43.011934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-04be64fb-d8c0-4546-978d-0feb3da98579 None None] MFA Rules not processed for user `7dd919f31b7847bf99a139b819deafd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:43.013190 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-04be64fb-d8c0-4546-978d-0feb3da98579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:43.017163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:43.081800 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1428/2875] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:43.093686 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab30bca-2545-4f1c-8511-28443f5a55b1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:43.095414 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-eab30bca-2545-4f1c-8511-28443f5a55b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:43.102156 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:43.154278 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab30bca-2545-4f1c-8511-28443f5a55b1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:43.157916 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be1b83-8454-4291-a8bf-a430c81a2fe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:43.158516 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be1b83-8454-4291-a8bf-a430c81a2fe6 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:43.158798 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be1b83-8454-4291-a8bf-a430c81a2fe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:43.159067 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be1b83-8454-4291-a8bf-a430c81a2fe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:43.168200 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be1b83-8454-4291-a8bf-a430c81a2fe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:43.169630 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be1b83-8454-4291-a8bf-a430c81a2fe6 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:43.178990 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1448/2876] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:06:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:06:43.551732 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be64fb-d8c0-4546-978d-0feb3da98579 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:43.613278 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be64fb-d8c0-4546-978d-0feb3da98579 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:43.618460 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce505d-0e9f-4771-8ce5-5a4269fbd77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:43.619120 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce505d-0e9f-4771-8ce5-5a4269fbd77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:43.619404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce505d-0e9f-4771-8ce5-5a4269fbd77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:43.619704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce505d-0e9f-4771-8ce5-5a4269fbd77d admin admin] PATH_INFO: `/v3/users/d9beded37ae24c01b5eda0ceb8a2eafd` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:43.620910 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce505d-0e9f-4771-8ce5-5a4269fbd77d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9beded37ae24c01b5eda0ceb8a2eafd)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:43.622848 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce505d-0e9f-4771-8ce5-5a4269fbd77d admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:43.668516 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1fce505d-0e9f-4771-8ce5-5a4269fbd77d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9beded37ae24c01b5eda0ceb8a2eafd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:43.676683 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1fce505d-0e9f-4771-8ce5-5a4269fbd77d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9beded37ae24c01b5eda0ceb8a2eafd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:43.677551 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1fce505d-0e9f-4771-8ce5-5a4269fbd77d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9beded37ae24c01b5eda0ceb8a2eafd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:43.678224 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1fce505d-0e9f-4771-8ce5-5a4269fbd77d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9beded37ae24c01b5eda0ceb8a2eafd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:43.685868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1fce505d-0e9f-4771-8ce5-5a4269fbd77d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9beded37ae24c01b5eda0ceb8a2eafd'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:43.703720 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1429/2877] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:06:43 2022] DELETE /identity/v3/users/d9beded37ae24c01b5eda0ceb8a2eafd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:43.708383 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a3a3d-cae7-4a25-b626-bab8512d067d None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:43.708668 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a3a3d-cae7-4a25-b626-bab8512d067d None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:43.708943 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a3a3d-cae7-4a25-b626-bab8512d067d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:43.729008 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-956a3a3d-cae7-4a25-b626-bab8512d067d None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:43.730215 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-956a3a3d-cae7-4a25-b626-bab8512d067d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:43.786967 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1449/2878] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:43.796886 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce505d-0e9f-4771-8ce5-5a4269fbd77d admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:43.798366 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1fce505d-0e9f-4771-8ce5-5a4269fbd77d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:43.819752 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:43.856533 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce505d-0e9f-4771-8ce5-5a4269fbd77d admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:43.860206 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19df783-e31c-4559-beb0-73c403a8ad97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:43.860807 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19df783-e31c-4559-beb0-73c403a8ad97 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:43.861111 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19df783-e31c-4559-beb0-73c403a8ad97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:43.861388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19df783-e31c-4559-beb0-73c403a8ad97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:43.870388 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19df783-e31c-4559-beb0-73c403a8ad97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:43.871820 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19df783-e31c-4559-beb0-73c403a8ad97 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:43.881208 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1430/2879] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:06:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:06:44.152137 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a3a3d-cae7-4a25-b626-bab8512d067d None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:44.153618 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-956a3a3d-cae7-4a25-b626-bab8512d067d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:44.166155 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a3a3d-cae7-4a25-b626-bab8512d067d None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:44.171041 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e90c4e-2711-46e8-a0b1-4471c8b3d892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:44.171674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e90c4e-2711-46e8-a0b1-4471c8b3d892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:44.171948 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e90c4e-2711-46e8-a0b1-4471c8b3d892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:44.172269 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e90c4e-2711-46e8-a0b1-4471c8b3d892 admin admin] PATH_INFO: `/v3/projects/31136bff17584cc0a88f5c908e82ba57` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:44.173394 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e90c4e-2711-46e8-a0b1-4471c8b3d892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31136bff17584cc0a88f5c908e82ba57)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:44.175332 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e90c4e-2711-46e8-a0b1-4471c8b3d892 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:44.221885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d4e90c4e-2711-46e8-a0b1-4471c8b3d892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31136bff17584cc0a88f5c908e82ba57', 'request_id': 'req-d4e90c4e-2711-46e8-a0b1-4471c8b3d892'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:44.228443 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d4e90c4e-2711-46e8-a0b1-4471c8b3d892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31136bff17584cc0a88f5c908e82ba57', 'request_id': 'req-d4e90c4e-2711-46e8-a0b1-4471c8b3d892'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:44.234395 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d4e90c4e-2711-46e8-a0b1-4471c8b3d892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31136bff17584cc0a88f5c908e82ba57', 'request_id': 'req-d4e90c4e-2711-46e8-a0b1-4471c8b3d892'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:44.246291 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d4e90c4e-2711-46e8-a0b1-4471c8b3d892 admin admin] The token cache is being invalidate because project 31136bff17584cc0a88f5c908e82ba57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:06:44.246583 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d4e90c4e-2711-46e8-a0b1-4471c8b3d892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:44.247210 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d4e90c4e-2711-46e8-a0b1-4471c8b3d892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:44.248707 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1450/2880] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:06:44 2022] DELETE /identity/v3/projects/31136bff17584cc0a88f5c908e82ba57 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:44.252689 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19df783-e31c-4559-beb0-73c403a8ad97 service neutron] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:44.262977 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19df783-e31c-4559-beb0-73c403a8ad97 service neutron] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:44.321910 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64deac5-6219-47d5-8018-94a2781c70e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:44.322541 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64deac5-6219-47d5-8018-94a2781c70e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:44.322820 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64deac5-6219-47d5-8018-94a2781c70e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:44.323089 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64deac5-6219-47d5-8018-94a2781c70e2 admin admin] PATH_INFO: `/v3/users/7dd919f31b7847bf99a139b819deafd5` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:44.324232 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64deac5-6219-47d5-8018-94a2781c70e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd919f31b7847bf99a139b819deafd5)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:44.326151 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64deac5-6219-47d5-8018-94a2781c70e2 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:44.372850 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f64deac5-6219-47d5-8018-94a2781c70e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd919f31b7847bf99a139b819deafd5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:44.379697 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f64deac5-6219-47d5-8018-94a2781c70e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd919f31b7847bf99a139b819deafd5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:44.380371 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f64deac5-6219-47d5-8018-94a2781c70e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd919f31b7847bf99a139b819deafd5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:44.381019 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f64deac5-6219-47d5-8018-94a2781c70e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd919f31b7847bf99a139b819deafd5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:44.388568 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-f64deac5-6219-47d5-8018-94a2781c70e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd919f31b7847bf99a139b819deafd5'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:44.405909 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1431/2881] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:06:44 2022] DELETE /identity/v3/users/7dd919f31b7847bf99a139b819deafd5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:44.669732 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e90c4e-2711-46e8-a0b1-4471c8b3d892 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:44.671297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d4e90c4e-2711-46e8-a0b1-4471c8b3d892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:44.686341 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e90c4e-2711-46e8-a0b1-4471c8b3d892 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:44.721405 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:44.752584 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecec1d-b150-4cfe-9350-6067bbea640d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:44.753137 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecec1d-b150-4cfe-9350-6067bbea640d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:44.753418 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecec1d-b150-4cfe-9350-6067bbea640d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:44.753687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecec1d-b150-4cfe-9350-6067bbea640d admin admin] PATH_INFO: `/v3/projects/e63120dd4611492fbb7d63b6de026842` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:44.754816 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecec1d-b150-4cfe-9350-6067bbea640d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e63120dd4611492fbb7d63b6de026842)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:44.756762 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecec1d-b150-4cfe-9350-6067bbea640d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:44.803498 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d1ecec1d-b150-4cfe-9350-6067bbea640d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e63120dd4611492fbb7d63b6de026842', 'request_id': 'req-d1ecec1d-b150-4cfe-9350-6067bbea640d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:44.812718 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d1ecec1d-b150-4cfe-9350-6067bbea640d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e63120dd4611492fbb7d63b6de026842', 'request_id': 'req-d1ecec1d-b150-4cfe-9350-6067bbea640d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:44.818765 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d1ecec1d-b150-4cfe-9350-6067bbea640d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e63120dd4611492fbb7d63b6de026842', 'request_id': 'req-d1ecec1d-b150-4cfe-9350-6067bbea640d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:44.830946 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d1ecec1d-b150-4cfe-9350-6067bbea640d admin admin] The token cache is being invalidate because project e63120dd4611492fbb7d63b6de026842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:06:44.831234 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d1ecec1d-b150-4cfe-9350-6067bbea640d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:44.831902 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d1ecec1d-b150-4cfe-9350-6067bbea640d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:44.833457 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1451/2882] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:06:44 2022] DELETE /identity/v3/projects/e63120dd4611492fbb7d63b6de026842 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:44.839217 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91699dd-b3a7-42f8-b4a6-3226675ac14d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:44.839712 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91699dd-b3a7-42f8-b4a6-3226675ac14d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:44.839813 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91699dd-b3a7-42f8-b4a6-3226675ac14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:44.860591 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a91699dd-b3a7-42f8-b4a6-3226675ac14d None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:44.861818 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a91699dd-b3a7-42f8-b4a6-3226675ac14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:44.905012 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:44.928789 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1432/2883] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:44.939945 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db52db-8dba-419f-9a3e-c63577b63b0e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:44.940263 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db52db-8dba-419f-9a3e-c63577b63b0e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:44.940540 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db52db-8dba-419f-9a3e-c63577b63b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:44.965217 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-61db52db-8dba-419f-9a3e-c63577b63b0e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:44.966434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-61db52db-8dba-419f-9a3e-c63577b63b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:44.975075 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1452/2884] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:44.980164 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91699dd-b3a7-42f8-b4a6-3226675ac14d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:44.990455 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91699dd-b3a7-42f8-b4a6-3226675ac14d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:44.996266 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a764e-6024-4bc1-8ead-729cc54dea2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:44.996879 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a764e-6024-4bc1-8ead-729cc54dea2e admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:44.997163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a764e-6024-4bc1-8ead-729cc54dea2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:44.997441 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a764e-6024-4bc1-8ead-729cc54dea2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:44.998097 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a764e-6024-4bc1-8ead-729cc54dea2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:06:44.998405 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a764e-6024-4bc1-8ead-729cc54dea2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:45.000050 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a764e-6024-4bc1-8ead-729cc54dea2e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:45.012171 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1433/2885] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 09 21:06:45.018889 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db52db-8dba-419f-9a3e-c63577b63b0e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:45.034140 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db52db-8dba-419f-9a3e-c63577b63b0e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:45.039962 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74ac9c-b918-46ed-b43a-bf62ae640a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:45.041406 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74ac9c-b918-46ed-b43a-bf62ae640a1b admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:45.041406 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74ac9c-b918-46ed-b43a-bf62ae640a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:45.041406 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e74ac9c-b918-46ed-b43a-bf62ae640a1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:45.041869 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74ac9c-b918-46ed-b43a-bf62ae640a1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:45.043777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e74ac9c-b918-46ed-b43a-bf62ae640a1b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:45.073464 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1453/2886] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:06:45 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:06:45.077541 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a764e-6024-4bc1-8ead-729cc54dea2e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:45.089090 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a764e-6024-4bc1-8ead-729cc54dea2e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:45.152192 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faf034-c86b-4c53-9df9-d6f355ff2f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:45.152806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faf034-c86b-4c53-9df9-d6f355ff2f06 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:45.153088 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faf034-c86b-4c53-9df9-d6f355ff2f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:45.153367 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faf034-c86b-4c53-9df9-d6f355ff2f06 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:45.154009 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08faf034-c86b-4c53-9df9-d6f355ff2f06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:45.156329 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08faf034-c86b-4c53-9df9-d6f355ff2f06 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:45.182169 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1434/2887] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:06:45 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:06:45.186372 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74ac9c-b918-46ed-b43a-bf62ae640a1b admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:45.197715 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e74ac9c-b918-46ed-b43a-bf62ae640a1b admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:45.202531 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49073f3-616f-4986-be30-3ef74cbbe605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:45.203139 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49073f3-616f-4986-be30-3ef74cbbe605 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:45.203416 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49073f3-616f-4986-be30-3ef74cbbe605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:45.203687 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49073f3-616f-4986-be30-3ef74cbbe605 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:45.204375 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49073f3-616f-4986-be30-3ef74cbbe605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:45.206023 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49073f3-616f-4986-be30-3ef74cbbe605 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:45.218097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1454/2888] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:06:45.222333 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faf034-c86b-4c53-9df9-d6f355ff2f06 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:45.233276 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faf034-c86b-4c53-9df9-d6f355ff2f06 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:45.238704 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc700f60-fe8e-4cf9-929b-bac3166a32df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:45.239307 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc700f60-fe8e-4cf9-929b-bac3166a32df admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:45.239589 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc700f60-fe8e-4cf9-929b-bac3166a32df admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:45.239864 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc700f60-fe8e-4cf9-929b-bac3166a32df admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:45.240546 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc700f60-fe8e-4cf9-929b-bac3166a32df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:45.242163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc700f60-fe8e-4cf9-929b-bac3166a32df admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:45.257610 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1435/2889] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:06:45.263290 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49073f3-616f-4986-be30-3ef74cbbe605 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:45.275097 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49073f3-616f-4986-be30-3ef74cbbe605 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:45.280453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fef109-e8f3-429a-8a6c-7700097e30e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:45.281109 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fef109-e8f3-429a-8a6c-7700097e30e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:45.281387 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fef109-e8f3-429a-8a6c-7700097e30e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:45.281660 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fef109-e8f3-429a-8a6c-7700097e30e1 admin admin] PATH_INFO: `/v3/projects/a4eaee0159814377b6324774b1f9345c/users/cae54fea787048e6b1e75cdeba7dff32/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:45.299967 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fef109-e8f3-429a-8a6c-7700097e30e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4eaee0159814377b6324774b1f9345c, user_id=cae54fea787048e6b1e75cdeba7dff32, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:45.304872 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fef109-e8f3-429a-8a6c-7700097e30e1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:45.322842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1455/2890] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:06:45 2022] PUT /identity/v3/projects/a4eaee0159814377b6324774b1f9345c/users/cae54fea787048e6b1e75cdeba7dff32/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:45.335326 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07591426-42a3-4019-907e-8c2a72130e57 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:45.335685 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07591426-42a3-4019-907e-8c2a72130e57 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:45.336241 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07591426-42a3-4019-907e-8c2a72130e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:45.373024 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-07591426-42a3-4019-907e-8c2a72130e57 None None] MFA Rules not processed for user `cae54fea787048e6b1e75cdeba7dff32`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:45.374268 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-07591426-42a3-4019-907e-8c2a72130e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:45.450617 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1436/2891] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:45.462785 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fef109-e8f3-429a-8a6c-7700097e30e1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:45.465883 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-23fef109-e8f3-429a-8a6c-7700097e30e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:45.536851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fef109-e8f3-429a-8a6c-7700097e30e1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:45.540842 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763aaff6-ac4d-4880-bb73-c3bba5021ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:45.541439 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aaff6-ac4d-4880-bb73-c3bba5021ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:45.541716 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aaff6-ac4d-4880-bb73-c3bba5021ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:45.541989 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aaff6-ac4d-4880-bb73-c3bba5021ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:45.552150 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763aaff6-ac4d-4880-bb73-c3bba5021ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:45.553585 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763aaff6-ac4d-4880-bb73-c3bba5021ca4 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:45.558783 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:45.564180 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1456/2892] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:06:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:06:48.558611 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07591426-42a3-4019-907e-8c2a72130e57 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:48.598595 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:48.620998 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07591426-42a3-4019-907e-8c2a72130e57 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:48.625490 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed468c53-72da-4772-86e1-68c30dc9d26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:48.626154 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed468c53-72da-4772-86e1-68c30dc9d26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:48.626438 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed468c53-72da-4772-86e1-68c30dc9d26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:48.626716 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed468c53-72da-4772-86e1-68c30dc9d26e admin admin] PATH_INFO: `/v3/users/cae54fea787048e6b1e75cdeba7dff32` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:48.627866 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed468c53-72da-4772-86e1-68c30dc9d26e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cae54fea787048e6b1e75cdeba7dff32)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:48.629843 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed468c53-72da-4772-86e1-68c30dc9d26e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:48.675577 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ed468c53-72da-4772-86e1-68c30dc9d26e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cae54fea787048e6b1e75cdeba7dff32'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:48.683862 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ed468c53-72da-4772-86e1-68c30dc9d26e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cae54fea787048e6b1e75cdeba7dff32'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:48.684508 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ed468c53-72da-4772-86e1-68c30dc9d26e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cae54fea787048e6b1e75cdeba7dff32'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:48.685114 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ed468c53-72da-4772-86e1-68c30dc9d26e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cae54fea787048e6b1e75cdeba7dff32'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:48.691903 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-ed468c53-72da-4772-86e1-68c30dc9d26e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cae54fea787048e6b1e75cdeba7dff32'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:48.708538 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1437/2893] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:06:48 2022] DELETE /identity/v3/users/cae54fea787048e6b1e75cdeba7dff32 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:48.713584 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda166ac-7827-4852-842b-13bf63e9431e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:48.714091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda166ac-7827-4852-842b-13bf63e9431e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:48.714195 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda166ac-7827-4852-842b-13bf63e9431e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:48.733835 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-dda166ac-7827-4852-842b-13bf63e9431e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:48.735057 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dda166ac-7827-4852-842b-13bf63e9431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:48.794560 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1457/2894] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:48.804239 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed468c53-72da-4772-86e1-68c30dc9d26e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:48.805721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ed468c53-72da-4772-86e1-68c30dc9d26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:48.863417 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed468c53-72da-4772-86e1-68c30dc9d26e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:48.867026 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c351694-8777-4e99-a2ef-c98c3ecb2888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:48.867728 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c351694-8777-4e99-a2ef-c98c3ecb2888 service neutron] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:48.868033 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c351694-8777-4e99-a2ef-c98c3ecb2888 service neutron] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:48.868308 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c351694-8777-4e99-a2ef-c98c3ecb2888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:48.877248 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c351694-8777-4e99-a2ef-c98c3ecb2888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:48.878678 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c351694-8777-4e99-a2ef-c98c3ecb2888 service neutron] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:48.888579 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1438/2895] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:06:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:06:49.155055 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda166ac-7827-4852-842b-13bf63e9431e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:49.156545 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-dda166ac-7827-4852-842b-13bf63e9431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:49.169077 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda166ac-7827-4852-842b-13bf63e9431e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:49.173644 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8edb84-ef22-48ba-b136-e511b201428d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:49.174271 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8edb84-ef22-48ba-b136-e511b201428d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:49.174547 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8edb84-ef22-48ba-b136-e511b201428d admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:49.174813 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8edb84-ef22-48ba-b136-e511b201428d admin admin] PATH_INFO: `/v3/projects/a4eaee0159814377b6324774b1f9345c` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:49.175973 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8edb84-ef22-48ba-b136-e511b201428d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4eaee0159814377b6324774b1f9345c)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:49.177911 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8edb84-ef22-48ba-b136-e511b201428d admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:49.224104 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2b8edb84-ef22-48ba-b136-e511b201428d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4eaee0159814377b6324774b1f9345c', 'request_id': 'req-2b8edb84-ef22-48ba-b136-e511b201428d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:49.231422 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2b8edb84-ef22-48ba-b136-e511b201428d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4eaee0159814377b6324774b1f9345c', 'request_id': 'req-2b8edb84-ef22-48ba-b136-e511b201428d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:49.237144 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2b8edb84-ef22-48ba-b136-e511b201428d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4eaee0159814377b6324774b1f9345c', 'request_id': 'req-2b8edb84-ef22-48ba-b136-e511b201428d'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:49.248632 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2b8edb84-ef22-48ba-b136-e511b201428d admin admin] The token cache is being invalidate because project a4eaee0159814377b6324774b1f9345c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81397) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:06:49.248922 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2b8edb84-ef22-48ba-b136-e511b201428d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:49.249556 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-2b8edb84-ef22-48ba-b136-e511b201428d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:49.251040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1458/2896] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:06:49 2022] DELETE /identity/v3/projects/a4eaee0159814377b6324774b1f9345c => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:49.255914 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a32b5-36c5-406d-8e93-036517fbca9e None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:49.256283 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a32b5-36c5-406d-8e93-036517fbca9e None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:49.256559 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a32b5-36c5-406d-8e93-036517fbca9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:49.276349 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-400a32b5-36c5-406d-8e93-036517fbca9e None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:49.277550 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-400a32b5-36c5-406d-8e93-036517fbca9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:49.330803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:49.340701 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1439/2897] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:49.348385 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4fdda-0898-4b48-9a38-4bec77304685 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:49.348670 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4fdda-0898-4b48-9a38-4bec77304685 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:49.348941 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4fdda-0898-4b48-9a38-4bec77304685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:49.369777 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-4ba4fdda-0898-4b48-9a38-4bec77304685 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:49.370970 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-4ba4fdda-0898-4b48-9a38-4bec77304685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:49.378705 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1459/2898] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:49.382798 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a32b5-36c5-406d-8e93-036517fbca9e None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:49.393270 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a32b5-36c5-406d-8e93-036517fbca9e None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:49.397803 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c32d90-99dd-4f78-983d-3e6c3858d222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:49.398413 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c32d90-99dd-4f78-983d-3e6c3858d222 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:49.399276 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c32d90-99dd-4f78-983d-3e6c3858d222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:49.399739 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c32d90-99dd-4f78-983d-3e6c3858d222 admin admin] PATH_INFO: `/v3/domains` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:49.400431 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c32d90-99dd-4f78-983d-3e6c3858d222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81398) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:06:49.400721 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c32d90-99dd-4f78-983d-3e6c3858d222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:49.402317 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c32d90-99dd-4f78-983d-3e6c3858d222 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:49.413917 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1440/2899] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:06:49.418782 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4fdda-0898-4b48-9a38-4bec77304685 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:49.428113 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4fdda-0898-4b48-9a38-4bec77304685 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:49.432846 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71615eb7-8cd4-4f22-88a9-8a8b19844969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:49.433453 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71615eb7-8cd4-4f22-88a9-8a8b19844969 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:49.433728 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71615eb7-8cd4-4f22-88a9-8a8b19844969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:49.433996 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71615eb7-8cd4-4f22-88a9-8a8b19844969 admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:49.434634 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71615eb7-8cd4-4f22-88a9-8a8b19844969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:49.436595 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71615eb7-8cd4-4f22-88a9-8a8b19844969 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:49.463905 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1460/2900] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:06:49 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:06:49.467938 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c32d90-99dd-4f78-983d-3e6c3858d222 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:49.478613 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c32d90-99dd-4f78-983d-3e6c3858d222 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:49.535213 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c2189-5814-4535-aaf1-22a0728c0225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:49.535824 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c2189-5814-4535-aaf1-22a0728c0225 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:49.536139 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c2189-5814-4535-aaf1-22a0728c0225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:49.536413 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c2189-5814-4535-aaf1-22a0728c0225 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:49.537040 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c2189-5814-4535-aaf1-22a0728c0225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:49.539948 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c2189-5814-4535-aaf1-22a0728c0225 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:49.561051 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1441/2901] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:06:49 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:06:49.565333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71615eb7-8cd4-4f22-88a9-8a8b19844969 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:49.576069 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71615eb7-8cd4-4f22-88a9-8a8b19844969 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:49.580806 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58287a46-5dfb-4ecb-a53e-9f479bf351f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:49.581527 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58287a46-5dfb-4ecb-a53e-9f479bf351f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:49.581803 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58287a46-5dfb-4ecb-a53e-9f479bf351f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:49.582076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58287a46-5dfb-4ecb-a53e-9f479bf351f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:49.582710 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58287a46-5dfb-4ecb-a53e-9f479bf351f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:49.584332 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58287a46-5dfb-4ecb-a53e-9f479bf351f7 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:49.595237 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1461/2902] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:06:49.599235 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c2189-5814-4535-aaf1-22a0728c0225 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:49.610695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c2189-5814-4535-aaf1-22a0728c0225 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:49.615375 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff822c75-a74c-4c22-8faf-a7ce5fdf8407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:49.615975 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff822c75-a74c-4c22-8faf-a7ce5fdf8407 admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:49.616287 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff822c75-a74c-4c22-8faf-a7ce5fdf8407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:49.616563 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff822c75-a74c-4c22-8faf-a7ce5fdf8407 admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:49.617249 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff822c75-a74c-4c22-8faf-a7ce5fdf8407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:49.619059 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff822c75-a74c-4c22-8faf-a7ce5fdf8407 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:49.629663 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1442/2903] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:06:49.634400 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58287a46-5dfb-4ecb-a53e-9f479bf351f7 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:49.644305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58287a46-5dfb-4ecb-a53e-9f479bf351f7 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:49.649514 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088c86e-e2ed-4ac8-a951-e6778728bbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:49.650150 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088c86e-e2ed-4ac8-a951-e6778728bbe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:49.650424 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088c86e-e2ed-4ac8-a951-e6778728bbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:49.650693 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088c86e-e2ed-4ac8-a951-e6778728bbe1 admin admin] PATH_INFO: `/v3/projects/c52a0b9adaff48039180a722347fc922/users/f8525e198e7442e5a0447d1e91b4277e/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:49.665127 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088c86e-e2ed-4ac8-a951-e6778728bbe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c52a0b9adaff48039180a722347fc922, user_id=f8525e198e7442e5a0447d1e91b4277e, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:49.667780 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088c86e-e2ed-4ac8-a951-e6778728bbe1 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:49.680426 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1462/2904] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:06:49 2022] PUT /identity/v3/projects/c52a0b9adaff48039180a722347fc922/users/f8525e198e7442e5a0447d1e91b4277e/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:49.690603 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec90ae6-add3-46eb-ac24-770e84b53ca1 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:49.690895 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec90ae6-add3-46eb-ac24-770e84b53ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:49.691174 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec90ae6-add3-46eb-ac24-770e84b53ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:49.719556 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-cec90ae6-add3-46eb-ac24-770e84b53ca1 None None] MFA Rules not processed for user `f8525e198e7442e5a0447d1e91b4277e`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:49.720851 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-cec90ae6-add3-46eb-ac24-770e84b53ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:49.783792 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1443/2905] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:49.788482 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088c86e-e2ed-4ac8-a951-e6778728bbe1 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:49.809324 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:49.851561 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088c86e-e2ed-4ac8-a951-e6778728bbe1 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:49.856059 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ef0f4-c52d-42ae-8c88-4cfb403fe5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:49.856655 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ef0f4-c52d-42ae-8c88-4cfb403fe5ce admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:49.856928 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ef0f4-c52d-42ae-8c88-4cfb403fe5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:49.857198 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ef0f4-c52d-42ae-8c88-4cfb403fe5ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:49.857824 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ef0f4-c52d-42ae-8c88-4cfb403fe5ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:49.859714 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ef0f4-c52d-42ae-8c88-4cfb403fe5ce admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:49.886186 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1463/2906] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:06:49 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:06:49.890302 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec90ae6-add3-46eb-ac24-770e84b53ca1 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:49.901403 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec90ae6-add3-46eb-ac24-770e84b53ca1 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:49.950484 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:49.958279 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a609c65-0e5b-43b4-ac42-db1361e23586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:49.958898 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a609c65-0e5b-43b4-ac42-db1361e23586 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:49.959179 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a609c65-0e5b-43b4-ac42-db1361e23586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:49.959452 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a609c65-0e5b-43b4-ac42-db1361e23586 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:49.960123 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a609c65-0e5b-43b4-ac42-db1361e23586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:49.962264 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a609c65-0e5b-43b4-ac42-db1361e23586 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:49.983570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1444/2907] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:06:49 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:06:49.987567 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ef0f4-c52d-42ae-8c88-4cfb403fe5ce admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:49.998569 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ef0f4-c52d-42ae-8c88-4cfb403fe5ce admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:50.003121 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eab34-1649-47fe-88d4-e01f1d3d1ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:50.003717 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eab34-1649-47fe-88d4-e01f1d3d1ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:50.004008 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eab34-1649-47fe-88d4-e01f1d3d1ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:50.004286 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7eab34-1649-47fe-88d4-e01f1d3d1ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:50.004920 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7eab34-1649-47fe-88d4-e01f1d3d1ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:50.006521 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7eab34-1649-47fe-88d4-e01f1d3d1ff2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:50.018280 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1464/2908] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:06:50.022070 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a609c65-0e5b-43b4-ac42-db1361e23586 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:50.032393 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a609c65-0e5b-43b4-ac42-db1361e23586 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:50.037026 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a474e5-bc5d-4c3f-a1d4-75d67267022b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:50.037619 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a474e5-bc5d-4c3f-a1d4-75d67267022b admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:50.038158 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a474e5-bc5d-4c3f-a1d4-75d67267022b admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:50.038429 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a474e5-bc5d-4c3f-a1d4-75d67267022b admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:50.039102 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a474e5-bc5d-4c3f-a1d4-75d67267022b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:50.040899 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a474e5-bc5d-4c3f-a1d4-75d67267022b admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:50.050776 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1445/2909] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:06:50.055153 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eab34-1649-47fe-88d4-e01f1d3d1ff2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:50.065148 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7eab34-1649-47fe-88d4-e01f1d3d1ff2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:50.069816 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb458a-5c0c-42f7-a953-45f6af3550bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:50.071013 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb458a-5c0c-42f7-a953-45f6af3550bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:50.071297 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb458a-5c0c-42f7-a953-45f6af3550bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:50.071574 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb458a-5c0c-42f7-a953-45f6af3550bc admin admin] PATH_INFO: `/v3/projects/c818258ec53d4446b05ff42d24f757c3/users/df1e94fd222947ee980c53d1d5e07452/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:50.086011 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb458a-5c0c-42f7-a953-45f6af3550bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c818258ec53d4446b05ff42d24f757c3, user_id=df1e94fd222947ee980c53d1d5e07452, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:50.088701 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb458a-5c0c-42f7-a953-45f6af3550bc admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:50.100886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1465/2910] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:06:50 2022] PUT /identity/v3/projects/c818258ec53d4446b05ff42d24f757c3/users/df1e94fd222947ee980c53d1d5e07452/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:50.112539 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab423bd9-792c-45f0-8d08-1d0dc7fed13d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:50.112765 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab423bd9-792c-45f0-8d08-1d0dc7fed13d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:50.113072 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab423bd9-792c-45f0-8d08-1d0dc7fed13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:50.141384 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-ab423bd9-792c-45f0-8d08-1d0dc7fed13d None None] MFA Rules not processed for user `df1e94fd222947ee980c53d1d5e07452`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:50.142609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-ab423bd9-792c-45f0-8d08-1d0dc7fed13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:50.206949 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1446/2911] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 09 21:06:50.211425 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb458a-5c0c-42f7-a953-45f6af3550bc admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:50.272512 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb458a-5c0c-42f7-a953-45f6af3550bc admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:50.277311 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f9346-cf96-4542-a931-f391cf0ac24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:50.277901 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f9346-cf96-4542-a931-f391cf0ac24e admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:50.278173 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f9346-cf96-4542-a931-f391cf0ac24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:50.278442 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f9346-cf96-4542-a931-f391cf0ac24e admin admin] PATH_INFO: `/v3/projects` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:50.279094 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f9346-cf96-4542-a931-f391cf0ac24e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:50.281208 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f9346-cf96-4542-a931-f391cf0ac24e admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:50.309272 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1466/2912] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:06:50 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 09 21:06:50.313312 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab423bd9-792c-45f0-8d08-1d0dc7fed13d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:50.325288 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab423bd9-792c-45f0-8d08-1d0dc7fed13d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:50.380601 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a136851-5148-4cb4-9b62-8a18793d02a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:50.381133 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a136851-5148-4cb4-9b62-8a18793d02a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:50.381407 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a136851-5148-4cb4-9b62-8a18793d02a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:50.381676 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a136851-5148-4cb4-9b62-8a18793d02a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:50.382317 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a136851-5148-4cb4-9b62-8a18793d02a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:50.384849 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a136851-5148-4cb4-9b62-8a18793d02a7 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:50.405609 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1447/2913] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:06:50 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:06:50.410142 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f9346-cf96-4542-a931-f391cf0ac24e admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:50.421298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f9346-cf96-4542-a931-f391cf0ac24e admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:50.425886 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538df7a-8826-459c-8bfd-85d74e78ac07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:50.426475 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538df7a-8826-459c-8bfd-85d74e78ac07 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:50.426752 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538df7a-8826-459c-8bfd-85d74e78ac07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:50.427024 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a538df7a-8826-459c-8bfd-85d74e78ac07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:50.427663 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538df7a-8826-459c-8bfd-85d74e78ac07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:50.429287 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a538df7a-8826-459c-8bfd-85d74e78ac07 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:50.441320 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1467/2914] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 09 21:06:50.445742 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a136851-5148-4cb4-9b62-8a18793d02a7 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:50.455871 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a136851-5148-4cb4-9b62-8a18793d02a7 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:50.460547 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827f93a-ba56-469f-8c7f-f06a57cdef1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:50.461205 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827f93a-ba56-469f-8c7f-f06a57cdef1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:50.461532 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827f93a-ba56-469f-8c7f-f06a57cdef1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:50.461938 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2827f93a-ba56-469f-8c7f-f06a57cdef1c admin admin] PATH_INFO: `/v3/projects/54ec9a0becfe4c5ba71ca5b95c012fbf/users/7cbecba87b394d5aa95ac1026b346308/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:50.477194 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827f93a-ba56-469f-8c7f-f06a57cdef1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ec9a0becfe4c5ba71ca5b95c012fbf, user_id=7cbecba87b394d5aa95ac1026b346308, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:50.480091 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2827f93a-ba56-469f-8c7f-f06a57cdef1c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:50.493463 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1448/2915] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:06:50 2022] PUT /identity/v3/projects/54ec9a0becfe4c5ba71ca5b95c012fbf/users/7cbecba87b394d5aa95ac1026b346308/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:06:50.497452 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538df7a-8826-459c-8bfd-85d74e78ac07 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:50.507548 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a538df7a-8826-459c-8bfd-85d74e78ac07 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:50.548533 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:50.565468 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64bba5-2ab1-41eb-aa2d-0300195cde4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:50.566103 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64bba5-2ab1-41eb-aa2d-0300195cde4b admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:50.566382 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64bba5-2ab1-41eb-aa2d-0300195cde4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:50.566656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64bba5-2ab1-41eb-aa2d-0300195cde4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:50.567296 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64bba5-2ab1-41eb-aa2d-0300195cde4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:50.568919 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64bba5-2ab1-41eb-aa2d-0300195cde4b admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:50.578894 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1468/2916] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:06:50.583358 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827f93a-ba56-469f-8c7f-f06a57cdef1c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:50.593900 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2827f93a-ba56-469f-8c7f-f06a57cdef1c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:50.598543 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9e778-ed38-4b57-a3b4-93abf0815bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:50.599191 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9e778-ed38-4b57-a3b4-93abf0815bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:50.599477 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9e778-ed38-4b57-a3b4-93abf0815bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:50.599750 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9e778-ed38-4b57-a3b4-93abf0815bd3 admin admin] PATH_INFO: `/v3/projects/54ec9a0becfe4c5ba71ca5b95c012fbf/users/7cbecba87b394d5aa95ac1026b346308/roles/be620fc7968740269d233c5ace94a563` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:50.602323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9e778-ed38-4b57-a3b4-93abf0815bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54ec9a0becfe4c5ba71ca5b95c012fbf, user_id=7cbecba87b394d5aa95ac1026b346308, role_id=be620fc7968740269d233c5ace94a563)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:50.605033 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9e778-ed38-4b57-a3b4-93abf0815bd3 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:50.614997 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1449/2917] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:06:50 2022] PUT /identity/v3/projects/54ec9a0becfe4c5ba71ca5b95c012fbf/users/7cbecba87b394d5aa95ac1026b346308/roles/be620fc7968740269d233c5ace94a563 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:50.625753 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86decb6-b625-44a2-8024-2a572ff43370 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:50.626040 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86decb6-b625-44a2-8024-2a572ff43370 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:50.626339 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86decb6-b625-44a2-8024-2a572ff43370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:50.653858 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-a86decb6-b625-44a2-8024-2a572ff43370 None None] MFA Rules not processed for user `7cbecba87b394d5aa95ac1026b346308`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:50.655006 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a86decb6-b625-44a2-8024-2a572ff43370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:50.722306 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1469/2918] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:50.734219 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9e778-ed38-4b57-a3b4-93abf0815bd3 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:50.735923 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-46d9e778-ed38-4b57-a3b4-93abf0815bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:50.755162 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:50.794485 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9e778-ed38-4b57-a3b4-93abf0815bd3 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:50.798098 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1f2b0-5ab4-4e70-aef2-b50c02a6565b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:50.798693 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1f2b0-5ab4-4e70-aef2-b50c02a6565b service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:50.798971 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1f2b0-5ab4-4e70-aef2-b50c02a6565b service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:50.799241 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1f2b0-5ab4-4e70-aef2-b50c02a6565b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:50.854275 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1f2b0-5ab4-4e70-aef2-b50c02a6565b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:50.855695 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1f2b0-5ab4-4e70-aef2-b50c02a6565b service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:50.864476 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1450/2919] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:06:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:06:52.377435 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86decb6-b625-44a2-8024-2a572ff43370 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:52.378820 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-a86decb6-b625-44a2-8024-2a572ff43370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:52.390764 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86decb6-b625-44a2-8024-2a572ff43370 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:52.394303 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff6bd6-ee97-4352-81fd-6af1af326889 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:52.394898 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff6bd6-ee97-4352-81fd-6af1af326889 service cinder] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:52.395176 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff6bd6-ee97-4352-81fd-6af1af326889 service cinder] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:52.395448 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ff6bd6-ee97-4352-81fd-6af1af326889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:52.451975 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff6bd6-ee97-4352-81fd-6af1af326889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:52.453357 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ff6bd6-ee97-4352-81fd-6af1af326889 service cinder] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:52.462839 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1470/2920] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:06:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:06:52.972261 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1f2b0-5ab4-4e70-aef2-b50c02a6565b service cinder] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:52.980927 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1f2b0-5ab4-4e70-aef2-b50c02a6565b service cinder] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:52.984432 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6beaebc-019d-482c-a1fd-ea46f08da160 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:52.985023 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6beaebc-019d-482c-a1fd-ea46f08da160 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:52.985298 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6beaebc-019d-482c-a1fd-ea46f08da160 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:52.985570 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6beaebc-019d-482c-a1fd-ea46f08da160 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:52.994795 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6beaebc-019d-482c-a1fd-ea46f08da160 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:52.996252 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6beaebc-019d-482c-a1fd-ea46f08da160 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:53.005474 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1451/2921] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:06:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:06:56.881124 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff6bd6-ee97-4352-81fd-6af1af326889 service cinder] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:56.946000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ff6bd6-ee97-4352-81fd-6af1af326889 service cinder] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:56.950492 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d0f3c-6b92-40a4-946e-a65ada149dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:56.951108 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d0f3c-6b92-40a4-946e-a65ada149dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:56.951380 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d0f3c-6b92-40a4-946e-a65ada149dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:56.951648 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d0f3c-6b92-40a4-946e-a65ada149dda admin admin] PATH_INFO: `/v3/users/f8525e198e7442e5a0447d1e91b4277e` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:56.952781 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d0f3c-6b92-40a4-946e-a65ada149dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8525e198e7442e5a0447d1e91b4277e)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:56.954704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d0f3c-6b92-40a4-946e-a65ada149dda admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:56.959298 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=100 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:57.001885 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-760d0f3c-6b92-40a4-946e-a65ada149dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8525e198e7442e5a0447d1e91b4277e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:57.009487 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-760d0f3c-6b92-40a4-946e-a65ada149dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8525e198e7442e5a0447d1e91b4277e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:57.021305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-760d0f3c-6b92-40a4-946e-a65ada149dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8525e198e7442e5a0447d1e91b4277e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:57.021926 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-760d0f3c-6b92-40a4-946e-a65ada149dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8525e198e7442e5a0447d1e91b4277e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:57.022542 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-760d0f3c-6b92-40a4-946e-a65ada149dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8525e198e7442e5a0447d1e91b4277e'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:57.034375 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1471/2922] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:06:56 2022] DELETE /identity/v3/users/f8525e198e7442e5a0447d1e91b4277e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:57.039588 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346c4e0-61fd-4e7b-8c72-3991dd8af8ad None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:57.040085 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346c4e0-61fd-4e7b-8c72-3991dd8af8ad None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:57.040209 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346c4e0-61fd-4e7b-8c72-3991dd8af8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:57.059094 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-c346c4e0-61fd-4e7b-8c72-3991dd8af8ad None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:57.060322 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c346c4e0-61fd-4e7b-8c72-3991dd8af8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:57.119477 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1452/2923] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:57.129105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d0f3c-6b92-40a4-946e-a65ada149dda admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:57.130513 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-760d0f3c-6b92-40a4-946e-a65ada149dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:57.188851 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d0f3c-6b92-40a4-946e-a65ada149dda admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:57.192559 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215b68c-f9ca-4be3-8073-8a59a96fe2ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:57.193160 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215b68c-f9ca-4be3-8073-8a59a96fe2ec service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:57.193434 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215b68c-f9ca-4be3-8073-8a59a96fe2ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:57.193704 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215b68c-f9ca-4be3-8073-8a59a96fe2ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:57.203165 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215b68c-f9ca-4be3-8073-8a59a96fe2ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:57.204608 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215b68c-f9ca-4be3-8073-8a59a96fe2ec service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:57.214291 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1472/2924] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:06:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 09 21:06:57.478806 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346c4e0-61fd-4e7b-8c72-3991dd8af8ad None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:57.480339 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-c346c4e0-61fd-4e7b-8c72-3991dd8af8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:57.495934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346c4e0-61fd-4e7b-8c72-3991dd8af8ad None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:57.501413 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038431a-5177-476b-a393-124468cfc2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:57.502118 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038431a-5177-476b-a393-124468cfc2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:57.502351 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038431a-5177-476b-a393-124468cfc2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:57.502626 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038431a-5177-476b-a393-124468cfc2fb admin admin] PATH_INFO: `/v3/projects/c52a0b9adaff48039180a722347fc922` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:57.503934 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038431a-5177-476b-a393-124468cfc2fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c52a0b9adaff48039180a722347fc922)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:57.505880 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038431a-5177-476b-a393-124468cfc2fb admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:57.554587 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1038431a-5177-476b-a393-124468cfc2fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c52a0b9adaff48039180a722347fc922', 'request_id': 'req-1038431a-5177-476b-a393-124468cfc2fb'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:57.557171 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:57.562383 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1038431a-5177-476b-a393-124468cfc2fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c52a0b9adaff48039180a722347fc922', 'request_id': 'req-1038431a-5177-476b-a393-124468cfc2fb'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:57.569412 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1038431a-5177-476b-a393-124468cfc2fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c52a0b9adaff48039180a722347fc922', 'request_id': 'req-1038431a-5177-476b-a393-124468cfc2fb'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:57.580557 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1038431a-5177-476b-a393-124468cfc2fb admin admin] The token cache is being invalidate because project c52a0b9adaff48039180a722347fc922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:06:57.580846 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1038431a-5177-476b-a393-124468cfc2fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:57.581473 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-1038431a-5177-476b-a393-124468cfc2fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:57.582950 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1453/2925] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:06:57 2022] DELETE /identity/v3/projects/c52a0b9adaff48039180a722347fc922 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:57.587719 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215b68c-f9ca-4be3-8073-8a59a96fe2ec service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:57.597808 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215b68c-f9ca-4be3-8073-8a59a96fe2ec service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:57.654301 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0843b-0d11-41a4-9410-e797ebd43ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:57.654838 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0843b-0d11-41a4-9410-e797ebd43ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:57.655112 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0843b-0d11-41a4-9410-e797ebd43ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:57.655382 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0843b-0d11-41a4-9410-e797ebd43ba6 admin admin] PATH_INFO: `/v3/users/df1e94fd222947ee980c53d1d5e07452` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:57.656503 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0843b-0d11-41a4-9410-e797ebd43ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df1e94fd222947ee980c53d1d5e07452)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:57.658397 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0843b-0d11-41a4-9410-e797ebd43ba6 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:57.687019 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:57.705386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ceb0843b-0d11-41a4-9410-e797ebd43ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df1e94fd222947ee980c53d1d5e07452'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:57.712958 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ceb0843b-0d11-41a4-9410-e797ebd43ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df1e94fd222947ee980c53d1d5e07452'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:57.724569 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ceb0843b-0d11-41a4-9410-e797ebd43ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df1e94fd222947ee980c53d1d5e07452'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:57.725199 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ceb0843b-0d11-41a4-9410-e797ebd43ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df1e94fd222947ee980c53d1d5e07452'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:57.725806 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-ceb0843b-0d11-41a4-9410-e797ebd43ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df1e94fd222947ee980c53d1d5e07452'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:57.738329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1473/2926] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:06:57 2022] DELETE /identity/v3/users/df1e94fd222947ee980c53d1d5e07452 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:06:58.010539 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038431a-5177-476b-a393-124468cfc2fb admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:58.012016 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-1038431a-5177-476b-a393-124468cfc2fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:58.025993 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038431a-5177-476b-a393-124468cfc2fb admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:58.083190 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5b085-80b9-4812-92db-6c41cda9c13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:58.083842 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5b085-80b9-4812-92db-6c41cda9c13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:58.084117 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5b085-80b9-4812-92db-6c41cda9c13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:58.084392 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5b085-80b9-4812-92db-6c41cda9c13c admin admin] PATH_INFO: `/v3/projects/c818258ec53d4446b05ff42d24f757c3` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:58.085490 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5b085-80b9-4812-92db-6c41cda9c13c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c818258ec53d4446b05ff42d24f757c3)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:58.088316 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5b085-80b9-4812-92db-6c41cda9c13c admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:58.133338 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-79b5b085-80b9-4812-92db-6c41cda9c13c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c818258ec53d4446b05ff42d24f757c3', 'request_id': 'req-79b5b085-80b9-4812-92db-6c41cda9c13c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:58.140671 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-79b5b085-80b9-4812-92db-6c41cda9c13c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c818258ec53d4446b05ff42d24f757c3', 'request_id': 'req-79b5b085-80b9-4812-92db-6c41cda9c13c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:58.146258 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-79b5b085-80b9-4812-92db-6c41cda9c13c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c818258ec53d4446b05ff42d24f757c3', 'request_id': 'req-79b5b085-80b9-4812-92db-6c41cda9c13c'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:58.157604 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-79b5b085-80b9-4812-92db-6c41cda9c13c admin admin] The token cache is being invalidate because project c818258ec53d4446b05ff42d24f757c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:06:58.157890 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-79b5b085-80b9-4812-92db-6c41cda9c13c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:58.158506 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-79b5b085-80b9-4812-92db-6c41cda9c13c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:58.159970 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1454/2927] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:06:58 2022] DELETE /identity/v3/projects/c818258ec53d4446b05ff42d24f757c3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:58.164203 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0843b-0d11-41a4-9410-e797ebd43ba6 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:58.165674 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-ceb0843b-0d11-41a4-9410-e797ebd43ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:58.178301 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0843b-0d11-41a4-9410-e797ebd43ba6 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:58.234412 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ae04b-748a-4cb1-bbdf-d503f7957bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:58.235041 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ae04b-748a-4cb1-bbdf-d503f7957bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:58.235320 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ae04b-748a-4cb1-bbdf-d503f7957bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:58.235592 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ae04b-748a-4cb1-bbdf-d503f7957bf9 admin admin] PATH_INFO: `/v3/users/7cbecba87b394d5aa95ac1026b346308` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:58.236722 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ae04b-748a-4cb1-bbdf-d503f7957bf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cbecba87b394d5aa95ac1026b346308)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:58.238626 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ae04b-748a-4cb1-bbdf-d503f7957bf9 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:58.284046 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d14ae04b-748a-4cb1-bbdf-d503f7957bf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cbecba87b394d5aa95ac1026b346308'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:58.293932 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d14ae04b-748a-4cb1-bbdf-d503f7957bf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cbecba87b394d5aa95ac1026b346308'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:58.307785 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d14ae04b-748a-4cb1-bbdf-d503f7957bf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cbecba87b394d5aa95ac1026b346308'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:58.308516 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d14ae04b-748a-4cb1-bbdf-d503f7957bf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cbecba87b394d5aa95ac1026b346308'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:58.309152 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-d14ae04b-748a-4cb1-bbdf-d503f7957bf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cbecba87b394d5aa95ac1026b346308'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:58.321946 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1474/2928] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:06:58 2022] DELETE /identity/v3/users/7cbecba87b394d5aa95ac1026b346308 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:58.587318 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5b085-80b9-4812-92db-6c41cda9c13c admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:58.588841 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-79b5b085-80b9-4812-92db-6c41cda9c13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:58.602323 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5b085-80b9-4812-92db-6c41cda9c13c admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:58.659968 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843ef3c-cfb0-4a2a-a55f-fb4f1b5b9578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:58.660628 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843ef3c-cfb0-4a2a-a55f-fb4f1b5b9578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:58.660913 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843ef3c-cfb0-4a2a-a55f-fb4f1b5b9578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:58.661195 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843ef3c-cfb0-4a2a-a55f-fb4f1b5b9578 admin admin] PATH_INFO: `/v3/projects/54ec9a0becfe4c5ba71ca5b95c012fbf` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:58.662312 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843ef3c-cfb0-4a2a-a55f-fb4f1b5b9578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54ec9a0becfe4c5ba71ca5b95c012fbf)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:58.664726 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843ef3c-cfb0-4a2a-a55f-fb4f1b5b9578 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:58.682497 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:58.718928 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a843ef3c-cfb0-4a2a-a55f-fb4f1b5b9578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54ec9a0becfe4c5ba71ca5b95c012fbf', 'request_id': 'req-a843ef3c-cfb0-4a2a-a55f-fb4f1b5b9578'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:58.725897 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a843ef3c-cfb0-4a2a-a55f-fb4f1b5b9578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54ec9a0becfe4c5ba71ca5b95c012fbf', 'request_id': 'req-a843ef3c-cfb0-4a2a-a55f-fb4f1b5b9578'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:58.731650 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a843ef3c-cfb0-4a2a-a55f-fb4f1b5b9578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54ec9a0becfe4c5ba71ca5b95c012fbf', 'request_id': 'req-a843ef3c-cfb0-4a2a-a55f-fb4f1b5b9578'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:58.742598 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a843ef3c-cfb0-4a2a-a55f-fb4f1b5b9578 admin admin] The token cache is being invalidate because project 54ec9a0becfe4c5ba71ca5b95c012fbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:06:58.742887 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a843ef3c-cfb0-4a2a-a55f-fb4f1b5b9578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:58.743516 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-a843ef3c-cfb0-4a2a-a55f-fb4f1b5b9578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:06:58.745135 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1455/2929] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:06:58 2022] DELETE /identity/v3/projects/54ec9a0becfe4c5ba71ca5b95c012fbf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:58.749950 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987db41-58f6-4651-ae88-73bc58d6d4d4 None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:58.750242 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987db41-58f6-4651-ae88-73bc58d6d4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:58.750523 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987db41-58f6-4651-ae88-73bc58d6d4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:58.770417 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-e987db41-58f6-4651-ae88-73bc58d6d4d4 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:58.771617 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-e987db41-58f6-4651-ae88-73bc58d6d4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:58.791076 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:06:58.833089 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1475/2930] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:58.842751 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1853afe-992f-4b8d-aea9-b8a21f0580c0 None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:58.843038 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1853afe-992f-4b8d-aea9-b8a21f0580c0 None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:58.843315 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1853afe-992f-4b8d-aea9-b8a21f0580c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:58.862818 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-a1853afe-992f-4b8d-aea9-b8a21f0580c0 None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:58.864058 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-a1853afe-992f-4b8d-aea9-b8a21f0580c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:58.872010 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1456/2931] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:58.876250 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987db41-58f6-4651-ae88-73bc58d6d4d4 None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:58.886629 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987db41-58f6-4651-ae88-73bc58d6d4d4 None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:58.891174 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14e984-9071-479a-86bc-6bf44a5145fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:58.891778 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14e984-9071-479a-86bc-6bf44a5145fa admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:58.892091 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14e984-9071-479a-86bc-6bf44a5145fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:58.892371 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14e984-9071-479a-86bc-6bf44a5145fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:58.893022 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14e984-9071-479a-86bc-6bf44a5145fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81397) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 09 21:06:58.893329 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14e984-9071-479a-86bc-6bf44a5145fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:58.894931 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14e984-9071-479a-86bc-6bf44a5145fa admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:58.907264 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1476/2932] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Sep 9 21:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 09 21:06:58.911577 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1853afe-992f-4b8d-aea9-b8a21f0580c0 None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:58.922036 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1853afe-992f-4b8d-aea9-b8a21f0580c0 None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:58.926785 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f7772-e9a2-49b4-b113-ed7d06a7343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:58.927382 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f7772-e9a2-49b4-b113-ed7d06a7343e admin admin] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:58.927664 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f7772-e9a2-49b4-b113-ed7d06a7343e admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:58.927940 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f7772-e9a2-49b4-b113-ed7d06a7343e admin admin] PATH_INFO: `/v3/projects` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:58.928612 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f7772-e9a2-49b4-b113-ed7d06a7343e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:58.931052 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f7772-e9a2-49b4-b113-ed7d06a7343e admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:58.958129 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1457/2933] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Sep 9 21:06:58 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:06:58.962546 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14e984-9071-479a-86bc-6bf44a5145fa admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:58.972656 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14e984-9071-479a-86bc-6bf44a5145fa admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:59.028039 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fe052-1fbc-4dfb-bfe2-4cf5bfe52403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:59.028646 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fe052-1fbc-4dfb-bfe2-4cf5bfe52403 admin admin] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:59.028928 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fe052-1fbc-4dfb-bfe2-4cf5bfe52403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:59.029205 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971fe052-1fbc-4dfb-bfe2-4cf5bfe52403 admin admin] PATH_INFO: `/v3/users` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:59.029831 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971fe052-1fbc-4dfb-bfe2-4cf5bfe52403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:59.031753 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971fe052-1fbc-4dfb-bfe2-4cf5bfe52403 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:59.052392 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1477/2934] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Sep 9 21:06:58 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 09 21:06:59.056998 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f7772-e9a2-49b4-b113-ed7d06a7343e admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:59.067294 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f7772-e9a2-49b4-b113-ed7d06a7343e admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:59.073203 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd385138-328b-4852-9c77-b71b3aa93f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:59.073805 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd385138-328b-4852-9c77-b71b3aa93f5a admin admin] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:59.074085 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd385138-328b-4852-9c77-b71b3aa93f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:59.074404 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd385138-328b-4852-9c77-b71b3aa93f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:59.075039 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd385138-328b-4852-9c77-b71b3aa93f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:59.076691 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd385138-328b-4852-9c77-b71b3aa93f5a admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:59.086487 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1458/2935] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:06:59.090572 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fe052-1fbc-4dfb-bfe2-4cf5bfe52403 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:59.100723 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971fe052-1fbc-4dfb-bfe2-4cf5bfe52403 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:59.105515 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad5843-0583-493d-aaf2-e61691d1efb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:59.106105 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad5843-0583-493d-aaf2-e61691d1efb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:59.106391 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad5843-0583-493d-aaf2-e61691d1efb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:59.106667 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad5843-0583-493d-aaf2-e61691d1efb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:59.107299 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad5843-0583-493d-aaf2-e61691d1efb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:59.108907 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad5843-0583-493d-aaf2-e61691d1efb2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:59.119878 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1478/2936] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Sep 9 21:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 09 21:06:59.123864 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd385138-328b-4852-9c77-b71b3aa93f5a admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:59.134422 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd385138-328b-4852-9c77-b71b3aa93f5a admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:59.139163 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d66e1-571d-4cd7-bf7d-dee1c4f4e770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:59.139797 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d66e1-571d-4cd7-bf7d-dee1c4f4e770 admin admin] REQUEST_METHOD: `PUT` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:59.140097 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d66e1-571d-4cd7-bf7d-dee1c4f4e770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:59.140371 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d66e1-571d-4cd7-bf7d-dee1c4f4e770 admin admin] PATH_INFO: `/v3/projects/87d67b6a11554487bca2c114e7e8035d/users/96f83cb18aef4b4989f065dea0b802e2/roles/c726a7153e6e47a3aa35a96221eb3d78` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:59.154881 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d66e1-571d-4cd7-bf7d-dee1c4f4e770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d67b6a11554487bca2c114e7e8035d, user_id=96f83cb18aef4b4989f065dea0b802e2, role_id=c726a7153e6e47a3aa35a96221eb3d78)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:59.157589 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d66e1-571d-4cd7-bf7d-dee1c4f4e770 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:59.170890 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1459/2937] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Sep 9 21:06:59 2022] PUT /identity/v3/projects/87d67b6a11554487bca2c114e7e8035d/users/96f83cb18aef4b4989f065dea0b802e2/roles/c726a7153e6e47a3aa35a96221eb3d78 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:06:59.181809 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429e145-3f06-4203-a340-fcae617cfb4e None None] REQUEST_METHOD: `POST` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:59.182301 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429e145-3f06-4203-a340-fcae617cfb4e None None] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:59.182412 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429e145-3f06-4203-a340-fcae617cfb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:59.210432 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.auth.core [None req-3429e145-3f06-4203-a340-fcae617cfb4e None None] MFA Rules not processed for user `96f83cb18aef4b4989f065dea0b802e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81397) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:06:59.211751 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-3429e145-3f06-4203-a340-fcae617cfb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:59.274836 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1479/2938] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:06:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:06:59.285304 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d66e1-571d-4cd7-bf7d-dee1c4f4e770 admin admin] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:06:59.287126 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-228d66e1-571d-4cd7-bf7d-dee1c4f4e770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:06:59.345430 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d66e1-571d-4cd7-bf7d-dee1c4f4e770 admin admin] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:06:59.349036 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5c0ec-94ae-4913-8b9d-58b3b687fc52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf65c58c74fc49e4ba7605f3c6c27f8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:06:59.349641 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5c0ec-94ae-4913-8b9d-58b3b687fc52 service cinder] REQUEST_METHOD: `GET` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:06:59.349921 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5c0ec-94ae-4913-8b9d-58b3b687fc52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:06:59.350195 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5c0ec-94ae-4913-8b9d-58b3b687fc52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:06:59.358894 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5c0ec-94ae-4913-8b9d-58b3b687fc52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:06:59.360365 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5c0ec-94ae-4913-8b9d-58b3b687fc52 service cinder] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:06:59.369576 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1460/2939] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:06:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:07:09.202174 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429e145-3f06-4203-a340-fcae617cfb4e None None] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:07:09.222584 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:07:09.266000 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429e145-3f06-4203-a340-fcae617cfb4e None None] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:07:09.270501 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb1e1a-98a0-4068-8c72-69215ae1caa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:07:09.271123 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb1e1a-98a0-4068-8c72-69215ae1caa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:07:09.271401 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb1e1a-98a0-4068-8c72-69215ae1caa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:07:09.271676 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb1e1a-98a0-4068-8c72-69215ae1caa2 admin admin] PATH_INFO: `/v3/users/96f83cb18aef4b4989f065dea0b802e2` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:07:09.272821 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb1e1a-98a0-4068-8c72-69215ae1caa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f83cb18aef4b4989f065dea0b802e2)` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:07:09.274732 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb1e1a-98a0-4068-8c72-69215ae1caa2 admin admin] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:07:09.320794 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-defb1e1a-98a0-4068-8c72-69215ae1caa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f83cb18aef4b4989f065dea0b802e2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:07:09.328138 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-defb1e1a-98a0-4068-8c72-69215ae1caa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f83cb18aef4b4989f065dea0b802e2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:07:09.340685 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-defb1e1a-98a0-4068-8c72-69215ae1caa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f83cb18aef4b4989f065dea0b802e2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:07:09.341324 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-defb1e1a-98a0-4068-8c72-69215ae1caa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f83cb18aef4b4989f065dea0b802e2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:07:09.341927 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.notifications [None req-defb1e1a-98a0-4068-8c72-69215ae1caa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f83cb18aef4b4989f065dea0b802e2'} {{(pid=81397) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:07:09.354386 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1480/2940] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Sep 9 21:07:09 2022] DELETE /identity/v3/users/96f83cb18aef4b4989f065dea0b802e2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 09 21:07:09.359573 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f436095-366f-4e54-9897-0a3d5fd48b7d None None] REQUEST_METHOD: `POST` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:07:09.360066 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f436095-366f-4e54-9897-0a3d5fd48b7d None None] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:07:09.360174 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f436095-366f-4e54-9897-0a3d5fd48b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:07:09.379748 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.auth.core [None req-4f436095-366f-4e54-9897-0a3d5fd48b7d None None] MFA Rules not processed for user `8564ddd7649c432ab9e6d44eaa5a7f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=81398) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 09 21:07:09.380974 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4f436095-366f-4e54-9897-0a3d5fd48b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:07:09.414208 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:07:09.443060 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1461/2941] 10.222.0.15 () {58 vars in 958 bytes} [Fri Sep 9 21:07:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 09 21:07:09.452762 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb1e1a-98a0-4068-8c72-69215ae1caa2 admin admin] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:07:09.454166 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-defb1e1a-98a0-4068-8c72-69215ae1caa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:07:09.511574 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb1e1a-98a0-4068-8c72-69215ae1caa2 admin admin] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:07:09.515365 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da584a0c-1394-4df6-b48a-f853dad7e78e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27e2be33ebdc4c5a97befcbd4d09ee4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:07:09.516014 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da584a0c-1394-4df6-b48a-f853dad7e78e service neutron] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:07:09.516305 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da584a0c-1394-4df6-b48a-f853dad7e78e service neutron] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:07:09.516583 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da584a0c-1394-4df6-b48a-f853dad7e78e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:07:09.525650 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da584a0c-1394-4df6-b48a-f853dad7e78e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:07:09.527763 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da584a0c-1394-4df6-b48a-f853dad7e78e service neutron] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:07:09.537509 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1481/2942] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:07:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:07:09.796299 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f436095-366f-4e54-9897-0a3d5fd48b7d None None] Authenticating user token {{(pid=81398) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:07:09.797838 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.fernet_utils [None req-4f436095-366f-4e54-9897-0a3d5fd48b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81398) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:07:09.811084 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f436095-366f-4e54-9897-0a3d5fd48b7d None None] Validating token access rules against request {{(pid=81398) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:07:09.815715 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b8c3a-8bbf-4fea-b325-8f8dc3a85c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8564ddd7649c432ab9e6d44eaa5a7f9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36e4c2d50d8d40f5b9937dbb73fb973f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81398) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:07:09.816377 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b8c3a-8bbf-4fea-b325-8f8dc3a85c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:07:09.816658 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b8c3a-8bbf-4fea-b325-8f8dc3a85c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:07:09.816935 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b8c3a-8bbf-4fea-b325-8f8dc3a85c98 admin admin] PATH_INFO: `/v3/projects/87d67b6a11554487bca2c114e7e8035d` {{(pid=81398) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:07:09.818047 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b8c3a-8bbf-4fea-b325-8f8dc3a85c98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87d67b6a11554487bca2c114e7e8035d)` {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:07:09.820085 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b8c3a-8bbf-4fea-b325-8f8dc3a85c98 admin admin] RBAC: Authorization granted {{(pid=81398) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:07:09.866173 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-475b8c3a-8bbf-4fea-b325-8f8dc3a85c98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87d67b6a11554487bca2c114e7e8035d', 'request_id': 'req-475b8c3a-8bbf-4fea-b325-8f8dc3a85c98'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:07:09.873951 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-475b8c3a-8bbf-4fea-b325-8f8dc3a85c98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87d67b6a11554487bca2c114e7e8035d', 'request_id': 'req-475b8c3a-8bbf-4fea-b325-8f8dc3a85c98'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:07:09.880038 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-475b8c3a-8bbf-4fea-b325-8f8dc3a85c98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87d67b6a11554487bca2c114e7e8035d', 'request_id': 'req-475b8c3a-8bbf-4fea-b325-8f8dc3a85c98'} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:07:09.890868 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-475b8c3a-8bbf-4fea-b325-8f8dc3a85c98 admin admin] The token cache is being invalidate because project 87d67b6a11554487bca2c114e7e8035d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81398) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 09 21:07:09.891159 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-475b8c3a-8bbf-4fea-b325-8f8dc3a85c98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:07:09.891788 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG keystone.notifications [None req-475b8c3a-8bbf-4fea-b325-8f8dc3a85c98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81398) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 09 21:07:09.893310 dv-cinder-831247-28-smb devstack@keystone.service[81398]: [pid: 81398|app: 0|req: 1462/2943] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Sep 9 21:07:09 2022] DELETE /identity/v3/projects/87d67b6a11554487bca2c114e7e8035d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 09 21:07:19.533333 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=70,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:07:19.887849 dv-cinder-831247-28-smb devstack@keystone.service[81398]: DEBUG dbcounter [-] [81398] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81398) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 09 21:09:17.308125 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da584a0c-1394-4df6-b48a-f853dad7e78e service neutron] Authenticating user token {{(pid=81397) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 09 21:09:17.309565 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-da584a0c-1394-4df6-b48a-f853dad7e78e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:09:17.377265 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da584a0c-1394-4df6-b48a-f853dad7e78e service neutron] Validating token access rules against request {{(pid=81397) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 09 21:09:17.435511 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372a477-b21b-4e09-9a5d-26cdceb1d647 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc28d9a1b3f4feca0deeb5f266f8b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a57df41195d240fe8f28ac49bfd37921', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81397) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 09 21:09:17.436163 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372a477-b21b-4e09-9a5d-26cdceb1d647 service placement] REQUEST_METHOD: `GET` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 09 21:09:17.436446 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372a477-b21b-4e09-9a5d-26cdceb1d647 service placement] SCRIPT_NAME: `/identity` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 09 21:09:17.436719 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372a477-b21b-4e09-9a5d-26cdceb1d647 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81397) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 09 21:09:17.438431 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.fernet_utils [None req-d372a477-b21b-4e09-9a5d-26cdceb1d647 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81397) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 09 21:09:17.450238 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372a477-b21b-4e09-9a5d-26cdceb1d647 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 09 21:09:17.451815 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372a477-b21b-4e09-9a5d-26cdceb1d647 service placement] RBAC: Authorization granted {{(pid=81397) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 09 21:09:17.462371 dv-cinder-831247-28-smb devstack@keystone.service[81397]: [pid: 81397|app: 0|req: 1482/2944] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Sep 9 21:09:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 09 21:09:27.457409 dv-cinder-831247-28-smb devstack@keystone.service[81397]: DEBUG dbcounter [-] [81397] Writing DB stats keystone:SELECT=58 {{(pid=81397) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}